Commit Graph
3057 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 4adcc8cee9 Merge pull request #2075 from Suor/refactor-path-info
dvc: path info refactoring
2019-06-11 15:50:26 +03:00
Alexander Schepanovski d80293c44d dvc: path info refactoring
Replaced Path* dataclasses with PathInfo/URLInfo/CloudURLInfo, which
know how parse, serialize, stringify and join themselves. They also
provide useful accessors like part of an url or pathlib.Path like
.parent or .name.

Along the way two families of bugs where fixed and should never occur in
the future:
- paths not matched as strings anymore, e.g. using str.startswith()
- Output.path is eliminated as ambiguous

Both families might had caused undefined surprising behavior when local
and remote paths clash.
2019-06-11 19:19:17 +07:00
Ruslan Kuprieiev 6a1629c559 Merge pull request #2090 from pared/hardlink_cache_check
remote: local: add cache status check hardlink optimization
2019-06-11 12:51:25 +03:00
pawel fe3f83ee05 remote: local: test: refactor unpacked dir tests 2019-06-11 10:21:57 +02:00
pawel ac5ca4656a remote: progress callback for unpacked dir creation 2019-06-10 20:19:47 +02:00
pawel cfbd381d42 remote: create unpacked dir after status check if needed 2019-06-10 14:44:03 +02:00
pawel b5464cbc59 remote: local: check if status verification dir already exists 2019-06-10 14:44:03 +02:00
pawel 5d25d5ce96 remote: local: refactor link method 2019-06-10 14:44:03 +02:00
pared 90ca5bd35a remote: local: add cache status check hardlink optimization 2019-06-10 14:44:03 +02:00
Ruslan Kuprieiev c587c59dc6 Merge pull request #2108 from ei-grad/config-choices
config: choices refactoring
2019-06-10 13:49:09 +03:00
Andrew Grigorev 00a2e9bb7f config: choices refactoring 2019-06-10 13:34:54 +03:00
Ruslan Kuprieiev 7dffa9f27d Merge pull request #2107 from dberenbaum/feature-1967
remote: add basic support for s3 server side encryption.
2019-06-09 00:33:55 +03:00
dlg227 fa6b764f97 refactor of remote s3 extra_args 2019-06-08 17:10:58 -04:00
Ruslan Kuprieiev ff12f90e6e Merge pull request #2103 from jorgeorpinel/master
dvc: standard way to refer to DVC-files
2019-06-07 23:34:48 +03:00
dlg227 fd3c84d682 remote: add basic support for s3 server side encryption.
Fixes #1967
2019-06-07 14:31:50 -04:00
Jorge Orpinel 3dffe8e5c0 dvc: i/DVC file[s]?/ -> /DVC-file($1)/
Standardizes way to refer to DVC-file(s)

(Related to #2102)
2019-06-07 03:33:20 -05:00
Ruslan Kuprieiev 1e7e2aaed5 Merge pull request #2098 from efiop/config
refactoring: move config logic from CLI to API
2019-06-06 21:53:53 +03:00
Ruslan Kuprieiev 8ef9133194 remote: use RemoteConfig class
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-06 16:00:44 +03:00
Ruslan Kuprieiev f69836c2b3 tests: remove fixme msg
https://github.com/iterative/dvc/issues/2086

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-06 14:41:02 +03:00
Ruslan Kuprieiev 9e9e078de3 config: move logic from CLI to API
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-06 14:41:02 +03:00
Ruslan Kuprieiev f41dcea248 tests: don't use var before assignment
```
repo_dir = <tests.basic_env.TestDirFixture object at 0x7f36c3f3d650>                  
git = <git.Repo "/tmp/dvc-test.2894.0LMoaT.eefefa48-172d-44e4-8c3d-4f65f76c78ee/.git">
                                                                                      
    @pytest.fixture                                                                   
    def dvc_repo(repo_dir, git):                                                      
        try:                                                                          
            dvc = DvcRepo.init(repo_dir._root_dir)                                    
            dvc.scm.commit("init dvc")                                                
            yield dvc                                                                 
        finally:                                                                      
>           dvc.scm.git.close()                                                       
E           UnboundLocalError: local variable 'dvc' referenced before assignment      
                                                                                      
/home/efiop/git/dvc/tests/conftest.py:76: UnboundLocalError                           
```
2019-06-06 13:44:13 +03:00
Ivan Shcheklein 67e6dc253a Update README.rst 2019-06-03 12:17:48 -07:00
Ruslan Kuprieiev 6e707277d6 Merge pull request #2082 from ei-grad/fix-pytest46-caplog
tests: fix for pytest>=4.6.0 caplog
2019-06-03 04:57:07 +03:00
Andrew Grigorev 5fce9a01e4 tests: fix for pytest>=4.6.0 caplog 2019-06-02 15:41:21 +03:00
Ruslan Kuprieiev 07e07489d0 Merge pull request #2084 from efiop/hdfs
Revert "tests: test hdfs on cron and releases"
2019-06-02 15:25:44 +03:00
Ruslan Kuprieiev 0242976734 Merge pull request #2081 from ei-grad/appveyor-all-branches
ci: don't limit appveyor to master and devel
2019-06-02 15:13:51 +03:00
Ruslan Kuprieiev 122b94129f Revert "tests: test hdfs on cron and releases"
This reverts commit 76c4755865.
2019-06-02 15:07:36 +03:00
Ruslan Kuprieiev 202c951b68 Merge pull request #2083 from efiop/hdfs
tests: test hdfs on cron and releases
2019-06-02 14:56:27 +03:00
Ruslan Kuprieiev 76c4755865 tests: test hdfs on cron and releases
Related to
https://github.com/iterative/dvc/issues/1629#issuecomment-498023424

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-02 14:44:56 +03:00
Ruslan Kuprieiev 616d79f2d8 tests: freeze pytest version 2019-06-02 13:59:20 +03:00
Andrew Grigorev a76b0acaed ci: don't limit appveyor to master and devel 2019-06-02 13:34:06 +03:00
Ivan Shcheklein 9a5a01b2b1 enable deepsource analyzer 2019-06-01 17:52:45 -07:00
Kurian Benoy c8b2c10d7f scripts:add description for debian package (#2025)
* scripts:add description for debian package

* add DESC variable to build_posix

* Fix typos
2019-06-01 20:35:47 +03:00
Aman Sharma 688bcaa0e3 Add info for link type and filesystem name (#1997)
* Add info for link and filesystem type

* Remove unnecessary `repo_dir` fixture

* Add cache info

* Classify `test_version.py` as functional test

* Remove redundancy

* Optimize some functions involved

* Add pathlib2 to install_requires

* Display fs type for cache directory

* Use `dvc.utils.compat` to import Path

* Remove redundancy in tests and make logs more descriptive
2019-06-01 14:40:59 +03:00
Ruslan Kuprieiev 0935cfae2a tests: show how long tests took 2019-05-31 11:19:18 +03:00
Ruslan Kuprieiev f6a0a45fa4 Merge pull request #2077 from ricardoserradas/riserrad/comma-to-message
Adding a comma to the message to improve understanding
2019-05-31 08:57:13 +03:00
Ricardo Serradas e93534abc1 Adding a comma to the message to improve understanding 2019-05-30 14:21:10 -07:00
Ruslan Kuprieiev ea54a2b2b4 appveyor: don't install git with cinst 2019-05-30 21:47:47 +03:00
Ruslan Kuprieiev fede39452b appveyor: fix typo 2019-05-30 21:46:23 +03:00
Ruslan Kuprieiev 01b8e55259 appveyor: install git 2019-05-30 21:45:02 +03:00
Ruslan Kuprieiev 677a52b830 appveyor: use quotes 2019-05-30 21:42:07 +03:00
Ruslan Kuprieiev c7b7fba3a2 appveyor: fix typo 2019-05-30 21:38:43 +03:00
Ruslan Kuprieiev dba34ec3f1 appveyor: don't forget to modify PATH for custom python
Related to https://github.com/iterative/dvc/issues/2061
2019-05-30 21:10:28 +03:00
Ruslan Kuprieiev 556b33ba28 Merge pull request #2074 from ei-grad/no-pool-for-single-thread
remote: don't use threadpool for single thread
2019-05-30 19:07:32 +03:00
Andrew Grigorev a1d3013596 remote: don't use threadpool for single thread 2019-05-30 18:27:00 +03:00
Jorge Orpinel 8df0712b06 update zsh autocomplete script with current command help messages + (#2064)
* dvc: fixes dvc.scm.Git.get_diff_trees docstring imprecision.

Parentheses were used in the "Returns:" description but its a dict, so changed to curly brackets;
and specified the 2 possible forms of the return structure.

* dvc: updates zsh autocomplete script with current command help messages.

Comparing vs actually running each command's `-h` help output.

* dvc: begins updating bask autocomplete script...

Only reorders existing commands and adds comments for those missing.

* scripts: removes temporary comments in bash autocomplete script.

Per https://github.com/iterative/dvc/pull/2064#pullrequestreview-243578115

Related to #2069
2019-05-30 05:57:30 +03:00
Ruslan Kuprieiev ca63d729e9 Merge pull request #2072 from pared/optimize_mtime_and_size
make get_mtime_and_size use single stat call for files
2019-05-30 03:21:11 +03:00
Ruslan Kuprieiev bae3134d15 Merge pull request #2071 from mroutis/progress-be-quiet
progress: bug fix with --quiet
2019-05-30 03:20:59 +03:00
pawel 012e045837 make get_mtime_and_size use single stat call for files 2019-05-29 16:47:13 -07:00
Mr. Outis e3b3f3f371 progress: bug fix with --quiet
Related to #1377
2019-05-29 16:45:10 -07:00