Commit Graph
3073 Commits
Author SHA1 Message Date
Ruslan Kuprieiev bfdb990b3b utils: dont use str() for dvc_walk
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-13 11:51:14 +03:00
Ruslan Kuprieiev 16e162941e system: handle PurePath
------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/efiop/git/dvc/dvc/remote/local/__init__.py", line 280, in upload
    no_progress_bar=no_progress_bar,
  File "/Users/efiop/git/dvc/dvc/utils/__init__.py", line 129, in copyfile
    System.reflink(src, dest)
  File "/Users/efiop/git/dvc/dvc/system.py", line 125, in reflink
    ret = System._reflink_darwin(source, link_name)
  File "/Users/efiop/git/dvc/dvc/system.py", line 89, in _reflink_darwin
    ctypes.c_char_p(src.encode("utf-8")),
AttributeError: 'PosixPathInfo' object has no attribute 'encode'
------------------------------------------------------------

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-13 11:51:14 +03:00
Ruslan Kuprieiev dcca884696 Merge pull request #2126 from algomaster99/binary-info
Check whether package is installed from source or binary
2019-06-13 08:42:14 +03:00
Aman Sharma 11bafe4b7d Check whether package is installed from source or binary 2019-06-13 10:38:37 +05:30
Ruslan Kuprieiev 1c6f46c041 Merge pull request #2118 from pared/310
scm: git: end gitignore with newline
2019-06-12 18:08:43 +03:00
pawel 974bc39ae5 scm: git: end gitignore with newline 2019-06-12 16:52:36 +02:00
Ruslan Kuprieiev dd7876e72f Merge pull request #2117 from pared/2110
config: rename RemoteConfig variable in CmdRemoteConfig class
2019-06-12 12:10:29 +03:00
pawel 5ed6123101 config: rename RemoteConfig and CacheConfig variables in CmdRemoteConfig and CmdCacheDir class 2019-06-12 10:58:30 +02:00
Ruslan Kuprieiev 99d533310e Merge pull request #2044 from mroutis/fix-1762
remote: add other way to perform `cache_exists`
2019-06-12 00:10:55 +03:00
Mr. Outis d4f0d311fc remote: add other way to perform cache_exists
Close #1762
2019-06-11 08:55:48 -05:00
Ruslan Kuprieiev 7f73c6fa6f Merge pull request #2111 from sanidhyamangal/master
Patch: shared parser target content.
2019-06-11 16:31:09 +03:00
Ruslan Kuprieiev 39a8cab49d test: fix s3 test with extra args
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-11 16:28:11 +03:00
Sanidhya Mangal d356644754 code formatting: data sync 2019-06-11 18:31:34 +05:30
Ruslan Kuprieiev 4adcc8cee9 Merge pull request #2075 from Suor/refactor-path-info
dvc: path info refactoring
2019-06-11 15:50:26 +03:00
Alexander Schepanovski d80293c44d dvc: path info refactoring
Replaced Path* dataclasses with PathInfo/URLInfo/CloudURLInfo, which
know how parse, serialize, stringify and join themselves. They also
provide useful accessors like part of an url or pathlib.Path like
.parent or .name.

Along the way two families of bugs where fixed and should never occur in
the future:
- paths not matched as strings anymore, e.g. using str.startswith()
- Output.path is eliminated as ambiguous

Both families might had caused undefined surprising behavior when local
and remote paths clash.
2019-06-11 19:19:17 +07:00
Ruslan Kuprieiev 6a1629c559 Merge pull request #2090 from pared/hardlink_cache_check
remote: local: add cache status check hardlink optimization
2019-06-11 12:51:25 +03:00
pawel fe3f83ee05 remote: local: test: refactor unpacked dir tests 2019-06-11 10:21:57 +02:00
Sanidhya Mangal 2b3583a30e patched: shared parser target content 2019-06-11 00:23:54 +05:30
Sanidhya Mangal e44e3ad127 fixed: merge conflict 2019-06-11 00:19:47 +05:30
Sanidhya Mangal 1c14b8c579 patched: target content for shared parser 2019-06-11 00:17:47 +05:30
pawel ac5ca4656a remote: progress callback for unpacked dir creation 2019-06-10 20:19:47 +02:00
pawel cfbd381d42 remote: create unpacked dir after status check if needed 2019-06-10 14:44:03 +02:00
pawel b5464cbc59 remote: local: check if status verification dir already exists 2019-06-10 14:44:03 +02:00
pawel 5d25d5ce96 remote: local: refactor link method 2019-06-10 14:44:03 +02:00
pared 90ca5bd35a remote: local: add cache status check hardlink optimization 2019-06-10 14:44:03 +02:00
Ruslan Kuprieiev c587c59dc6 Merge pull request #2108 from ei-grad/config-choices
config: choices refactoring
2019-06-10 13:49:09 +03:00
Andrew Grigorev 00a2e9bb7f config: choices refactoring 2019-06-10 13:34:54 +03:00
Ruslan Kuprieiev 7dffa9f27d Merge pull request #2107 from dberenbaum/feature-1967
remote: add basic support for s3 server side encryption.
2019-06-09 00:33:55 +03:00
dlg227 fa6b764f97 refactor of remote s3 extra_args 2019-06-08 17:10:58 -04:00
Ruslan Kuprieiev ff12f90e6e Merge pull request #2103 from jorgeorpinel/master
dvc: standard way to refer to DVC-files
2019-06-07 23:34:48 +03:00
dlg227 fd3c84d682 remote: add basic support for s3 server side encryption.
Fixes #1967
2019-06-07 14:31:50 -04:00
Jorge Orpinel 3dffe8e5c0 dvc: i/DVC file[s]?/ -> /DVC-file($1)/
Standardizes way to refer to DVC-file(s)

(Related to #2102)
2019-06-07 03:33:20 -05:00
Ruslan Kuprieiev 1e7e2aaed5 Merge pull request #2098 from efiop/config
refactoring: move config logic from CLI to API
2019-06-06 21:53:53 +03:00
Ruslan Kuprieiev 8ef9133194 remote: use RemoteConfig class
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-06 16:00:44 +03:00
Ruslan Kuprieiev f69836c2b3 tests: remove fixme msg
https://github.com/iterative/dvc/issues/2086

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-06 14:41:02 +03:00
Ruslan Kuprieiev 9e9e078de3 config: move logic from CLI to API
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-06 14:41:02 +03:00
Ruslan Kuprieiev f41dcea248 tests: don't use var before assignment
```
repo_dir = <tests.basic_env.TestDirFixture object at 0x7f36c3f3d650>                  
git = <git.Repo "/tmp/dvc-test.2894.0LMoaT.eefefa48-172d-44e4-8c3d-4f65f76c78ee/.git">
                                                                                      
    @pytest.fixture                                                                   
    def dvc_repo(repo_dir, git):                                                      
        try:                                                                          
            dvc = DvcRepo.init(repo_dir._root_dir)                                    
            dvc.scm.commit("init dvc")                                                
            yield dvc                                                                 
        finally:                                                                      
>           dvc.scm.git.close()                                                       
E           UnboundLocalError: local variable 'dvc' referenced before assignment      
                                                                                      
/home/efiop/git/dvc/tests/conftest.py:76: UnboundLocalError                           
```
2019-06-06 13:44:13 +03:00
Ivan Shcheklein 67e6dc253a Update README.rst 2019-06-03 12:17:48 -07:00
Ruslan Kuprieiev 6e707277d6 Merge pull request #2082 from ei-grad/fix-pytest46-caplog
tests: fix for pytest>=4.6.0 caplog
2019-06-03 04:57:07 +03:00
Andrew Grigorev 5fce9a01e4 tests: fix for pytest>=4.6.0 caplog 2019-06-02 15:41:21 +03:00
Ruslan Kuprieiev 07e07489d0 Merge pull request #2084 from efiop/hdfs
Revert "tests: test hdfs on cron and releases"
2019-06-02 15:25:44 +03:00
Ruslan Kuprieiev 0242976734 Merge pull request #2081 from ei-grad/appveyor-all-branches
ci: don't limit appveyor to master and devel
2019-06-02 15:13:51 +03:00
Ruslan Kuprieiev 122b94129f Revert "tests: test hdfs on cron and releases"
This reverts commit 76c4755865.
2019-06-02 15:07:36 +03:00
Ruslan Kuprieiev 202c951b68 Merge pull request #2083 from efiop/hdfs
tests: test hdfs on cron and releases
2019-06-02 14:56:27 +03:00
Ruslan Kuprieiev 76c4755865 tests: test hdfs on cron and releases
Related to
https://github.com/iterative/dvc/issues/1629#issuecomment-498023424

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-02 14:44:56 +03:00
Ruslan Kuprieiev 616d79f2d8 tests: freeze pytest version 2019-06-02 13:59:20 +03:00
Andrew Grigorev a76b0acaed ci: don't limit appveyor to master and devel 2019-06-02 13:34:06 +03:00
Ivan Shcheklein 9a5a01b2b1 enable deepsource analyzer 2019-06-01 17:52:45 -07:00
Kurian Benoy c8b2c10d7f scripts:add description for debian package (#2025)
* scripts:add description for debian package

* add DESC variable to build_posix

* Fix typos
2019-06-01 20:35:47 +03:00
Aman Sharma 688bcaa0e3 Add info for link type and filesystem name (#1997)
* Add info for link and filesystem type

* Remove unnecessary `repo_dir` fixture

* Add cache info

* Classify `test_version.py` as functional test

* Remove redundancy

* Optimize some functions involved

* Add pathlib2 to install_requires

* Display fs type for cache directory

* Use `dvc.utils.compat` to import Path

* Remove redundancy in tests and make logs more descriptive
2019-06-01 14:40:59 +03:00