Commit Graph
3092 Commits
Author SHA1 Message Date
Mr. Outis 223f0f6c0f status: show a progress bar while gathering info
Fix #1762
Fix #1825
2019-06-14 16:39:30 -05:00
Ruslan Kuprieiev ade4261cf5 Merge pull request #2133 from Suor/push-pull-error-code
dvc: return non zero error code on push/pull/fetch error
2019-06-14 20:43:02 +03:00
Alexander Schepanovski db75693fe1 dvc: return non zero error code on push/pull/fetch error
Closes #2038
2019-06-14 23:25:39 +07:00
Ruslan Kuprieiev 2f02280483 Merge pull request #2129 from Suor/download-refactor
dvc: unify remote upload/download code
2019-06-14 11:56:43 +03:00
Ruslan Kuprieiev 765c8570d2 Merge pull request #2121 from sanidhyamangal/master
extended patch for pr 2111
2019-06-14 11:50:22 +03:00
Alexander Schepanovski 80ca3eedc8 dvc: unify remote upload/download code
Bugs fixed along the way:
- unable to copy between buckets in GS
- unneeded connection init in RemoteGS.copy()
- connection not closed on some errors in RemoteSSH.download()
- inconsistent progress bar handling
2019-06-14 12:13:11 +07:00
Ruslan Kuprieiev 670af9afd5 Merge pull request #2130 from efiop/2039
dvc: move Updater out of Repo()
2019-06-14 01:07:14 +03:00
Ruslan Kuprieiev 0d330c1b9b dvc: move Updater out of Repo()
Fixes #2039

Required by #2012 to be able to fetch data through the API without
interuption from updater.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-14 00:54:36 +03:00
Ruslan Kuprieiev b1eebe2f86 diff: don't use self
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-14 00:20:56 +03:00
Sanidhya Mangal f39bb551d7 fixed: split lines for datasync 2019-06-14 02:49:14 +05:30
Sanidhya Mangal a831918195 fixed: splited helper text in data sync 2019-06-13 23:07:29 +05:30
Sanidhya Mangal 47cb449165 fixed: whitespace error 2019-06-13 23:00:25 +05:30
Sanidhya Mangal 62f55d6617 Merge remote-tracking branch 'upstream/master' 2019-06-13 22:50:07 +05:30
Sanidhya Mangal 498bbc647d fixed: lenghty message in help command 2019-06-13 22:49:39 +05:30
Ruslan Kuprieiev f36162d613 Merge pull request #2124 from efiop/reflink
system: handle PurePath
2019-06-13 12:09:26 +03:00
Ruslan Kuprieiev bfdb990b3b utils: dont use str() for dvc_walk
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-13 11:51:14 +03:00
Ruslan Kuprieiev 16e162941e system: handle PurePath
------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/efiop/git/dvc/dvc/remote/local/__init__.py", line 280, in upload
    no_progress_bar=no_progress_bar,
  File "/Users/efiop/git/dvc/dvc/utils/__init__.py", line 129, in copyfile
    System.reflink(src, dest)
  File "/Users/efiop/git/dvc/dvc/system.py", line 125, in reflink
    ret = System._reflink_darwin(source, link_name)
  File "/Users/efiop/git/dvc/dvc/system.py", line 89, in _reflink_darwin
    ctypes.c_char_p(src.encode("utf-8")),
AttributeError: 'PosixPathInfo' object has no attribute 'encode'
------------------------------------------------------------

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-13 11:51:14 +03:00
Sanidhya Mangal 61923a6687 Merge remote-tracking branch 'upstream/master' 2019-06-13 13:06:10 +05:30
Ruslan Kuprieiev dcca884696 Merge pull request #2126 from algomaster99/binary-info
Check whether package is installed from source or binary
2019-06-13 08:42:14 +03:00
Aman Sharma 11bafe4b7d Check whether package is installed from source or binary 2019-06-13 10:38:37 +05:30
Sanidhya Mangal e954a918ec Merge remote-tracking branch 'upstream/master' 2019-06-12 22:53:09 +05:30
Ruslan Kuprieiev 1c6f46c041 Merge pull request #2118 from pared/310
scm: git: end gitignore with newline
2019-06-12 18:08:43 +03:00
pawel 974bc39ae5 scm: git: end gitignore with newline 2019-06-12 16:52:36 +02:00
Ruslan Kuprieiev dd7876e72f Merge pull request #2117 from pared/2110
config: rename RemoteConfig variable in CmdRemoteConfig class
2019-06-12 12:10:29 +03:00
pawel 5ed6123101 config: rename RemoteConfig and CacheConfig variables in CmdRemoteConfig and CmdCacheDir class 2019-06-12 10:58:30 +02:00
Sanidhya Mangal 771b84a9f8 Merge remote-tracking branch 'upstream/master' 2019-06-12 13:59:33 +05:30
Sanidhya Mangal cb4a745d1b updated: help message for shared parent parser 2019-06-12 13:59:07 +05:30
Ruslan Kuprieiev 99d533310e Merge pull request #2044 from mroutis/fix-1762
remote: add other way to perform `cache_exists`
2019-06-12 00:10:55 +03:00
Mr. Outis d4f0d311fc remote: add other way to perform cache_exists
Close #1762
2019-06-11 08:55:48 -05:00
Ruslan Kuprieiev 7f73c6fa6f Merge pull request #2111 from sanidhyamangal/master
Patch: shared parser target content.
2019-06-11 16:31:09 +03:00
Ruslan Kuprieiev 39a8cab49d test: fix s3 test with extra args
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-06-11 16:28:11 +03:00
Sanidhya Mangal d356644754 code formatting: data sync 2019-06-11 18:31:34 +05:30
Ruslan Kuprieiev 4adcc8cee9 Merge pull request #2075 from Suor/refactor-path-info
dvc: path info refactoring
2019-06-11 15:50:26 +03:00
Alexander Schepanovski d80293c44d dvc: path info refactoring
Replaced Path* dataclasses with PathInfo/URLInfo/CloudURLInfo, which
know how parse, serialize, stringify and join themselves. They also
provide useful accessors like part of an url or pathlib.Path like
.parent or .name.

Along the way two families of bugs where fixed and should never occur in
the future:
- paths not matched as strings anymore, e.g. using str.startswith()
- Output.path is eliminated as ambiguous

Both families might had caused undefined surprising behavior when local
and remote paths clash.
2019-06-11 19:19:17 +07:00
Ruslan Kuprieiev 6a1629c559 Merge pull request #2090 from pared/hardlink_cache_check
remote: local: add cache status check hardlink optimization
2019-06-11 12:51:25 +03:00
pawel fe3f83ee05 remote: local: test: refactor unpacked dir tests 2019-06-11 10:21:57 +02:00
Sanidhya Mangal 2b3583a30e patched: shared parser target content 2019-06-11 00:23:54 +05:30
Sanidhya Mangal e44e3ad127 fixed: merge conflict 2019-06-11 00:19:47 +05:30
Sanidhya Mangal 1c14b8c579 patched: target content for shared parser 2019-06-11 00:17:47 +05:30
pawel ac5ca4656a remote: progress callback for unpacked dir creation 2019-06-10 20:19:47 +02:00
pawel cfbd381d42 remote: create unpacked dir after status check if needed 2019-06-10 14:44:03 +02:00
pawel b5464cbc59 remote: local: check if status verification dir already exists 2019-06-10 14:44:03 +02:00
pawel 5d25d5ce96 remote: local: refactor link method 2019-06-10 14:44:03 +02:00
pared 90ca5bd35a remote: local: add cache status check hardlink optimization 2019-06-10 14:44:03 +02:00
Ruslan Kuprieiev c587c59dc6 Merge pull request #2108 from ei-grad/config-choices
config: choices refactoring
2019-06-10 13:49:09 +03:00
Andrew Grigorev 00a2e9bb7f config: choices refactoring 2019-06-10 13:34:54 +03:00
Ruslan Kuprieiev 7dffa9f27d Merge pull request #2107 from dberenbaum/feature-1967
remote: add basic support for s3 server side encryption.
2019-06-09 00:33:55 +03:00
dlg227 fa6b764f97 refactor of remote s3 extra_args 2019-06-08 17:10:58 -04:00
Ruslan Kuprieiev ff12f90e6e Merge pull request #2103 from jorgeorpinel/master
dvc: standard way to refer to DVC-files
2019-06-07 23:34:48 +03:00
dlg227 fd3c84d682 remote: add basic support for s3 server side encryption.
Fixes #1967
2019-06-07 14:31:50 -04:00