Ruslan Kuprieiev
2c003fdc04
Merge pull request #2426 from mroutis/close-1652
...
ssh: support linking
2019-09-09 20:48:22 +03:00
Ruslan Kuprieiev
b0b958e14b
Merge pull request #2481 from efiop/2476
...
scm: remove `pkg install` leftovers
2019-09-09 20:16:01 +03:00
Ruslan Kuprieiev
a529f7d8ad
Merge pull request #2479 from efiop/always_reproduce
...
run: introduce --always-changed
2019-09-09 19:45:35 +03:00
Ruslan Kuprieiev
ce27444dd2
scm: remove pkg install leftovers
...
Leftover code was causing problems when working with symlinks, because
it tried to use `realpath` on symlinks to further use it to determine
parent directory.
Fixes #2476
2019-09-09 19:43:10 +03:00
Mr. Outis
2a847ef25c
tests: ignore ssh's hardlink and copy tests on windows
2019-09-09 11:20:29 -05:00
Ruslan Kuprieiev
357ce82f28
run: introduce --always-changed
...
This is an extension of our callback stages (no deps, so always
considered as changed) for stages with dependencies, so that these
stages could be used properly in the middle of the DAG. See attached
issue for more info.
Related to #2378
2019-09-09 18:03:28 +03:00
pawel
90738fab9c
stage: prevent writing default wdir into stage file
2019-09-09 16:20:33 +02:00
Ruslan Kuprieiev
b3e4ff7cba
test: install: don't forget to adjust hook tests
2019-09-09 05:10:30 +03:00
Mr. Outis and Ruslan Kuprieiev
5103dfd4aa
tests: fix skipif on ssh/test_connection.py
...
Co-Authored-By: Ruslan Kuprieiev <[email protected] >
2019-09-07 21:38:50 -05:00
Mr. Outis
b4507444d5
version: adjust get_fs_type to discover all partitions
2019-09-06 19:27:23 -05:00
Paweł Redzyński
0a214ae15a
test: add: remove TestDvcGit ( #2467 )
2019-09-06 23:15:26 +03:00
Mr. Outis
05cbe0c922
tests: support windows
2019-09-06 14:17:44 -05:00
Mr. Outis
737f1e141d
tests: use repo_dir instead of custom fixtures
2019-09-06 13:28:48 -05:00
Mr. Outis
b903fe8023
get: show error message when path is a DVC-file ( #2470 )
...
* get: show error message when path is a DVC-file
Fix #2468
* exceptions: rename output for data artifact
* get: use method to indetify if file is a DVC-file
* exceptions: change GetDVCFileError message
2019-09-06 21:11:23 +03:00
Mr. Outis
dd1d5bdbb0
tests: PosixPath to string in chdir_tmp fixture
2019-09-06 12:57:06 -05:00
Mr. Outis
73133e8c7a
tests: [re] fix hardlink stuff with HDFS
2019-09-06 12:35:38 -05:00
Mr. Outis
f97c33178f
tests: use copy as cache type for HDFS
2019-09-06 12:05:53 -05:00
Mr. Outis
6eb26de856
fix tests
2019-09-06 11:32:31 -05:00
Mr. Outis
42168d34f3
Merge branch 'master' into close-1652
2019-09-06 09:29:54 -05:00
5ec1d274ae
remote: base: don't checkout existing file ( #2358 )
...
* remote: base: don't checkout existing file
* remote: _checkout_file: split to smaller methods
* state: local: verify if file needs checkout considering link type and access rights
* tests: checkout: test avoiding unnecessary copying
* efiop review refactor
* remote: local: refactor _needs_checkout NOTE
* remote: local: remove bool cast for `protected`, wrap linking in try
* test: checkout: test relinking upon existing cache
* stage: remove obsolete unprotecing from Stage.create
* test: checkout: refactor setting link type
* test: checkout: parametrize relinking test
* remote: local: don't remove cache test file on cache_copy test
* remote: base: remove force from _needs_checkout arguments
* Update dvc/remote/local/__init__.py
Co-Authored-By: Alexander Schepanovski <[email protected] >
* suor review refactor
* remote: base: re-add note why do we unprotect on _checkout_file
* test: checkout: tests for relinking and resetting target protection
* remove checkout behavior change
* remove unused imports
* remote: base: reuse __checkout_file in __checkout_dir
* initial dir
* checkout: test: should relink on repeated add
* remote: cleanup commented lines
* remote: base/local: add save_link flag to _checkout_file
* remote: local: add allow_copy flag to unprotect method
* Update dvc/remote/local/__init__.py
Co-Authored-By: Ruslan Kuprieiev <[email protected] >
* remote: local: remove unnecessary removal warning on _checkout_file
* remote: local: proper cache link type detection
* test: checkout: move repeated add tests
* Update dvc/remote/local/__init__.py
Co-Authored-By: Ruslan Kuprieiev <[email protected] >
* remote: base: remove _needs_checkout
* Update dvc/remote/base.py
Co-Authored-By: Ruslan Kuprieiev <[email protected] >
* remote: base: remove wrappers from _checkout_file
2019-09-06 17:20:32 +03:00
Mr. Outis
369146a926
Merge branch 'master' into close-1652
2019-09-05 10:47:18 -05:00
Mr. Outis
0c231b68d7
fix formatting
2019-09-04 22:07:02 -05:00
Mr. Outis
2fe6fc1ba6
refactor: use a module for slow link detection
2019-09-04 19:32:55 -05:00
pawel
651d925578
stage: don't unprotect outs on stage create
2019-09-04 12:54:32 +02:00
pawel
4236f18e0c
repo: get: intercept and convert NotDvcRepoErro to UrlNotDvcRepoError
2019-09-03 13:59:04 +02:00
Mr. Outis
3c69dc9fd5
tests: unit ssh symlink
2019-09-03 00:04:44 -05:00
Mr. Outis
da65f8fe9a
tests: functional ssh symlink
2019-08-31 13:34:48 -05:00
Mr. Outis
7b4584f86c
ssh: stat -> lstat
2019-08-31 13:02:17 -05:00
Mr. Outis
0fc83be9ff
tests: ssh hardlink optimization
2019-08-31 03:23:35 -05:00
Mr. Outis
0361b1b9c0
tests: ssh connection link methods
2019-08-31 01:56:00 -05:00
Mr. Outis
5f89242791
Merge branch 'master' into close-1652
2019-08-31 00:27:28 -05:00
Mr. Outis
40c61b3aaa
remote: abstract link logic to base
2019-08-30 23:51:20 -05:00
Alexander Schepanovski
8984e9fed4
dvc: use wdir == "." on add
...
Fixes #2404
2019-08-24 10:23:41 +07:00
Ruslan Kuprieiev
e4f7c6124c
Merge pull request #2424 from JoshuaPostel/ssh-gss-auth
...
ssh: add gss_auth option
2019-08-22 01:48:50 +03:00
joshua postel
cc87531df3
tests: added test for ssh gss_auth
...
Fixes #2327
2019-08-21 13:20:38 -04:00
Ruslan Kuprieiev
2d9497c524
Merge pull request #2421 from pared/2328
...
repo: move: save stage after moving
2019-08-21 16:33:13 +03:00
Ruslan Kuprieiev
5aa9a2f501
Merge pull request #2333 from casperdcl/tqdm
...
change progress bar backend to tqdm
2019-08-21 15:38:51 +03:00
pared
c4de07b2bd
repo: move: save stage after moving
2019-08-21 14:34:23 +02:00
Casper da Costa-Luis
4bd2ce25e1
get_files_number test fix
2019-08-20 14:27:20 +01:00
Mr. Outis and Ruslan Kuprieiev
8918bdc383
http: add exception when trying to traverse remote ( #2411 )
...
* http: add exception when trying to traverse remote
Fix #2380
* http: exception raise on `list_cache_paths` instead of `all`
`NotImplementedError` -> `RemoteActionNotImplemented`
* http: raise exception on `__init__`
* set default no_traverse to True on remote base
* tests: explicitly use traverse on data cloud and no traverse with HTTP
* remote: define a new RemoteConfigError
* remote: reuse ConfigError instead of RemoteConfigError
* tests: set no_traverse to False with SSHMocked
* deepsource: fix minor issue with spacing
* remove blankspace
Co-Authored-By: Ruslan Kuprieiev <[email protected] >
2019-08-20 00:47:15 +03:00
Ruslan Kuprieiev
f0c12ea162
Merge pull request #2407 from efiop/master
...
test: run: refactor signal handler tests
2019-08-19 15:22:25 +03:00
Ruslan Kuprieiev
89d3ccae0d
test: run: refactor signal handler tests
...
Current test is testing for signal handler restoration in an obscure
way. As a result, the test wasn't actually testing anything, because
KeyboardInterrupt is raised by default_int_handler, and so raising it
in a mock won't be caught by signal handlers, because they are dealing
with real singnals.
Fix #2406
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2019-08-19 14:49:19 +03:00
Casper da Costa-Luis
1c8bf11238
Merge remote-tracking branch 'upstream/master' into tqdm
2019-08-19 11:15:13 +01:00
Casper da Costa-Luis
093ad20a84
flake8 unused imports
2019-08-17 16:15:15 +01:00
Casper da Costa-Luis
534d6fdb0c
remove defunct test, extraneous comments
...
- https://github.com/iterative/dvc/pull/2333#discussion_r314927966
2019-08-17 15:43:54 +01:00
Gunnlaugur Thor Briem
e1dd75edcd
fix: don't dvc checkout on git file checkout
...
Closes #2400
2019-08-16 22:11:16 +00:00
Casper da Costa-Luis
60566b380e
minor test update
2019-08-16 22:33:00 +01:00
Casper da Costa-Luis
adf05e6ff0
minor rename
2019-08-16 22:32:47 +01:00
Casper da Costa-Luis
b018933b5a
fix py2 MagicMock(sys.stderr).encoding in tests
2019-08-16 22:26:19 +01:00
Alexander Schepanovski
85289ad00b
api: wrap not found errors
...
api.open()/read() will now raise OutputFileMissingError and
Remote*.open() will raise FileNotFoundError if target file is absent.
2019-08-15 23:20:48 +07:00