Commit Graph
1319 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 78e5b166fe dvc: replace StageNotFoundError with NotDvcFileError
Fixes #760

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-13 14:00:03 +03:00
Ruslan Kuprieiev 0ffcdd669a remove: fix error msg
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-13 13:34:46 +03:00
Ruslan Kuprieiev 569e40eded Merge pull request #767 from efiop/master
remove: add `-o|--outs` and `-p|--purge` options
2018-06-13 13:21:46 +03:00
Ruslan Kuprieiev 5902e6066c remove: add -o|--outs and -p|--purge options
Fixes #761

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-13 13:15:40 +03:00
Ruslan Kuprieiev 582cb9e064 Merge pull request #759 from franekp/master
Fix bottlenecks related to large number of files.
2018-06-10 21:04:22 +03:00
Franciszek Piszcz e380a4a858 Fix bottlenecks related to large number of files. 2018-06-10 16:35:49 +02:00
Ruslan Kuprieiev 35f5945720 Merge pull request #757 from efiop/master
dvc: initial hdfs support
2018-06-10 05:36:46 +03:00
Ruslan Kuprieiev ff0d91737b dvc: initial hdfs support
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-10 05:32:16 +03:00
Ruslan Kuprieiev 77b814f039 Merge pull request #756 from efiop/master
Support deps/outputs that are relative to specific remote
2018-06-09 02:08:41 +03:00
Ruslan Kuprieiev a734e07776 dvc: support deps/outputs that are relative to specific remote
Fixes #748

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-09 02:03:02 +03:00
Ruslan Kuprieiev fecc38e602 remote: use default urls
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-09 01:09:44 +03:00
Ivan Shcheklein 6fe26a0bdc minor: fix links in README to target dvc.org instead of dataversioncontrol.com 2018-06-08 12:20:12 -07:00
Ruslan Kuprieiev 2cd4312423 Merge pull request #753 from efiop/master
status: report callback stages as changed
2018-06-08 17:16:24 +03:00
Ruslan Kuprieiev e68137181e status: report callback stages as changed
Fixes #751

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-08 16:43:50 +03:00
Ruslan Kuprieiev 2e347847ec Merge pull request #752 from efiop/master
stage: try to specify user's shell when running commands
2018-06-07 23:49:32 +03:00
Ruslan Kuprieiev c136297b82 stage: try to specify user's shell when running commands
Fixes #749

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-07 23:19:29 +03:00
Ruslan Kuprieiev 6218124764 travis: run hadoop only on linux 2018-06-06 17:09:38 +03:00
Ruslan Kuprieiev 22718faf9c Merge pull request #747 from efiop/master
travis: run docker image with hadoop
2018-06-06 14:58:47 +03:00
Ruslan Kuprieiev a2bc64e85f travis: run hadoop docker image
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-06 14:34:54 +03:00
Ruslan Kuprieiev f2a5058a74 Merge pull request #746 from efiop/master
checkout: create dir even if it is empty
2018-06-06 02:57:49 +03:00
Ruslan Kuprieiev 38c585a5f9 checkout: create dir even if it is empty
Fixes #737

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-06 02:37:51 +03:00
Ruslan Kuprieiev 408f96b31c Merge pull request #745 from efiop/master
dvc: add --cwd for dvc repro
2018-06-06 02:21:14 +03:00
Ruslan Kuprieiev 9389422f0b dvc: add --cwd for dvc repro
Fixes #401

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-06 01:42:06 +03:00
Ruslan Kuprieiev 5d169916de Merge pull request #740 from efiop/master
Add initial support for s3/gs outputs/deps/cache_dirs
2018-06-04 22:38:24 +03:00
Ruslan Kuprieiev dd610c04fb test: add test for s3/gs out/dep/cache
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 585c27f354 cloud: use project.cache.local instead of project.cache
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 346ef139dd out: properly remove outputs when reproducing
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 331e3b2bf9 cache: fix cache_dir resolving
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 7a7c9e7713 dvc: fix import conflicts
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 1ef21039c4 remote: use Remote() func to determine remote type 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 42265339a8 remote: rename Remote -> RemoteBase
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev fc53971f2b dvc: temporarily only count local cache as used cache
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 484b04cb68 outs: raise exception if no cache location setup for s3/gs
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 88397ef430 dvc: use Remote concept in existing code
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 6f4d0cd74a cache: use atomic move to avoid using Lock()
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev f03ea7a915 dvc: move link_state from Cache to Project
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 08dcd8490e outs/deps: remove loadd
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 5c1748c15c outs/deps: remove loads method
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev fbfdecd1de outs/deps: remove type-specific SCHEMAs
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev f3b2497fb9 deps/outs: remove load{s,d}_from methods
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev e0a42f1265 outs: support gs/s3 as an output without cache
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 2e78bb2a69 deps: s3/gs: check if key exists
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 456ba271b3 dvc: rename dataversioncontrol/dvc into iterative/dvc
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-30 04:14:16 +03:00
Ruslan Kuprieiev 95870ce769 README: fix typo in format 2018-05-24 20:08:22 +03:00
Ruslan Kuprieiev 92cbda749f README: use remotes instead of an obsoleted model 2018-05-24 20:07:57 +03:00
Ruslan Kuprieiev 33b26278fe Merge pull request #731 from efiop/master
test: temporarily disable gs dependency test on CI
2018-05-24 19:05:03 +03:00
Ruslan Kuprieiev ac3d37e58c test: temporarily disable gs dependency test on CI
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-24 18:58:20 +03:00
Ruslan Kuprieiev a35b3aa67a travis: specify BOTO_CONFIG=/dev/null
See https://github.com/travis-ci/travis-ci/issues/7940
2018-05-24 18:50:52 +03:00
Ruslan Kuprieiev 7a3aa54293 Merge pull request #730 from efiop/master
gs/s3 as dependency
2018-05-24 18:31:09 +03:00
Ruslan Kuprieiev b85c41c734 updater: use response.json()
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-24 18:24:18 +03:00