Commit Graph
1333 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 83d831735c dvc: introduce -m option for repro
Fixes #188

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-16 16:01:32 +03:00
Ruslan Kuprieiev c733b8130b dvc: add dvc metrics add/show/remove and dvc run -M|--metrics-no-cache
Fixes #656

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-16 16:01:32 +03:00
Ruslan Kuprieiev 50c50a54e3 dvc: delete garbage 2018-06-16 12:17:43 +03:00
Ruslan Kuprieiev 05cf6c26e3 Merge pull request #780 from efiop/master
dvc introduce `dvc import`
2018-06-15 18:47:34 +03:00
Ruslan Kuprieiev 4271ddf11c dvc introduce dvc import
Fixes #705

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-15 18:37:50 +03:00
Ruslan Kuprieiev f65ea82ddf Merge pull request #778 from efiop/master
outputs: fix `remove` methods for s3/gs/hdfs
2018-06-15 04:13:31 +03:00
Ruslan Kuprieiev b511193113 outputs: fix remove methods for s3/gs/hdfs
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-15 04:09:17 +03:00
Ruslan Kuprieiev 048ae43e34 Merge pull request #777 from efiop/master
dvc: support external local deps
2018-06-15 03:43:21 +03:00
Ruslan Kuprieiev b074c49318 dvc: support external local deps
Fixes #764

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-15 03:35:53 +03:00
Ruslan Kuprieiev 5ea2fd8367 Merge pull request #775 from efiop/master
utils: read in binary mode when converting CRLF -> LF
2018-06-14 23:42:46 +03:00
Ruslan Kuprieiev b57f829b1b utils: read in binary mode when converting CRLF -> LF
Fixes #773

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-14 23:37:10 +03:00
Ruslan Kuprieiev 8148d51a97 Merge pull request #771 from efiop/master
cli: fix `dvc remote` bug on python3
2018-06-13 22:08:29 +03:00
Ruslan Kuprieiev 594a99ba9d cli: fix dvc remote bug on python3
Fixes #769

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-13 21:43:45 +03:00
Ruslan Kuprieiev e49ccf26f1 Merge pull request #768 from efiop/master
Error msgs fix for CLI commands
2018-06-13 14:07:54 +03:00
Ruslan Kuprieiev 78e5b166fe dvc: replace StageNotFoundError with NotDvcFileError
Fixes #760

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-13 14:00:03 +03:00
Ruslan Kuprieiev 0ffcdd669a remove: fix error msg
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-13 13:34:46 +03:00
Ruslan Kuprieiev 569e40eded Merge pull request #767 from efiop/master
remove: add `-o|--outs` and `-p|--purge` options
2018-06-13 13:21:46 +03:00
Ruslan Kuprieiev 5902e6066c remove: add -o|--outs and -p|--purge options
Fixes #761

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-13 13:15:40 +03:00
Ruslan Kuprieiev 582cb9e064 Merge pull request #759 from franekp/master
Fix bottlenecks related to large number of files.
2018-06-10 21:04:22 +03:00
Franciszek Piszcz e380a4a858 Fix bottlenecks related to large number of files. 2018-06-10 16:35:49 +02:00
Ruslan Kuprieiev 35f5945720 Merge pull request #757 from efiop/master
dvc: initial hdfs support
2018-06-10 05:36:46 +03:00
Ruslan Kuprieiev ff0d91737b dvc: initial hdfs support
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-10 05:32:16 +03:00
Ruslan Kuprieiev 77b814f039 Merge pull request #756 from efiop/master
Support deps/outputs that are relative to specific remote
2018-06-09 02:08:41 +03:00
Ruslan Kuprieiev a734e07776 dvc: support deps/outputs that are relative to specific remote
Fixes #748

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-09 02:03:02 +03:00
Ruslan Kuprieiev fecc38e602 remote: use default urls
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-09 01:09:44 +03:00
Ivan Shcheklein 6fe26a0bdc minor: fix links in README to target dvc.org instead of dataversioncontrol.com 2018-06-08 12:20:12 -07:00
Ruslan Kuprieiev 2cd4312423 Merge pull request #753 from efiop/master
status: report callback stages as changed
2018-06-08 17:16:24 +03:00
Ruslan Kuprieiev e68137181e status: report callback stages as changed
Fixes #751

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-08 16:43:50 +03:00
Ruslan Kuprieiev 2e347847ec Merge pull request #752 from efiop/master
stage: try to specify user's shell when running commands
2018-06-07 23:49:32 +03:00
Ruslan Kuprieiev c136297b82 stage: try to specify user's shell when running commands
Fixes #749

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-07 23:19:29 +03:00
Ruslan Kuprieiev 6218124764 travis: run hadoop only on linux 2018-06-06 17:09:38 +03:00
Ruslan Kuprieiev 22718faf9c Merge pull request #747 from efiop/master
travis: run docker image with hadoop
2018-06-06 14:58:47 +03:00
Ruslan Kuprieiev a2bc64e85f travis: run hadoop docker image
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-06 14:34:54 +03:00
Ruslan Kuprieiev f2a5058a74 Merge pull request #746 from efiop/master
checkout: create dir even if it is empty
2018-06-06 02:57:49 +03:00
Ruslan Kuprieiev 38c585a5f9 checkout: create dir even if it is empty
Fixes #737

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-06 02:37:51 +03:00
Ruslan Kuprieiev 408f96b31c Merge pull request #745 from efiop/master
dvc: add --cwd for dvc repro
2018-06-06 02:21:14 +03:00
Ruslan Kuprieiev 9389422f0b dvc: add --cwd for dvc repro
Fixes #401

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-06 01:42:06 +03:00
Ruslan Kuprieiev 5d169916de Merge pull request #740 from efiop/master
Add initial support for s3/gs outputs/deps/cache_dirs
2018-06-04 22:38:24 +03:00
Ruslan Kuprieiev dd610c04fb test: add test for s3/gs out/dep/cache
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 585c27f354 cloud: use project.cache.local instead of project.cache
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 346ef139dd out: properly remove outputs when reproducing
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 331e3b2bf9 cache: fix cache_dir resolving
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 7a7c9e7713 dvc: fix import conflicts
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 1ef21039c4 remote: use Remote() func to determine remote type 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 42265339a8 remote: rename Remote -> RemoteBase
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev fc53971f2b dvc: temporarily only count local cache as used cache
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 484b04cb68 outs: raise exception if no cache location setup for s3/gs
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 88397ef430 dvc: use Remote concept in existing code
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 6f4d0cd74a cache: use atomic move to avoid using Lock()
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev f03ea7a915 dvc: move link_state from Cache to Project
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00