Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-10 15:28:34 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,333 Commits 7 Branches 579 Tags
83d831735c8082e4d7eaa8bbeebe3978294ceeaa
Commit Graph
42 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 4271ddf11c dvc introduce dvc import 
Fixes #705

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-15 18:37:50 +03:00
Ruslan Kuprieiev b074c49318 dvc: support external local deps 
Fixes #764

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-15 03:35:53 +03:00
Ruslan Kuprieiev ff0d91737b dvc: initial hdfs support 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-10 05:32:16 +03:00
Ruslan Kuprieiev a734e07776 dvc: support deps/outputs that are relative to specific remote 
Fixes #748

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-09 02:03:02 +03:00
Ruslan Kuprieiev c136297b82 stage: try to specify user's shell when running commands 
Fixes #749

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-07 23:19:29 +03:00
Ruslan Kuprieiev 9389422f0b dvc: add --cwd for dvc repro 
Fixes #401

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-06 01:42:06 +03:00
Ruslan Kuprieiev dd610c04fb test: add test for s3/gs out/dep/cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 88397ef430 dvc: use Remote concept in existing code 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev e0a42f1265 outs: support gs/s3 as an output without cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev ac3d37e58c test: temporarily disable gs dependency test on CI 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-05-24 18:58:20 +03:00
Ruslan Kuprieiev 2bbefc91ef deps: introduce s3/gs dependencies 
E.g.:
dvc run -d gs://bucket/file -o file gsutil cp gs://bucket/file file
dvc run -d s3://bucket/file -o file aws s3 cp s3://bucket/file file

Etags are used to track deps in both cases.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-05-24 18:24:18 +03:00
Ruslan Kuprieiev 9a88a412d0 dvc: reproduce stage if it has no dependencies and has cmd 
This allows as to define conditional stages in the dependency graph.

Fixes #646
Fixes #648

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-29 17:43:32 +03:00
Ruslan Kuprieiev 958eab2f23 dvc: fix checkout/repro with stage files without md5 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-20 00:31:30 +02:00
Ruslan Kuprieiev 286002f9cb test: add '--force' test for repro 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-17 11:42:05 +02:00
Ruslan Kuprieiev 2fe6091ffb dvc: don't change mode of files 
Since we can now detect cache corruption, we don't need
to force any permissions on our data files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-14 12:48:16 +02:00
Ruslan Kuprieiev f96f1f7ee3 tests: add test for reproducing directories 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-01 09:15:13 +02:00
Ruslan Kuprieiev 17d92a441d test: use swap_code function 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-02-13 15:03:40 +02:00
Ruslan Kuprieiev 2b8c8b62f0 repro: don't reproduce twice 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-18 19:49:08 +02:00
Ruslan Kuprieiev a130a25e39 dvc: refactor data_cloud 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-15 21:11:25 +02:00
Ruslan Kuprieiev 722f6abfc9 test: add test for changed data source 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-12 21:49:45 +02:00
Ruslan Kuprieiev 5043726f9d dvc: fix repro bugs 
Fixes #400

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-11 13:22:21 +02:00
Ruslan Kuprieiev 487eae3f07 test: improve test coverage 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-10 17:15:42 +02:00
Ruslan Kuprieiev bc74afb4cf dvc: accept only single target through project.reproduce 
Accepting multiple targets doesn't really make sence in both usage
and return values.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-05 12:06:45 +02:00
Ruslan Kuprieiev 9c7b142883 test: add test for phony targets 
Fixes #342

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-05 11:39:34 +02:00
Ruslan Kuprieiev 2c108ff410 unit: simplify repro test 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-04 15:26:01 +02:00
Ruslan Kuprieiev 14181ede5f dvc: remove -D option 
Fixes #370

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-04 13:34:31 +02:00
Ruslan Kuprieiev f47a2c7585 dvc: initial unittests 
Initial unittests for new design.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-01 16:52:06 +02:00
Ruslan Kuprieiev ee34fdfa31 RFC: move cmdline parsing to cli.py and settings RFC 
This will make the structure of dvc more linear
making it easier to read. Plus, these changes
are needed in preparation for libdvc, as they
move all cmdline parsing to one common place.

This patch also refactors our settings system
also make it more linear and remove abstraction
levels that are not needed and only cause confusion.
There is a lot more to be done in preparation for
dvc lib and RFC overall, but this a first step
in that long journey.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-07-31 01:39:32 +03:00
Dmitry Petrov 71566b1a24 Rename CmdDataRemove class 2017-06-19 18:32:30 -07:00
Dmitry Petrov 0e3278641c Small tests headers fixes 2017-06-19 18:21:58 -07:00
Dmitry Petrov f6ded2fa72 Lock cmd: small changes 2017-04-29 18:01:24 -07:00
Dmitry Petrov a7f8989575 Unit tests 2017-04-28 15:03:33 -07:00
Dmitry Petrov 92553358e6 Windows symlink: more small fixes 2017-04-10 14:32:26 -07:00
Dmitry Petrov 376f139f81 Windows symlink: replace echo to python code and fix --shell command line propagation 2017-04-10 12:47:03 -07:00
Dmitry Petrov 741ad5435a Windows symlink: rewrite unit test for windows 2017-04-09 14:22:17 -07:00
Dmitry Petrov a6ceb02f97 WindowsSymlinkOverride class 2017-04-07 18:22:22 -07:00
Dmitry Petrov 449517c511 Windows symlink 2017-04-07 17:44:25 -07:00
Dmitry Petrov 5f3c53603f Refactoring: extract Settings from BaseCmd; move path_factory to Settings 2017-04-05 23:08:40 -07:00
Dmitry Petrov c3c2116220 Close #1 - repro cmd and close #2 repro unit tese 2017-04-05 20:41:35 -07:00
Dmitry Petrov 84218deccb Finalize ReproCodeDependencyTest 2017-04-03 15:02:49 -07:00
Dmitry Petrov dccc15c0d6 Repro cmd first unttest 2017-04-03 03:56:08 -07:00
Dmitry Petrov 2f8c2e9397 Fix: change dir back 2017-04-03 00:02:12 -07:00