Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-11 15:28:27 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,564 Commits 7 Branches 579 Tags
9bf0fc89df8d035a356c8b9e6ca73c8bb07708aa
Commit Graph
61 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 870d98bc18 test: fix expected number of stages 2018-07-17 15:57:31 +03:00
Ruslan Kuprieiev dc5fec6a75 test: remove unused add() call 2018-07-17 15:47:38 +03:00
Ruslan Kuprieiev 805eb908d0 import: support external urls 
Fixes #891

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-17 12:00:12 +03:00
Ruslan Kuprieiev b952e599bf debug: add a few more sleep()s to test_repro 2018-07-03 02:43:01 +03:00
Ruslan Kuprieiev 71d03b5a43 test: add sleep() calls 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-03 01:33:13 +03:00
Ruslan Kuprieiev f634bc1916 test: remote: add basic test for remove() and checkout() 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-01 22:34:48 +03:00
Ruslan Kuprieiev a392289cbf travis: run hdfs test only on Linux 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-01 10:02:43 +03:00
Ruslan Kuprieiev 591cd90583 travis: enable hdfs test 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-01 09:44:42 +03:00
Ruslan Kuprieiev 432fa56315 test: don't set gs env when running a command 2018-07-01 02:58:30 +03:00
Ruslan Kuprieiev 24d44695f7 test: fix typo 2018-07-01 02:45:02 +03:00
Ruslan Kuprieiev fde11a3b7f test: use GOOGLE_APPLICATION_CREDENTIALS when running GS repro test 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-01 02:36:22 +03:00
Ruslan Kuprieiev fb4fc72642 tests: try enable GS test on CI 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-01 02:08:06 +03:00
Ruslan Kuprieiev 12edcbaa04 remote: support HDFS for push/pull/status from local repo 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-30 22:54:49 +03:00
Ruslan Kuprieiev 50578a5923 gc: support s3/gs/ssh/hdfs 
Fixes #738

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-28 21:32:57 +03:00
Ruslan Kuprieiev b8371d1c76 dvc: bring back dvc lock with dvc unlock 
Fixes #523

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-26 02:53:07 +03:00
Ruslan Kuprieiev 0b29f8748f test: use contents without \n 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-24 18:21:20 +03:00
Ruslan Kuprieiev 71752f68a8 hdfs: fix drivers and tests 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-24 17:23:47 +03:00
Ruslan Kuprieiev db7251b3ea dvc: support ssh deps/outs/cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-23 18:47:52 +03:00
Ruslan Kuprieiev 6886fc29d5 dvc: support dependecy files under tracked directory 
Fixes #722

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-17 09:32:29 +03:00
Ruslan Kuprieiev 4271ddf11c dvc introduce dvc import 
Fixes #705

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-15 18:37:50 +03:00
Ruslan Kuprieiev b074c49318 dvc: support external local deps 
Fixes #764

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-15 03:35:53 +03:00
Ruslan Kuprieiev ff0d91737b dvc: initial hdfs support 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-10 05:32:16 +03:00
Ruslan Kuprieiev a734e07776 dvc: support deps/outputs that are relative to specific remote 
Fixes #748

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-09 02:03:02 +03:00
Ruslan Kuprieiev c136297b82 stage: try to specify user's shell when running commands 
Fixes #749

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-07 23:19:29 +03:00
Ruslan Kuprieiev 9389422f0b dvc: add --cwd for dvc repro 
Fixes #401

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-06 01:42:06 +03:00
Ruslan Kuprieiev dd610c04fb test: add test for s3/gs out/dep/cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 88397ef430 dvc: use Remote concept in existing code 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev e0a42f1265 outs: support gs/s3 as an output without cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev ac3d37e58c test: temporarily disable gs dependency test on CI 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-05-24 18:58:20 +03:00
Ruslan Kuprieiev 2bbefc91ef deps: introduce s3/gs dependencies 
E.g.:
dvc run -d gs://bucket/file -o file gsutil cp gs://bucket/file file
dvc run -d s3://bucket/file -o file aws s3 cp s3://bucket/file file

Etags are used to track deps in both cases.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-05-24 18:24:18 +03:00
Ruslan Kuprieiev 9a88a412d0 dvc: reproduce stage if it has no dependencies and has cmd 
This allows as to define conditional stages in the dependency graph.

Fixes #646
Fixes #648

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-29 17:43:32 +03:00
Ruslan Kuprieiev 958eab2f23 dvc: fix checkout/repro with stage files without md5 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-20 00:31:30 +02:00
Ruslan Kuprieiev 286002f9cb test: add '--force' test for repro 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-17 11:42:05 +02:00
Ruslan Kuprieiev 2fe6091ffb dvc: don't change mode of files 
Since we can now detect cache corruption, we don't need
to force any permissions on our data files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-14 12:48:16 +02:00
Ruslan Kuprieiev f96f1f7ee3 tests: add test for reproducing directories 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-01 09:15:13 +02:00
Ruslan Kuprieiev 17d92a441d test: use swap_code function 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-02-13 15:03:40 +02:00
Ruslan Kuprieiev 2b8c8b62f0 repro: don't reproduce twice 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-18 19:49:08 +02:00
Ruslan Kuprieiev a130a25e39 dvc: refactor data_cloud 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-15 21:11:25 +02:00
Ruslan Kuprieiev 722f6abfc9 test: add test for changed data source 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-12 21:49:45 +02:00
Ruslan Kuprieiev 5043726f9d dvc: fix repro bugs 
Fixes #400

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-11 13:22:21 +02:00
Ruslan Kuprieiev 487eae3f07 test: improve test coverage 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-10 17:15:42 +02:00
Ruslan Kuprieiev bc74afb4cf dvc: accept only single target through project.reproduce 
Accepting multiple targets doesn't really make sence in both usage
and return values.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-05 12:06:45 +02:00
Ruslan Kuprieiev 9c7b142883 test: add test for phony targets 
Fixes #342

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-05 11:39:34 +02:00
Ruslan Kuprieiev 2c108ff410 unit: simplify repro test 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-04 15:26:01 +02:00
Ruslan Kuprieiev 14181ede5f dvc: remove -D option 
Fixes #370

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-04 13:34:31 +02:00
Ruslan Kuprieiev f47a2c7585 dvc: initial unittests 
Initial unittests for new design.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-01 16:52:06 +02:00
Ruslan Kuprieiev ee34fdfa31 RFC: move cmdline parsing to cli.py and settings RFC 
This will make the structure of dvc more linear
making it easier to read. Plus, these changes
are needed in preparation for libdvc, as they
move all cmdline parsing to one common place.

This patch also refactors our settings system
also make it more linear and remove abstraction
levels that are not needed and only cause confusion.
There is a lot more to be done in preparation for
dvc lib and RFC overall, but this a first step
in that long journey.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-07-31 01:39:32 +03:00
Dmitry Petrov 71566b1a24 Rename CmdDataRemove class 2017-06-19 18:32:30 -07:00
Dmitry Petrov 0e3278641c Small tests headers fixes 2017-06-19 18:21:58 -07:00
Dmitry Petrov f6ded2fa72 Lock cmd: small changes 2017-04-29 18:01:24 -07:00