Ruslan Kuprieiev
f5bb3e4501
tests: use shallow=False with filecmp.cmp()
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-08-05 00:52:29 +03:00
Ruslan Kuprieiev
ed8052c229
repro: introduce --dry option
...
Fixes #972
Related to #894
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-08-05 00:21:35 +03:00
Ruslan Kuprieiev
b9a5bde22f
test: cover status
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-08-04 19:59:23 +03:00
Ruslan Kuprieiev
07fa6442b8
test: add dvc status simple test
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-19 22:56:53 +03:00
Ruslan Kuprieiev
e598b0b4c7
test: repro: add test for failed stage in CLI
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-19 08:36:32 +03:00
Ruslan Kuprieiev
870d98bc18
test: fix expected number of stages
2018-07-17 15:57:31 +03:00
Ruslan Kuprieiev
dc5fec6a75
test: remove unused add() call
2018-07-17 15:47:38 +03:00
Ruslan Kuprieiev
805eb908d0
import: support external urls
...
Fixes #891
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-17 12:00:12 +03:00
Ruslan Kuprieiev
b952e599bf
debug: add a few more sleep()s to test_repro
2018-07-03 02:43:01 +03:00
Ruslan Kuprieiev
71d03b5a43
test: add sleep() calls
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-03 01:33:13 +03:00
Ruslan Kuprieiev
f634bc1916
test: remote: add basic test for remove() and checkout()
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 22:34:48 +03:00
Ruslan Kuprieiev
a392289cbf
travis: run hdfs test only on Linux
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 10:02:43 +03:00
Ruslan Kuprieiev
591cd90583
travis: enable hdfs test
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 09:44:42 +03:00
Ruslan Kuprieiev
432fa56315
test: don't set gs env when running a command
2018-07-01 02:58:30 +03:00
Ruslan Kuprieiev
24d44695f7
test: fix typo
2018-07-01 02:45:02 +03:00
Ruslan Kuprieiev
fde11a3b7f
test: use GOOGLE_APPLICATION_CREDENTIALS when running GS repro test
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 02:36:22 +03:00
Ruslan Kuprieiev
fb4fc72642
tests: try enable GS test on CI
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 02:08:06 +03:00
Ruslan Kuprieiev
12edcbaa04
remote: support HDFS for push/pull/status from local repo
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-30 22:54:49 +03:00
Ruslan Kuprieiev
50578a5923
gc: support s3/gs/ssh/hdfs
...
Fixes #738
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-28 21:32:57 +03:00
Ruslan Kuprieiev
b8371d1c76
dvc: bring back dvc lock with dvc unlock
...
Fixes #523
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-26 02:53:07 +03:00
Ruslan Kuprieiev
0b29f8748f
test: use contents without \n
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-24 18:21:20 +03:00
Ruslan Kuprieiev
71752f68a8
hdfs: fix drivers and tests
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-24 17:23:47 +03:00
Ruslan Kuprieiev
db7251b3ea
dvc: support ssh deps/outs/cache
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-23 18:47:52 +03:00
Ruslan Kuprieiev
6886fc29d5
dvc: support dependecy files under tracked directory
...
Fixes #722
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-17 09:32:29 +03:00
Ruslan Kuprieiev
4271ddf11c
dvc introduce dvc import
...
Fixes #705
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-15 18:37:50 +03:00
Ruslan Kuprieiev
b074c49318
dvc: support external local deps
...
Fixes #764
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-15 03:35:53 +03:00
Ruslan Kuprieiev
ff0d91737b
dvc: initial hdfs support
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-10 05:32:16 +03:00
Ruslan Kuprieiev
a734e07776
dvc: support deps/outputs that are relative to specific remote
...
Fixes #748
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-09 02:03:02 +03:00
Ruslan Kuprieiev
c136297b82
stage: try to specify user's shell when running commands
...
Fixes #749
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-07 23:19:29 +03:00
Ruslan Kuprieiev
9389422f0b
dvc: add --cwd for dvc repro
...
Fixes #401
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-06 01:42:06 +03:00
Ruslan Kuprieiev
dd610c04fb
test: add test for s3/gs out/dep/cache
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev
88397ef430
dvc: use Remote concept in existing code
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev
e0a42f1265
outs: support gs/s3 as an output without cache
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev
ac3d37e58c
test: temporarily disable gs dependency test on CI
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-05-24 18:58:20 +03:00
Ruslan Kuprieiev
2bbefc91ef
deps: introduce s3/gs dependencies
...
E.g.:
dvc run -d gs://bucket/file -o file gsutil cp gs://bucket/file file
dvc run -d s3://bucket/file -o file aws s3 cp s3://bucket/file file
Etags are used to track deps in both cases.
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-05-24 18:24:18 +03:00
Ruslan Kuprieiev
9a88a412d0
dvc: reproduce stage if it has no dependencies and has cmd
...
This allows as to define conditional stages in the dependency graph.
Fixes #646
Fixes #648
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-04-29 17:43:32 +03:00
Ruslan Kuprieiev
958eab2f23
dvc: fix checkout/repro with stage files without md5
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-03-20 00:31:30 +02:00
Ruslan Kuprieiev
286002f9cb
test: add '--force' test for repro
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-03-17 11:42:05 +02:00
Ruslan Kuprieiev
2fe6091ffb
dvc: don't change mode of files
...
Since we can now detect cache corruption, we don't need
to force any permissions on our data files.
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-03-14 12:48:16 +02:00
Ruslan Kuprieiev
f96f1f7ee3
tests: add test for reproducing directories
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-03-01 09:15:13 +02:00
Ruslan Kuprieiev
17d92a441d
test: use swap_code function
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-02-13 15:03:40 +02:00
Ruslan Kuprieiev
2b8c8b62f0
repro: don't reproduce twice
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-01-18 19:49:08 +02:00
Ruslan Kuprieiev
a130a25e39
dvc: refactor data_cloud
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-01-15 21:11:25 +02:00
Ruslan Kuprieiev
722f6abfc9
test: add test for changed data source
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-01-12 21:49:45 +02:00
Ruslan Kuprieiev
5043726f9d
dvc: fix repro bugs
...
Fixes #400
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-01-11 13:22:21 +02:00
Ruslan Kuprieiev
487eae3f07
test: improve test coverage
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-01-10 17:15:42 +02:00
Ruslan Kuprieiev
bc74afb4cf
dvc: accept only single target through project.reproduce
...
Accepting multiple targets doesn't really make sence in both usage
and return values.
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-01-05 12:06:45 +02:00
Ruslan Kuprieiev
9c7b142883
test: add test for phony targets
...
Fixes #342
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-01-05 11:39:34 +02:00
Ruslan Kuprieiev
2c108ff410
unit: simplify repro test
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-01-04 15:26:01 +02:00
Ruslan Kuprieiev
14181ede5f
dvc: remove -D option
...
Fixes #370
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-01-04 13:34:31 +02:00