Ruslan Kuprieiev
e8818ef67a
test: add basic test from dvc import cmd
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 21:02:43 +03:00
Ruslan Kuprieiev
449d4880d1
tests: add test for double install
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 21:02:43 +03:00
Ruslan Kuprieiev
7c90cbab79
test: test root
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 21:02:43 +03:00
Ruslan Kuprieiev
bd254c15ab
test: remove updater test
2018-07-01 20:38:10 +03:00
Ruslan Kuprieiev
8d662e4402
test: del CI env when testing updater
2018-07-01 20:33:19 +03:00
Ruslan Kuprieiev
6219b28be6
test: add test for Updater
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 20:13:27 +03:00
Ruslan Kuprieiev
95f3b49db8
test: add basic test for metrics
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 20:07:00 +03:00
Ruslan Kuprieiev
a392289cbf
travis: run hdfs test only on Linux
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 10:02:43 +03:00
Ruslan Kuprieiev
591cd90583
travis: enable hdfs test
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 09:44:42 +03:00
Ruslan Kuprieiev
fa9a79008b
test: use gauth
2018-07-01 03:01:16 +03:00
Ruslan Kuprieiev
432fa56315
test: don't set gs env when running a command
2018-07-01 02:58:30 +03:00
Ruslan Kuprieiev
24d44695f7
test: fix typo
2018-07-01 02:45:02 +03:00
Ruslan Kuprieiev
fde11a3b7f
test: use GOOGLE_APPLICATION_CREDENTIALS when running GS repro test
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 02:36:22 +03:00
Ruslan Kuprieiev
fb4fc72642
tests: try enable GS test on CI
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-07-01 02:08:06 +03:00
Ruslan Kuprieiev
12edcbaa04
remote: support HDFS for push/pull/status from local repo
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-30 22:54:49 +03:00
Ruslan Kuprieiev
5d85b19e77
test: enable ssh test on osx
...
Fixes #798
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-30 16:56:17 +03:00
Ruslan Kuprieiev
555e802ed2
RFC/perf: data cloud logic
...
Properly splitting jobs between thread workers and removing unnecessary logic.
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-30 07:44:11 +03:00
Ruslan Kuprieiev
50578a5923
gc: support s3/gs/ssh/hdfs
...
Fixes #738
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-28 21:32:57 +03:00
Ruslan Kuprieiev
add9498e82
gc: move gc logic to Remote
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-28 18:05:55 +03:00
Ruslan Kuprieiev
3f63592c82
test: two repositories one cache dir
...
Fixes #699
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-27 21:35:02 +03:00
Ruslan Kuprieiev
b8371d1c76
dvc: bring back dvc lock with dvc unlock
...
Fixes #523
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-26 02:53:07 +03:00
Ruslan Kuprieiev
38aed70995
dvc: introduce dvc move
...
Fixes #336
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-24 23:28:22 +03:00
Ruslan Kuprieiev
0b29f8748f
test: use contents without \n
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-24 18:21:20 +03:00
Ruslan Kuprieiev
71752f68a8
hdfs: fix drivers and tests
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-24 17:23:47 +03:00
Ruslan Kuprieiev
db7251b3ea
dvc: support ssh deps/outs/cache
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-23 18:47:52 +03:00
Ruslan Kuprieiev
c274bfee3e
RFC: remove unused code
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-22 18:46:09 +03:00
Ruslan Kuprieiev
d0b730f62f
RFC: data_cloud and remotes
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-22 18:21:50 +03:00
Ruslan Kuprieiev
0a951f5ab3
dvc: move cloud/ drivers to remote/
...
Fixes #741
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-20 19:42:33 +03:00
Ruslan Kuprieiev
11f7eb0c4e
system: add temporary workaround for getdirinfo() issue
...
Fixes #670
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-17 19:14:58 +03:00
Ruslan Kuprieiev
9680e040a3
test: run tests in NCORES processes
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-17 16:04:52 +03:00
Ruslan Kuprieiev
834f9502dd
test: enable CLI metrics test on windows
...
Fixes #674
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-17 15:39:10 +03:00
Ruslan Kuprieiev
6886fc29d5
dvc: support dependecy files under tracked directory
...
Fixes #722
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-17 09:32:29 +03:00
Ruslan Kuprieiev
56ed60f1cd
dvc: add -d|--default option for dvc remote add
...
Fixes #783
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-17 08:11:07 +03:00
Ruslan Kuprieiev
c733b8130b
dvc: add dvc metrics add/show/remove and dvc run -M|--metrics-no-cache
...
Fixes #656
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-16 16:01:32 +03:00
Ruslan Kuprieiev
4271ddf11c
dvc introduce dvc import
...
Fixes #705
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-15 18:37:50 +03:00
Ruslan Kuprieiev
b074c49318
dvc: support external local deps
...
Fixes #764
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-15 03:35:53 +03:00
Ruslan Kuprieiev
b57f829b1b
utils: read in binary mode when converting CRLF -> LF
...
Fixes #773
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-14 23:37:10 +03:00
Ruslan Kuprieiev
78e5b166fe
dvc: replace StageNotFoundError with NotDvcFileError
...
Fixes #760
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-13 14:00:03 +03:00
Ruslan Kuprieiev
5902e6066c
remove: add -o|--outs and -p|--purge options
...
Fixes #761
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-13 13:15:40 +03:00
Ruslan Kuprieiev
ff0d91737b
dvc: initial hdfs support
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-10 05:32:16 +03:00
Ruslan Kuprieiev
a734e07776
dvc: support deps/outputs that are relative to specific remote
...
Fixes #748
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-09 02:03:02 +03:00
Ruslan Kuprieiev
c136297b82
stage: try to specify user's shell when running commands
...
Fixes #749
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-07 23:19:29 +03:00
Ruslan Kuprieiev
38c585a5f9
checkout: create dir even if it is empty
...
Fixes #737
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-06 02:37:51 +03:00
Ruslan Kuprieiev
9389422f0b
dvc: add --cwd for dvc repro
...
Fixes #401
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-06 01:42:06 +03:00
Ruslan Kuprieiev
dd610c04fb
test: add test for s3/gs out/dep/cache
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev
88397ef430
dvc: use Remote concept in existing code
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev
e0a42f1265
outs: support gs/s3 as an output without cache
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev
ac3d37e58c
test: temporarily disable gs dependency test on CI
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-05-24 18:58:20 +03:00
Ruslan Kuprieiev
2bbefc91ef
deps: introduce s3/gs dependencies
...
E.g.:
dvc run -d gs://bucket/file -o file gsutil cp gs://bucket/file file
dvc run -d s3://bucket/file -o file aws s3 cp s3://bucket/file file
Etags are used to track deps in both cases.
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-05-24 18:24:18 +03:00
Ruslan Kuprieiev
21bf52ee9d
dvc: split output and dependency classes
...
Preparation for the 'external deps' patches.
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2018-05-23 00:01:04 +03:00