Commit Graph
141 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 068f742852 dvc: use zc.lockfile instead of fasteners
fasteners' InterProcessLock doesn't work within
one process, thus it is not suitable for our dvc
library.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-27 04:20:32 +02:00
Ruslan Kuprieiev d87e8e47af test: add test for non-existing sections/fields in config
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-27 04:20:32 +02:00
Ruslan Kuprieiev a05eddd746 tests: add test for cli data cloud
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-27 04:20:32 +02:00
Ruslan Kuprieiev 36323010fc tests: add test for removing directory
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-27 04:20:32 +02:00
Ruslan Kuprieiev 576ba96e25 Revert "cloud: process targets one-by-one"
This reverts commit 61b469144e.
2018-02-18 23:10:59 +02:00
Ruslan Kuprieiev 61b469144e cloud: process targets one-by-one
In all operations we're dealing with a single stream,
so there is no good reason to process targets in parallel
as they all use the same resource to pull\push data to.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-17 19:36:51 +02:00
Ruslan Kuprieiev d938e44ceb test: don't forget to import shutils 2018-02-15 21:30:46 +02:00
Ruslan Kuprieiev a58f3b8184 test: enable gcp tests
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-15 20:47:45 +02:00
Ruslan Kuprieiev bccdbfb15f Revert "travis/appveyor: test: enable gcp tests" 2018-02-14 23:18:41 +02:00
Ruslan Kuprieiev f109b69903 test: enable gcp tests
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-14 22:39:14 +02:00
Ruslan Kuprieiev 77e61f40be test: test AWS on appveyor
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-14 18:36:19 +02:00
Ruslan Kuprieiev d54f803eb6 system: remove unused code
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-14 18:22:33 +02:00
Ruslan Kuprieiev ecea487614 Revert "test: test AWS on appveyor" 2018-02-14 14:09:17 +02:00
Ruslan Kuprieiev c5530a4830 test: test AWS on appveyor
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-14 13:57:26 +02:00
Ruslan Kuprieiev 17d92a441d test: use swap_code function
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-13 15:03:40 +02:00
Ruslan Kuprieiev 8d1832d602 test: add test for modyfing config
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-12 17:58:02 +02:00
Ruslan Kuprieiev 2351fc12d2 dvc: move status/pull/push under cache subcmd
Fixes #449

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-12 13:14:07 +02:00
Ruslan Kuprieiev 7c61c75d23 dvc: split stage and output files
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-06 13:51:11 +02:00
Ruslan Kuprieiev 14ae7811c1 test: add modified dir test
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-03 14:46:13 +02:00
Ruslan Kuprieiev 24f8c4ca9f test: add test for adding same data in and inside dir
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-02 16:53:35 +02:00
Ruslan Kuprieiev e4d9755a7e dvc: cloud RFC add support for directories
Fixes #367

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-22 03:19:29 +02:00
Ruslan Kuprieiev c07be85e0e dvc: use Popen directly instead of Executor
Executor is no longer useful.

Fixes #434

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-19 06:49:53 +02:00
Ruslan Kuprieiev 2b8c8b62f0 repro: don't reproduce twice
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-18 19:49:08 +02:00
Ruslan Kuprieiev 0fcb44b364 dvc: don't add regular files to gitignore
Fixes #430

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-16 04:27:54 +02:00
Ruslan Kuprieiev 39328620f8 test: test gcp only when env var DVC_TEST_GCP=true
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-16 03:21:57 +02:00
Ruslan Kuprieiev a130a25e39 dvc: refactor data_cloud
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-15 21:11:25 +02:00
Ruslan Kuprieiev 6e037a4307 dvc: remove show-workflow logic
As discussed with @dmpetrov, removing this functionality
for the upcoming release.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-15 20:30:53 +02:00
Ruslan Kuprieiev ddf40a9cf9 test: fix on python3
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-15 15:58:52 +02:00
Dmitry 3163b8a3e2 checkout test: add remove file test and gitignore test 2018-01-15 02:26:09 -08:00
Ruslan Kuprieiev a7dbf70995 dvc: remove .gitignore entries
Fixes #378

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-14 22:20:06 +02:00
Ruslan Kuprieiev 266a908169 dvc: fix gitignore bug
Fixes #375

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-14 18:48:48 +02:00
Ruslan Kuprieiev cf7bafad4d dvc: remove brancher and Find
Fixes #383
Fixes #376

We discussed this with @dmpetrov and decided to
remove this ml-specific functionality from the
core product.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-14 18:15:42 +02:00
Ruslan Kuprieiev a3e023c340 state: don't forget to track inode
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-14 01:34:20 +02:00
Ruslan Kuprieiev 6a6c11ffdb dvc: remove lock
As discussed with @dmpetrov, we don't really see a good usage scenario
for this and thus removing it from dvc.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-13 01:54:20 +02:00
Ruslan Kuprieiev 722f6abfc9 test: add test for changed data source
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-12 21:49:45 +02:00
Dmitry 8c4712710c Missing data source error message 2018-01-11 09:45:43 -08:00
Ruslan Kuprieiev 5043726f9d dvc: fix repro bugs
Fixes #400

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-11 13:22:21 +02:00
Ruslan Kuprieiev 3b09290ed8 test: improve coverage and fix bugs
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-10 19:39:41 +02:00
Ruslan Kuprieiev 487eae3f07 test: improve test coverage
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-10 17:15:42 +02:00
Ruslan Kuprieiev 96f9c50de8 cloud: fixup for #404
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-10 14:34:12 +02:00
Ruslan Kuprieiev 2b6d997fd3 dvc: remove ec2 commands
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-10 11:37:16 +02:00
Dmitry fbb3a8e0bb dvc fsck unit-tests and refactoring 2018-01-08 22:47:37 -08:00
Ruslan Kuprieiev e532aba6fa test: use unique aws s3 repo name
I've setup a cleanup rule on s3 to remove old files, so
there is no need them up manualy.

Fixes #374

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-08 15:24:00 +02:00
Ruslan Kuprieiev e4b9718f34 run: add --no-exec option
Fixes #385

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-08 13:19:42 +02:00
Ruslan Kuprieiev 1c89bb50c5 test: add initial tests for LOCAL and AWS data clouds
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-07 22:33:26 +02:00
Ruslan Kuprieiev bce3210a98 logger: rework and add test
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-07 16:58:17 +02:00
Ruslan Kuprieiev 609586eb60 test: add basic tests for cli.py
Fixes #384

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-07 16:11:24 +02:00
Ruslan Kuprieiev 64a1666d78 test: add test for Cache.find_cache()
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-06 18:45:01 +02:00
Ruslan Kuprieiev bc74afb4cf dvc: accept only single target through project.reproduce
Accepting multiple targets doesn't really make sence in both usage
and return values.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-05 12:06:45 +02:00
Ruslan Kuprieiev 9c7b142883 test: add test for phony targets
Fixes #342

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-05 11:39:34 +02:00