Commit Graph
166 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 286002f9cb test: add '--force' test for repro
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-17 11:42:05 +02:00
Ruslan Kuprieiev b38b12962d dvc: remove fsck
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-16 11:23:54 +02:00
Ruslan Kuprieiev 2447415657 dvc: move CmdDataStatus to a separate file
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-15 10:30:12 +02:00
Ruslan Kuprieiev 8db50b88e2 test: add test for bad dir cache files
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-14 20:11:37 +02:00
Ruslan Kuprieiev 75c0ffaa68 test: test CLI failures for push/pull/fetch/status
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-14 20:11:05 +02:00
Ruslan Kuprieiev 2fe6091ffb dvc: don't change mode of files
Since we can now detect cache corruption, we don't need
to force any permissions on our data files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-14 12:48:16 +02:00
Ruslan Kuprieiev 3ab62555bd tests: checkout: sleep(1) to emulate realistic behavior
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-13 20:51:29 +02:00
Ruslan Kuprieiev b728d942c7 state: optimize state storage and computation
Reduces 'dvc add' time for 30K files from 25sec to 9sec.

Fixes #546

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-13 20:18:03 +02:00
Ruslan Kuprieiev c9f4a4076c test: state: sleep 1 sec to simulate realistic behavior
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-13 18:57:33 +02:00
Ruslan Kuprieiev 97643de654 test: add debug msgs for mtime issue
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-12 22:51:17 +02:00
Ruslan Kuprieiev 440768b056 tests: add debug msg
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-12 20:38:57 +02:00
Ruslan Kuprieiev 79e034b493 dvc: remove 'show pipeline'
Fixes #533

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-12 01:18:52 +02:00
Ruslan Kuprieiev 0cd0e6700f cache: check of cache corruption
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-12 00:58:45 +02:00
Ruslan Kuprieiev 04855c8631 test: remove directory from gc test
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-10 19:13:14 +02:00
Ruslan Kuprieiev 0068e90074 test: enable 'local cloud' tests for windows
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-10 18:46:14 +02:00
Ruslan Kuprieiev 54a6532360 cache: create cache dirs only when needed
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-08 19:45:58 +02:00
Ruslan Kuprieiev 2e21c39c00 cli: move push/pull from under 'dvc cache'
Fixes #528

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-08 14:03:49 +02:00
Ruslan Kuprieiev fa43309222 config: rename 'Global' section to 'Core'
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-08 09:04:28 +02:00
Ruslan Kuprieiev 783fad935b remove: use stage files as targets and only remove outputs
Fixes #516

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-08 06:59:01 +02:00
Ruslan Kuprieiev 7f4c7783e7 dvc: store cached dir structure in a single json file
Fixes #507

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-04 11:15:20 +02:00
Ruslan Kuprieiev f814269b4c dvc: properly collect used cache
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-03 04:25:46 +02:00
Ruslan Kuprieiev 8b85d1c201 dvc: cloud: reuse connections when processing targets
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-02 04:00:40 +02:00
Ruslan Kuprieiev 44bcf9fa6b test: fix data cloud test
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-02 03:28:20 +02:00
Ruslan Kuprieiev 539ac41b70 dvc: use two-level hash for cache
Fixes #488

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-02 02:51:20 +02:00
Ruslan Kuprieiev f96f1f7ee3 tests: add test for reproducing directories
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-01 09:15:13 +02:00
Ruslan Kuprieiev 068f742852 dvc: use zc.lockfile instead of fasteners
fasteners' InterProcessLock doesn't work within
one process, thus it is not suitable for our dvc
library.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-27 04:20:32 +02:00
Ruslan Kuprieiev d87e8e47af test: add test for non-existing sections/fields in config
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-27 04:20:32 +02:00
Ruslan Kuprieiev a05eddd746 tests: add test for cli data cloud
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-27 04:20:32 +02:00
Ruslan Kuprieiev 36323010fc tests: add test for removing directory
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-27 04:20:32 +02:00
Ruslan Kuprieiev 576ba96e25 Revert "cloud: process targets one-by-one"
This reverts commit 61b469144e.
2018-02-18 23:10:59 +02:00
Ruslan Kuprieiev 61b469144e cloud: process targets one-by-one
In all operations we're dealing with a single stream,
so there is no good reason to process targets in parallel
as they all use the same resource to pull\push data to.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-17 19:36:51 +02:00
Ruslan Kuprieiev d938e44ceb test: don't forget to import shutils 2018-02-15 21:30:46 +02:00
Ruslan Kuprieiev a58f3b8184 test: enable gcp tests
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-15 20:47:45 +02:00
Ruslan Kuprieiev bccdbfb15f Revert "travis/appveyor: test: enable gcp tests" 2018-02-14 23:18:41 +02:00
Ruslan Kuprieiev f109b69903 test: enable gcp tests
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-14 22:39:14 +02:00
Ruslan Kuprieiev 77e61f40be test: test AWS on appveyor
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-14 18:36:19 +02:00
Ruslan Kuprieiev d54f803eb6 system: remove unused code
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-14 18:22:33 +02:00
Ruslan Kuprieiev ecea487614 Revert "test: test AWS on appveyor" 2018-02-14 14:09:17 +02:00
Ruslan Kuprieiev c5530a4830 test: test AWS on appveyor
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-14 13:57:26 +02:00
Ruslan Kuprieiev 17d92a441d test: use swap_code function
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-13 15:03:40 +02:00
Ruslan Kuprieiev 8d1832d602 test: add test for modyfing config
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-12 17:58:02 +02:00
Ruslan Kuprieiev 2351fc12d2 dvc: move status/pull/push under cache subcmd
Fixes #449

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-12 13:14:07 +02:00
Ruslan Kuprieiev 7c61c75d23 dvc: split stage and output files
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-06 13:51:11 +02:00
Ruslan Kuprieiev 14ae7811c1 test: add modified dir test
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-03 14:46:13 +02:00
Ruslan Kuprieiev 24f8c4ca9f test: add test for adding same data in and inside dir
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-02 16:53:35 +02:00
Ruslan Kuprieiev e4d9755a7e dvc: cloud RFC add support for directories
Fixes #367

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-22 03:19:29 +02:00
Ruslan Kuprieiev c07be85e0e dvc: use Popen directly instead of Executor
Executor is no longer useful.

Fixes #434

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-19 06:49:53 +02:00
Ruslan Kuprieiev 2b8c8b62f0 repro: don't reproduce twice
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-18 19:49:08 +02:00
Ruslan Kuprieiev 0fcb44b364 dvc: don't add regular files to gitignore
Fixes #430

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-16 04:27:54 +02:00
Ruslan Kuprieiev 39328620f8 test: test gcp only when env var DVC_TEST_GCP=true
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-16 03:21:57 +02:00