Commit Graph
569 Commits
Author SHA1 Message Date
Dmitry 86a933ea71 dvc find command 2017-11-16 01:11:07 -08:00
Dmitry Petrov 76a6757fa1 Merge pull request #297 from dataversioncontrol/dvc_checkout_witout_git_checkout
Include dvc commit to the tutorial
2017-11-14 09:19:34 -08:00
Dmitry 6955d56ca1 Include dvc commit to the tutorial 2017-11-14 09:16:53 -08:00
Dmitry Petrov fabae6d1ce Merge pull request #295 from dataversioncontrol/dvc_checkout_witout_git_checkout
Dvc checkout without git checkout and STATE_DIR refactoring
2017-11-13 02:23:46 -08:00
Dmitry b4bf6ffbd7 No commit history issue 2017-11-13 01:51:48 -08:00
Dmitry 524901d4ad Bug fixing 2017-11-13 00:51:54 -08:00
Dmitry 8d6c134780 Extract cache_dir\state_dir as a CongigI class variable 2017-11-13 00:38:44 -08:00
Dmitry 62e8b751ba Rename STATE_DIR to STATE_DIR_NAME 2017-11-12 22:41:46 -08:00
Dmitry 410a05c937 rm repro.py__ 2017-11-12 22:37:35 -08:00
Dmitry 9f21c6a51c dvc checkout witout git checkout. Close #292 2017-11-12 22:36:02 -08:00
Dmitry Petrov 0cb7ec6179 Merge pull request #294 from dataversioncontrol/dvc_repro_after_merge
dvc-repro after dvc-merge
2017-11-07 00:25:19 -08:00
Dmitry 046d356137 dvc-repro after dvc-merge: Ignore state file changes for data sources. Close #266 2017-11-07 00:22:17 -08:00
Dmitry Petrov 098d98ac4a Merge pull request #289 from dataversioncontrol/empty_file
Get rid of the empty file
2017-11-05 23:18:18 -08:00
Dmitry 849dc2d873 get rid of the empty file 2017-11-05 18:18:51 -08:00
Dmitry Petrov bf44f53656 Merge pull request #288 from dataversioncontrol/dvc_checkout_fix
dvc checkout fix
2017-11-05 17:30:27 -08:00
Dmitry b2f0a76546 Checkout branches, not commits if possible 2017-11-04 17:14:44 -07:00
Dmitry 8435b38a09 dvc checkout fix. Close #287 2017-11-04 16:09:53 -07:00
Ruslan Kuprieiev 9a31909e8d Merge pull request #284 from efiop/master
Data cloud and func test fixes
2017-11-02 02:47:41 +02:00
Ruslan Kuprieiev c022aa89d5 functest: use small data to test basic functionality
Fixes #283

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-02 01:39:39 +02:00
Ruslan Kuprieiev 7e90522d3f cloud: gcp: decode base64 when comparing files
Otherwise comparison with string fails on Python3, as base64 returns bytes.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-02 01:10:13 +02:00
Ruslan Kuprieiev 8fac23f93d functest: fix test-sync
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-01 23:50:43 +02:00
Ruslan Kuprieiev 831f21f555 sync: properly collect and check data items
Fixes #282

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-01 22:21:04 +02:00
Ruslan Kuprieiev 38f6aab7e2 Merge pull request #281 from efiop/master
Read-only data files, small fixes
2017-11-01 05:05:56 +02:00
Ruslan Kuprieiev b1bd7a9543 dvc: don't forget to import ConfigI
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-01 04:04:31 +02:00
Ruslan Kuprieiev 2be87f57fd data: set read-only flag
Fixes #278
Fixes #277
Fixes #276

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-01 04:04:25 +02:00
Ruslan Kuprieiev fad091e9a6 factory: don't forget to import Logger
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-01 04:00:01 +02:00
Ruslan Kuprieiev cb47ac4eae repository_change: skip .dvc when collecting timestamps
Fixes #277

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-01 03:58:00 +02:00
Ruslan Kuprieiev 19d93c13b5 Merge pull request #275 from efiop/master
[WIP] data dir removal, hardlinks, various fixes
2017-10-31 19:46:31 +02:00
Ruslan Kuprieiev f91abed416 git: check if gitignore already has file before modifying it
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-31 16:03:43 +02:00
Ruslan Kuprieiev 54c4ce1b49 functest: fix tutorial
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-31 14:28:47 +02:00
Ruslan Kuprieiev 2dcb9ac37b dvc: factory: check if file inside state dir has proper suffix
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-31 13:17:20 +02:00
Ruslan Kuprieiev 299e4e2ae1 checkout: use os.path.samefile instead of stat
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 52b47a25b4 test: fix unit tests
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev afff00048b tests: utils: remove sleep()
No real need to sleep that much in the unit test, as it
really slows down everything.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 664ec5dfa4 tests: remove gc unit test
After moving to md5 for cache files, gc logic became very straightforward,
and this unit test became irrelevant. We still have functional test for gc
though, so it is not like we're leaving gc untested. Probably worth it to
write simple unit test for it later.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 72b691b7f1 dvc: add 'dvc checkout'
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 90641c755a functest: fix merge test
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev bdea4ba2f0 dvc: fix 'dvc merge' command
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev fb377b8506 dvc: add 'dvc checkout'
Fixes #225

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 9ae4c289eb functest: fix test-init
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 1d109b41a1 dvc: fix gc
Fixes #271

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 4ffac507df dvc: remove data dir
From now on, we're no longer tied to fixed data dir, so we can
track individual data items without forcing user to use separate
dir for them. This way we add much more flexibility for dvc, so
users can use their own project structure.

Fixes #68

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev a813ebaeb7 dvc: use hardlinks instead of symlinks
Fixes #225
Fixes #273

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Dmitry 1ef90c882e Repro error with the new md5 logic 2017-10-21 00:32:09 -07:00
Ruslan Kuprieiev 089a526373 Merge pull request #264 from efiop/master
Misc fixes and improvements
2017-10-21 02:56:23 +03:00
Ruslan Kuprieiev 9941a3f92c state: capture exception if unable to parse target metrics
Fixes #265

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-21 01:19:06 +03:00
Ruslan Kuprieiev 561cca120d test: add test for 'dvc merge'
Basic test for 'dvc merge' functionality. We just create two branches,
do some dummy work on big data set, then branch and do some changes on
small data set and then merge second branch into first, calling 'dvc merge'
afterwards to restore big data back.

Fixes #262

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-21 00:04:39 +03:00
Ruslan Kuprieiev 2cf060ca5f merge: checkout state files
Fixes #263
Fixes #260

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-21 00:04:39 +03:00
Ruslan Kuprieiev c6029d1421 repro: use state to obtain data item history
Fixes #258

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-21 00:04:39 +03:00
Ruslan Kuprieiev ef01dd9893 Merge pull request #253 from efiop/246
dvc: add 'merge' command
2017-10-18 15:56:38 +03:00