Commit Graph
554 Commits
Author SHA1 Message Date
Dmitry b2f0a76546 Checkout branches, not commits if possible 2017-11-04 17:14:44 -07:00
Dmitry 8435b38a09 dvc checkout fix. Close #287 2017-11-04 16:09:53 -07:00
Ruslan Kuprieiev 9a31909e8d Merge pull request #284 from efiop/master
Data cloud and func test fixes
2017-11-02 02:47:41 +02:00
Ruslan Kuprieiev c022aa89d5 functest: use small data to test basic functionality
Fixes #283

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-02 01:39:39 +02:00
Ruslan Kuprieiev 7e90522d3f cloud: gcp: decode base64 when comparing files
Otherwise comparison with string fails on Python3, as base64 returns bytes.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-02 01:10:13 +02:00
Ruslan Kuprieiev 8fac23f93d functest: fix test-sync
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-01 23:50:43 +02:00
Ruslan Kuprieiev 831f21f555 sync: properly collect and check data items
Fixes #282

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-01 22:21:04 +02:00
Ruslan Kuprieiev 38f6aab7e2 Merge pull request #281 from efiop/master
Read-only data files, small fixes
2017-11-01 05:05:56 +02:00
Ruslan Kuprieiev b1bd7a9543 dvc: don't forget to import ConfigI
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-01 04:04:31 +02:00
Ruslan Kuprieiev 2be87f57fd data: set read-only flag
Fixes #278
Fixes #277
Fixes #276

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-01 04:04:25 +02:00
Ruslan Kuprieiev fad091e9a6 factory: don't forget to import Logger
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-01 04:00:01 +02:00
Ruslan Kuprieiev cb47ac4eae repository_change: skip .dvc when collecting timestamps
Fixes #277

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-01 03:58:00 +02:00
Ruslan Kuprieiev 19d93c13b5 Merge pull request #275 from efiop/master
[WIP] data dir removal, hardlinks, various fixes
2017-10-31 19:46:31 +02:00
Ruslan Kuprieiev f91abed416 git: check if gitignore already has file before modifying it
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-31 16:03:43 +02:00
Ruslan Kuprieiev 54c4ce1b49 functest: fix tutorial
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-31 14:28:47 +02:00
Ruslan Kuprieiev 2dcb9ac37b dvc: factory: check if file inside state dir has proper suffix
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-31 13:17:20 +02:00
Ruslan Kuprieiev 299e4e2ae1 checkout: use os.path.samefile instead of stat
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 52b47a25b4 test: fix unit tests
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev afff00048b tests: utils: remove sleep()
No real need to sleep that much in the unit test, as it
really slows down everything.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 664ec5dfa4 tests: remove gc unit test
After moving to md5 for cache files, gc logic became very straightforward,
and this unit test became irrelevant. We still have functional test for gc
though, so it is not like we're leaving gc untested. Probably worth it to
write simple unit test for it later.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 72b691b7f1 dvc: add 'dvc checkout'
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 90641c755a functest: fix merge test
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev bdea4ba2f0 dvc: fix 'dvc merge' command
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev fb377b8506 dvc: add 'dvc checkout'
Fixes #225

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 9ae4c289eb functest: fix test-init
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 1d109b41a1 dvc: fix gc
Fixes #271

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 4ffac507df dvc: remove data dir
From now on, we're no longer tied to fixed data dir, so we can
track individual data items without forcing user to use separate
dir for them. This way we add much more flexibility for dvc, so
users can use their own project structure.

Fixes #68

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev a813ebaeb7 dvc: use hardlinks instead of symlinks
Fixes #225
Fixes #273

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Dmitry 1ef90c882e Repro error with the new md5 logic 2017-10-21 00:32:09 -07:00
Ruslan Kuprieiev 089a526373 Merge pull request #264 from efiop/master
Misc fixes and improvements
2017-10-21 02:56:23 +03:00
Ruslan Kuprieiev 9941a3f92c state: capture exception if unable to parse target metrics
Fixes #265

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-21 01:19:06 +03:00
Ruslan Kuprieiev 561cca120d test: add test for 'dvc merge'
Basic test for 'dvc merge' functionality. We just create two branches,
do some dummy work on big data set, then branch and do some changes on
small data set and then merge second branch into first, calling 'dvc merge'
afterwards to restore big data back.

Fixes #262

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-21 00:04:39 +03:00
Ruslan Kuprieiev 2cf060ca5f merge: checkout state files
Fixes #263
Fixes #260

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-21 00:04:39 +03:00
Ruslan Kuprieiev c6029d1421 repro: use state to obtain data item history
Fixes #258

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-21 00:04:39 +03:00
Ruslan Kuprieiev ef01dd9893 Merge pull request #253 from efiop/246
dvc: add 'merge' command
2017-10-18 15:56:38 +03:00
Ruslan Kuprieiev 6d03d9998b Merge pull request #252 from efiop/checksum
Use md5 checksum instead of commit-ids for cache files
2017-10-17 16:31:45 +03:00
Ruslan Kuprieiev 51cce677ce dvc: add 'merge' command
Fixes #246

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-17 16:15:15 +03:00
Ruslan Kuprieiev db12448a6e tests: fix cache tests
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-17 14:06:43 +03:00
Ruslan Kuprieiev 8bb51f5efc cache: use checksums instead of commit_id
From now on, we identify our cache files by their md5sum,
so that we can avoid cache collission in branching scenario
and also dedup same data at the same time.

Fixes #250, #251

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-17 14:06:43 +03:00
Dmitry b0e1d3374f Two branches scenario 2017-10-13 01:27:10 -07:00
Dmitry 898c4be0e2 Code improvements 2017-10-09 17:10:59 -07:00
Dmitry 4e98ce38bf Doc polishing: iteration 4, formatting commands list 2017-10-09 04:04:43 -07:00
Dmitry 276e910ba8 config command changes format of empty values. Clouse #245 2017-10-07 18:50:16 -07:00
Dmitry a2ed53b615 Doc polishing: iteration 3, commands 2017-10-07 18:34:35 -07:00
Dmitry 9dac0c136f Doc polishing: iteration 2, intro and cloud config 2017-10-07 18:02:00 -07:00
Dmitry 133d16bc6e Doc polishing: iteration 1 2017-10-06 01:41:45 -07:00
Dmitry 20217457eb EOL 2017-10-05 22:05:10 -07:00
Dmitry 8e640e4683 Build docs in unix 2017-10-05 22:04:56 -07:00
Dmitry 46aaeb525a Status file merge issues. Close #243 2017-10-05 22:02:20 -07:00
Ruslan Kuprieiev b17e7448b9 Merge pull request #242 from efiop/master
Misc cli bug fixes
2017-10-01 04:29:21 +03:00