Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-09 23:10:24 +01:00
Code Issues Packages Projects Releases Wiki Activity
683 Commits 7 Branches 579 Tags
f47a2c75855ea2fe5aaa97a17efdb3a7cd20c13f
Commit Graph
54 Commits
Author SHA1 Message Date
Dmitry b9219404c2 Tutorial branch update - intermediate version 2017-12-25 03:09:52 -08:00
Dmitry 8b433c609b Func test fix 2017-12-25 01:28:30 -08:00
Dmitry f6a3830de2 Func test fix: default stage file was changed 2017-12-25 00:22:34 -08:00
Ruslan Kuprieiev a779424a36 WIP RFC 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-23 09:37:40 +02:00
Ruslan Kuprieiev 8186228043 repro: reproduce stages(Dvcfile by default) 
Fixes #341

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-11 01:06:53 +02:00
Ruslan Kuprieiev 8bfc1f77f3 functest: don't forget to use -f with 'dvc run' in test-merge.sh 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-10 05:45:01 +02:00
Ruslan Kuprieiev 927d58cfad dvc: introduce stage files instead of state files 
These describe single stage of pipeline and are allowed to
be placed anywhere in current or parent directories(up to
project's root) of the data file.

By default, 'dvc run' writes stage file to ./stage.dvc, but
it can be changed by using '-f' option(see functest/test-repro.py).

For now we're traversing project tree to find needed stage files for
specific data files. This is very wasteful and not optimal, but will
do for now, as this patch is aimed at stabilizing design of our repo
files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-07 22:52:18 +02:00
Ruslan Kuprieiev e853fc76aa dvc: get rid of state dir and cache_state in favor of single .dvc 
From now on everything is stored in filename + .dvc path, except for local_state.
This allows us to be more explicit and help users see everything they need in relation
to version control of their own data files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-05 20:33:21 +02:00
Ruslan Kuprieiev 99965d2cee functest: add partial repro test 
Fixes #259

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-11-27 02:58:37 +02:00
Ruslan Kuprieiev f035926891 functest: add simple gc test 
Fixes #274

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-11-27 00:41:02 +02:00
Ruslan Kuprieiev 0f4d0e8861 functest: fix tests 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-11-26 13:42:47 +02:00
Ruslan Kuprieiev e70ebb1e3d functest: use new 'dvc run' semantics in tutorial 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-11-26 13:42:47 +02:00
Ruslan Kuprieiev 3083604a9c dvc: remove 'import' and replace it with 'add' 
Allows us to unify state files and drop another level of
abstraction.

Fixes #304

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-11-26 13:38:23 +02:00
Ruslan Kuprieiev c5648a33ec merge: don't forget to checkout cache_state file 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-11-26 13:38:23 +02:00
Dmitry 6955d56ca1 Include dvc commit to the tutorial 2017-11-14 09:16:53 -08:00
Ruslan Kuprieiev c022aa89d5 functest: use small data to test basic functionality 
Fixes #283

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-11-02 01:39:39 +02:00
Ruslan Kuprieiev 8fac23f93d functest: fix test-sync 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-11-01 23:50:43 +02:00
Ruslan Kuprieiev 54c4ce1b49 functest: fix tutorial 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-10-31 14:28:47 +02:00
Ruslan Kuprieiev 72b691b7f1 dvc: add 'dvc checkout' 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 90641c755a functest: fix merge test 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 9ae4c289eb functest: fix test-init 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-10-30 05:05:28 +02:00
Dmitry 1ef90c882e Repro error with the new md5 logic 2017-10-21 00:32:09 -07:00
Ruslan Kuprieiev 561cca120d test: add test for 'dvc merge' 
Basic test for 'dvc merge' functionality. We just create two branches,
do some dummy work on big data set, then branch and do some changes on
small data set and then merge second branch into first, calling 'dvc merge'
afterwards to restore big data back.

Fixes #262

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-10-21 00:04:39 +03:00
Dmitry b0e1d3374f Two branches scenario 2017-10-13 01:27:10 -07:00
Dmitry 898c4be0e2 Code improvements 2017-10-09 17:10:59 -07:00
Dmitry 4bece652d1 Typo in comment 2017-09-25 00:45:58 -07:00
Dmitry 67026ea43f Add comments 2017-09-19 09:31:34 -07:00
Dmitry 6fe4dc4d03 Fix typo 2017-09-18 05:14:43 -07:00
Dmitry 80271928f0 Change target command 2017-09-18 00:48:24 -07:00
Ruslan Kuprieiev 46b0f4eacc target: fix bugs 
Fixes #215

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-09-17 14:47:26 +03:00
Ruslan Kuprieiev 68186b08fc dvc: move config/cache/state/target to .dvc 
This is a more natural way to store dvc-related files and dirs
and follows git-logic much better.

Fixes #200

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-09-16 16:48:46 +03:00
Ruslan Kuprieiev 92ae0ba2a7 functest: add gcp sync test 
Temporarily disabled for travis.

Fixes #203

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-09-14 22:25:10 +03:00
Ruslan Kuprieiev fc901c03ed pull: create dirs before pulling 
Fixes #201

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-09-13 21:17:28 +03:00
Ruslan Kuprieiev 9b5b4874ad tests: use python in repro test 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-09-13 21:17:28 +03:00
Dmitry e32690dd71 Collapse repro command in the workflow 2017-09-03 14:45:01 -07:00
Dmitry d77ea9877e First workflow graph 2017-09-02 01:27:39 -07:00
Ruslan Kuprieiev 48e18cfc49 travis: check for secure env vars 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-08-27 01:50:10 +03:00
Ruslan Kuprieiev e0d1b68390 travis: fix pull check 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-08-27 00:46:55 +03:00
Ruslan Kuprieiev 68c06acd94 travis: enable aws tests 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-08-27 00:21:39 +03:00
Ruslan Kuprieiev f0ba4c1ff9 test: add simple push/pull/status test for aws 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-08-26 11:20:36 +03:00
Ruslan Kuprieiev 0f45afb3a4 functest: rework test system and introduce new tests 
Reworked existing tests and test-system, added a few new
tests(init, reworked repro, import).

Fixes #175

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-08-20 09:32:32 +03:00
Ruslan Kuprieiev e7bf8054da functest: fix existing scripts 
A few minor adjustments to make what we currently have work,
while I prepare new func tests.

Fixes #175

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-08-20 04:53:13 +03:00
Dmitry Petrov 141d7872d1 Install the latest requirements. Close #119 2017-07-23 21:32:13 -07:00
Dmitry Petrov cd99d48294 Tutorial scripts 2017-05-03 16:15:12 -07:00
Dmitry Petrov df33769203 Requirements file for the tutorial 2017-05-03 03:48:51 -07:00
Dmitry Petrov 6b3559a628 Tutorial E2E 2017-04-27 09:45:28 -07:00
Dmitry Petrov ab80e3c4a7 Create dvc command and make it work. Close #20 2017-04-11 23:22:37 -07:00
Dmitry Petrov 1222d7d8b8 A single repository or all func tests 2017-03-26 15:18:25 -07:00
Dmitry Petrov ac31c7a352 Modify func tests 2017-03-26 15:13:09 -07:00
Dmitry Petrov 7342880de9 Change code 2017-03-26 15:04:22 -07:00