Dmitry
b9219404c2
Tutorial branch update - intermediate version
2017-12-25 03:09:52 -08:00
Dmitry
8b433c609b
Func test fix
2017-12-25 01:28:30 -08:00
Dmitry
f6a3830de2
Func test fix: default stage file was changed
2017-12-25 00:22:34 -08:00
Ruslan Kuprieiev
a779424a36
WIP RFC
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-12-23 09:37:40 +02:00
Ruslan Kuprieiev
8186228043
repro: reproduce stages(Dvcfile by default)
...
Fixes #341
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-12-11 01:06:53 +02:00
Ruslan Kuprieiev
8bfc1f77f3
functest: don't forget to use -f with 'dvc run' in test-merge.sh
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-12-10 05:45:01 +02:00
Ruslan Kuprieiev
927d58cfad
dvc: introduce stage files instead of state files
...
These describe single stage of pipeline and are allowed to
be placed anywhere in current or parent directories(up to
project's root) of the data file.
By default, 'dvc run' writes stage file to ./stage.dvc, but
it can be changed by using '-f' option(see functest/test-repro.py).
For now we're traversing project tree to find needed stage files for
specific data files. This is very wasteful and not optimal, but will
do for now, as this patch is aimed at stabilizing design of our repo
files.
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-12-07 22:52:18 +02:00
Ruslan Kuprieiev
e853fc76aa
dvc: get rid of state dir and cache_state in favor of single .dvc
...
From now on everything is stored in filename + .dvc path, except for local_state.
This allows us to be more explicit and help users see everything they need in relation
to version control of their own data files.
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-12-05 20:33:21 +02:00
Ruslan Kuprieiev
99965d2cee
functest: add partial repro test
...
Fixes #259
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-11-27 02:58:37 +02:00
Ruslan Kuprieiev
f035926891
functest: add simple gc test
...
Fixes #274
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-11-27 00:41:02 +02:00
Ruslan Kuprieiev
0f4d0e8861
functest: fix tests
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-11-26 13:42:47 +02:00
Ruslan Kuprieiev
e70ebb1e3d
functest: use new 'dvc run' semantics in tutorial
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-11-26 13:42:47 +02:00
Ruslan Kuprieiev
3083604a9c
dvc: remove 'import' and replace it with 'add'
...
Allows us to unify state files and drop another level of
abstraction.
Fixes #304
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-11-26 13:38:23 +02:00
Ruslan Kuprieiev
c5648a33ec
merge: don't forget to checkout cache_state file
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-11-26 13:38:23 +02:00
Dmitry
6955d56ca1
Include dvc commit to the tutorial
2017-11-14 09:16:53 -08:00
Ruslan Kuprieiev
c022aa89d5
functest: use small data to test basic functionality
...
Fixes #283
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-11-02 01:39:39 +02:00
Ruslan Kuprieiev
8fac23f93d
functest: fix test-sync
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-11-01 23:50:43 +02:00
Ruslan Kuprieiev
54c4ce1b49
functest: fix tutorial
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-10-31 14:28:47 +02:00
Ruslan Kuprieiev
72b691b7f1
dvc: add 'dvc checkout'
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev
90641c755a
functest: fix merge test
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev
9ae4c289eb
functest: fix test-init
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-10-30 05:05:28 +02:00
Dmitry
1ef90c882e
Repro error with the new md5 logic
2017-10-21 00:32:09 -07:00
Ruslan Kuprieiev
561cca120d
test: add test for 'dvc merge'
...
Basic test for 'dvc merge' functionality. We just create two branches,
do some dummy work on big data set, then branch and do some changes on
small data set and then merge second branch into first, calling 'dvc merge'
afterwards to restore big data back.
Fixes #262
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-10-21 00:04:39 +03:00
Dmitry
b0e1d3374f
Two branches scenario
2017-10-13 01:27:10 -07:00
Dmitry
898c4be0e2
Code improvements
2017-10-09 17:10:59 -07:00
Dmitry
4bece652d1
Typo in comment
2017-09-25 00:45:58 -07:00
Dmitry
67026ea43f
Add comments
2017-09-19 09:31:34 -07:00
Dmitry
6fe4dc4d03
Fix typo
2017-09-18 05:14:43 -07:00
Dmitry
80271928f0
Change target command
2017-09-18 00:48:24 -07:00
Ruslan Kuprieiev
46b0f4eacc
target: fix bugs
...
Fixes #215
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-09-17 14:47:26 +03:00
Ruslan Kuprieiev
68186b08fc
dvc: move config/cache/state/target to .dvc
...
This is a more natural way to store dvc-related files and dirs
and follows git-logic much better.
Fixes #200
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-09-16 16:48:46 +03:00
Ruslan Kuprieiev
92ae0ba2a7
functest: add gcp sync test
...
Temporarily disabled for travis.
Fixes #203
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-09-14 22:25:10 +03:00
Ruslan Kuprieiev
fc901c03ed
pull: create dirs before pulling
...
Fixes #201
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-09-13 21:17:28 +03:00
Ruslan Kuprieiev
9b5b4874ad
tests: use python in repro test
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-09-13 21:17:28 +03:00
Dmitry
e32690dd71
Collapse repro command in the workflow
2017-09-03 14:45:01 -07:00
Dmitry
d77ea9877e
First workflow graph
2017-09-02 01:27:39 -07:00
Ruslan Kuprieiev
48e18cfc49
travis: check for secure env vars
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-08-27 01:50:10 +03:00
Ruslan Kuprieiev
e0d1b68390
travis: fix pull check
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-08-27 00:46:55 +03:00
Ruslan Kuprieiev
68c06acd94
travis: enable aws tests
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-08-27 00:21:39 +03:00
Ruslan Kuprieiev
f0ba4c1ff9
test: add simple push/pull/status test for aws
...
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-08-26 11:20:36 +03:00
Ruslan Kuprieiev
0f45afb3a4
functest: rework test system and introduce new tests
...
Reworked existing tests and test-system, added a few new
tests(init, reworked repro, import).
Fixes #175
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-08-20 09:32:32 +03:00
Ruslan Kuprieiev
e7bf8054da
functest: fix existing scripts
...
A few minor adjustments to make what we currently have work,
while I prepare new func tests.
Fixes #175
Signed-off-by: Ruslan Kuprieiev <[email protected] >
2017-08-20 04:53:13 +03:00
Dmitry Petrov
141d7872d1
Install the latest requirements. Close #119
2017-07-23 21:32:13 -07:00
Dmitry Petrov
cd99d48294
Tutorial scripts
2017-05-03 16:15:12 -07:00
Dmitry Petrov
df33769203
Requirements file for the tutorial
2017-05-03 03:48:51 -07:00
Dmitry Petrov
6b3559a628
Tutorial E2E
2017-04-27 09:45:28 -07:00
Dmitry Petrov
ab80e3c4a7
Create dvc command and make it work. Close #20
2017-04-11 23:22:37 -07:00
Dmitry Petrov
1222d7d8b8
A single repository or all func tests
2017-03-26 15:18:25 -07:00
Dmitry Petrov
ac31c7a352
Modify func tests
2017-03-26 15:13:09 -07:00
Dmitry Petrov
7342880de9
Change code
2017-03-26 15:04:22 -07:00