Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-02 07:18:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
664 Commits 7 Branches 579 Tags
863e0e4b14524b64a4ab2c70ef3088b96cb5850e
Commit Graph
664 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Dmitry 863e0e4b14 Use output filename as a default stage file name but do not change dir 2017-12-24 18:31:15 -08:00
Ruslan Kuprieiev 33ccb61d45 Merge pull request #356 from efiop/master 
Internal and external design changes
 2017-12-23 10:00:47 +02:00
Ruslan Kuprieiev a779424a36 WIP RFC 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-23 09:37:40 +02:00
Ruslan Kuprieiev 214e30e15c travis: use group to specify previous image 
Travis recently updated trusty image which broke our builds, this commit fixes that by manually specifying older image group.
 2017-12-20 04:56:35 +02:00
Dmitry Petrov 95dcdd8aec Merge pull request #355 from dataversioncontrol/dvcfiles_in_curr_dir_by_default 
Keep dvc files in the current dir by default
 2017-12-16 14:06:36 -08:00
Dmitry e9b50093e9 Keep dvc files i the currend dir by default 2017-12-16 14:03:13 -08:00
Dmitry Petrov 4bd9336c95 Merge pull request #354 from dataversioncontrol/dvc_checkout_2 
dvc checkout: remove files from previous branch
 2017-12-16 01:17:41 -08:00
Dmitry 1d3e5a2dcc dvc checkout: remove files from previous branch 2017-12-16 01:16:18 -08:00
Dmitry Petrov fbedc8115b Merge pull request #352 from dataversioncontrol/defult_stage_file_name 
Use output filename as a default stage file name
 2017-12-14 02:27:40 -08:00
Dmitry 282b7c6805 Use output filename as a defult stage file name. Close #351 2017-12-14 02:13:39 -08:00
Ruslan Kuprieiev 99ecc9e4d9 Merge pull request #347 from efiop/master 
Misc stage-file features
 2017-12-11 01:48:33 +02:00
Ruslan Kuprieiev 8186228043 repro: reproduce stages(Dvcfile by default) 
Fixes #341

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-11 01:06:53 +02:00
Ruslan Kuprieiev 2ded6bf409 run: add -c|--cwd option 
Fixes #343

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-10 06:06:29 +02:00
Ruslan Kuprieiev 8bfc1f77f3 functest: don't forget to use -f with 'dvc run' in test-merge.sh 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-10 05:45:01 +02:00
Ruslan Kuprieiev 300332e223 run: create 'Dvcfile' by default 
Fixes #344

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-10 05:41:17 +02:00
Ruslan Kuprieiev 554b928d62 Merge pull request #339 from efiop/master 
state: don't create dirs for local state
 2017-12-08 01:29:46 +02:00
Ruslan Kuprieiev 56036b0f74 state: don't create dirs for local state 
Fixes #312

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-07 23:36:19 +02:00
Ruslan Kuprieiev 84789d334d Merge pull request #338 from efiop/master 
State(stage) files design changes
 2017-12-07 23:18:24 +02:00
Ruslan Kuprieiev 927d58cfad dvc: introduce stage files instead of state files 
These describe single stage of pipeline and are allowed to
be placed anywhere in current or parent directories(up to
project's root) of the data file.

By default, 'dvc run' writes stage file to ./stage.dvc, but
it can be changed by using '-f' option(see functest/test-repro.py).

For now we're traversing project tree to find needed stage files for
specific data files. This is very wasteful and not optimal, but will
do for now, as this patch is aimed at stabilizing design of our repo
files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-07 22:52:18 +02:00
Ruslan Kuprieiev 0b639a9c09 state: rework state format 
Dependencies are now specified in a more natural way:

deps:
  path/to/file1: <md5>
  path/to/file2: <md5>

And outputs also have md5 sum, that allows us to track
them by it and not by separate md5 field in state file,
which will allow us to remove strict data <-> data.state
relation in the future.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-07 01:58:13 +02:00
Ruslan Kuprieiev 2ee71f8687 Merge pull request #335 from efiop/master 
travis: manually specify macos image
 2017-12-06 19:03:06 +02:00
Ruslan Kuprieiev ebba1270c4 travis: manually specify mac os image 
Fixes #332

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-06 12:50:37 +02:00
Dmitry Petrov 7d872cf8e7 Merge pull request #337 from dataversioncontrol/git_file_state_file_fix 
Git file output fix
 2017-12-06 00:56:13 -08:00
Dmitry 075415f6bc Git file output fix 2017-12-06 00:33:59 -08:00
Ruslan Kuprieiev 141351db99 Merge pull request #333 from efiop/master 
State/CommandFile and repository design changes
 2017-12-05 21:35:26 +02:00
Ruslan Kuprieiev bbe5e46b5c dvc: remove CommandFile 
As we're moving to more user friendly single *.dvc file approach, separate
command files become uneeded.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-05 20:56:17 +02:00
Ruslan Kuprieiev e853fc76aa dvc: get rid of state dir and cache_state in favor of single .dvc 
From now on everything is stored in filename + .dvc path, except for local_state.
This allows us to be more explicit and help users see everything they need in relation
to version control of their own data files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-12-05 20:33:21 +02:00
Dmitry Petrov 3322638b1b Merge pull request #319 from dataversioncontrol/new_design_fixes_2 
New design fixes 2
 2017-12-05 02:49:12 -08:00
Dmitry 4c388089af Rename -r to -g (--out-git). Close #322 2017-12-05 01:03:06 -08:00
Dmitry 7c49a195d8 Detailed message: md5 sum doesn\'t match 2017-12-05 00:51:01 -08:00
Dmitry 071c909962 Executor formatting 2017-11-28 22:51:40 -08:00
Dmitry 6a3fad1a4b Checkout: no warnings when file doesn't exist 2017-11-28 21:56:51 -08:00
Dmitry cd75631403 Replace a string hack to regexp 2017-11-28 19:14:04 -08:00
Dmitry 868c4d1c34 Python 2-3 unification: do not return iterators 2017-11-28 19:03:21 -08:00
Ruslan Kuprieiev 10f22142f5 Merge pull request #318 from efiop/master 
Misc small fixes
 2017-11-29 00:00:37 +02:00
Ruslan Kuprieiev a828fee479 requirements: add pyyaml 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-11-28 21:47:23 +02:00
Ruslan Kuprieiev f12402771b init: add *.local_state to gitignore 
Fixes #313

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-11-28 21:44:19 +02:00
Dmitry Petrov add5552c02 Merge pull request #317 from dataversioncontrol/new_design_fixes 
New design fixes
 2017-11-27 01:52:42 -08:00
Dmitry 2a980f6e57 Fix func tests: get rid of python3 lazy evaluation 2017-11-27 00:33:40 -08:00
Dmitry 4b3827255d Get rid of code duplication 2017-11-26 22:57:39 -08:00
Dmitry 86ad3cb360 It is okay if output file does not exist 2017-11-26 22:50:09 -08:00
Dmitry b022fa62fe Do not checkout files without cache_state 2017-11-26 22:47:47 -08:00
Dmitry 40660b5120 Refactoring: extract CommandFile class 2017-11-26 21:49:06 -08:00
Dmitry 50f736d9d9 dvc run: regular file output. Close #314 2017-11-26 21:40:55 -08:00
Dmitry e5fe6b3732 Ignore .coverage file 2017-11-26 18:09:01 -08:00
Ruslan Kuprieiev 5d8d6d2f55 Merge pull request #307 from efiop/master 
Func tests and RFC
 2017-11-27 03:17:43 +02:00
Ruslan Kuprieiev 99965d2cee functest: add partial repro test 
Fixes #259

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-11-27 02:58:37 +02:00
Ruslan Kuprieiev f035926891 functest: add simple gc test 
Fixes #274

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-11-27 00:41:02 +02:00
Ruslan Kuprieiev 3ed37fd0f8 data: check that data is not in .dvc 
Fixes #270

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-11-27 00:04:41 +02:00
Ruslan Kuprieiev f1ae4ad56c Merge pull request #306 from efiop/master 
Major misc changes(Cmdfile, repro, run, local_state etc)
 2017-11-26 20:27:43 +02:00