Commit Graph
39 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 927d58cfad dvc: introduce stage files instead of state files
These describe single stage of pipeline and are allowed to
be placed anywhere in current or parent directories(up to
project's root) of the data file.

By default, 'dvc run' writes stage file to ./stage.dvc, but
it can be changed by using '-f' option(see functest/test-repro.py).

For now we're traversing project tree to find needed stage files for
specific data files. This is very wasteful and not optimal, but will
do for now, as this patch is aimed at stabilizing design of our repo
files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-12-07 22:52:18 +02:00
Dmitry 4c388089af Rename -r to -g (--out-git). Close #322 2017-12-05 01:03:06 -08:00
Dmitry 50f736d9d9 dvc run: regular file output. Close #314 2017-11-26 21:40:55 -08:00
Ruslan Kuprieiev 5acdfcde51 run: use REMAINDER for command
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-26 13:42:47 +02:00
Ruslan Kuprieiev 7620e14c82 repro: state: rework state format and repro internals
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-26 13:42:46 +02:00
Ruslan Kuprieiev 3083604a9c dvc: remove 'import' and replace it with 'add'
Allows us to unify state files and drop another level of
abstraction.

Fixes #304

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-26 13:38:23 +02:00
Dmitry 847a5e2716 Add branch and new-branch options 2017-11-19 02:41:59 -08:00
Dmitry 5e38fa7078 Renaming: dvc find 2017-11-16 01:16:20 -08:00
Dmitry 86a933ea71 dvc find command 2017-11-16 01:11:07 -08:00
Ruslan Kuprieiev fb377b8506 dvc: add 'dvc checkout'
Fixes #225

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 1d109b41a1 dvc: fix gc
Fixes #271

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 51cce677ce dvc: add 'merge' command
Fixes #246

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-17 16:15:15 +03:00
Ruslan Kuprieiev 7ee58220ea dvc: deprecate 'sync' command
Fixes #237

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-01 04:03:14 +03:00
Ruslan Kuprieiev 22fa9d50f1 python3: cli: add workaround for required subcommand
http://bugs.python.org/issue9253#msg186387

Fixes #239

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-01 04:03:14 +03:00
Dmitry bb9de4b691 Define max limit to commits per graph node 2017-09-18 05:09:29 -07:00
Ruslan Kuprieiev 5b2931798b dvc: get rid of 'test' command
Fixes #221

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-17 23:07:31 +03:00
Ruslan Kuprieiev 17f0c0de10 RFC: find and fix errors and some warning reported by pylint
Fixes #219

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-17 19:25:03 +03:00
Dmitry 8b489f7663 Merge changes 2017-09-16 23:13:16 -07:00
Dmitry 563ad0f513 Final changes and unit-tests fixes 2017-09-16 22:11:32 -07:00
Ruslan Kuprieiev 3286af59ef target: remove 'target' command
Fixes #209

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-17 02:41:50 +03:00
Ruslan Kuprieiev 68186b08fc dvc: move config/cache/state/target to .dvc
This is a more natural way to store dvc-related files and dirs
and follows git-logic much better.

Fixes #200

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-16 16:48:46 +03:00
Dmitry 0ee2073dbe Add cmd options 2017-09-06 09:55:09 -07:00
Dmitry 983b8f5efa Separate show pipeline and workflow 2017-09-04 12:35:17 -07:00
Dmitry d77ea9877e First workflow graph 2017-09-02 01:27:39 -07:00
Ruslan Kuprieiev dd8662dcfa dvc: rename 'visual' to 'show'
New name suits it much better.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-31 01:06:53 +03:00
Ruslan Kuprieiev 98c29c80d3 config: add ability to add and remove options
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-26 11:20:36 +03:00
Ruslan Kuprieiev b707dbd0fe dvc: add 'dvc visual'
This command generates dependency graph for specified target,
saves it in .dot file and also draws it into .svg file.

Fixes #39

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-26 09:18:45 +03:00
Dmitry Petrov 6c74a85150 Fix last merge issues 2017-08-23 01:46:36 -07:00
Dmitry Petrov 4befe3f7c6 Manual merge 2017-08-23 00:48:27 -07:00
Ruslan Kuprieiev 194e1ec419 dvc: add 'config' command
Fixes #177

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-20 06:19:38 +03:00
Ruslan Kuprieiev 149c921576 dvc: add status command
This command shows status for data files. I.e.

    $ dvc status data/
        new file:       .cache/Posts-train.tsv_2ccd8e7
        new file:       data/llss
        modified:       .cache/Posts.xml_512a612
        new file:       .cache/empty_0000000
        new file:       data/oss
        new file:       .cache/matrix-test.p_69b924d
        new file:       .cache/dir21111/Posts.xml.tgz_cd71d01

so it will tell us if there are any new/modified/deleted data
files that you might want to push/pull/etc.

Fixes #158

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-19 20:10:24 +03:00
Dmitry Petrov 761546b858 Move cloud cmd to experimental 2017-08-17 21:57:21 -07:00
Ruslan Kuprieiev 55fc9b7e0d cli: replace "dvc instance-create" with "dvc cloud create"
This looks and sounds much better.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-14 02:23:23 +03:00
Ruslan Kuprieiev ebeb32a8ac import: resume download
Download to .part file first and rename at the very end,
so if we lose connection we could resume download.
Note: not all servers support 'Range' header, so this
feature is not going to work everywhere.

This feature is activated by -c/--continue cmdline option.

Fixes #108

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-14 01:16:28 +03:00
Ruslan Kuprieiev db43e6bc91 dvc: add pull/push commands
We already have 'sync' command, but users report it to be confusing
when both local and remote files exist, so lets introduce two direct
commands to implicitly push and pull from cloud.

Fixes #157.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-12 22:44:10 +03:00
Dmitry Petrov 54c1aa63b0 Cloud basic 2: init 2017-08-04 04:39:48 -07:00
Ruslan Kuprieiev a1971ad39a cli: set dvc prog name to 'dvc'
Fixes #145

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-03 11:46:39 +03:00
Ruslan Kuprieiev b5623a32bd cli: fix help, 'run', 'repro' and 'sync'
Adding metavar='' is a legacy from previous design and should
be removed to achieve better help msgs.

'run' should have 'command' as a positional and _required_ argument and 'args'
as a remainder.

'repro' had CmdRun triggered when called from cli.

'sync' should have 'targets' as a positional and _required_ argument.

Fixes #136.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-03 04:55:07 +03:00
Ruslan Kuprieiev ee34fdfa31 RFC: move cmdline parsing to cli.py and settings RFC
This will make the structure of dvc more linear
making it easier to read. Plus, these changes
are needed in preparation for libdvc, as they
move all cmdline parsing to one common place.

This patch also refactors our settings system
also make it more linear and remove abstraction
levels that are not needed and only cause confusion.
There is a lot more to be done in preparation for
dvc lib and RFC overall, but this a first step
in that long journey.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-07-31 01:39:32 +03:00