Commit Graph
85 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 4271ddf11c dvc introduce dvc import
Fixes #705

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-15 18:37:50 +03:00
Ruslan Kuprieiev 594a99ba9d cli: fix dvc remote bug on python3
Fixes #769

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-13 21:43:45 +03:00
Ruslan Kuprieiev 5902e6066c remove: add -o|--outs and -p|--purge options
Fixes #761

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-13 13:15:40 +03:00
Ruslan Kuprieiev 9389422f0b dvc: add --cwd for dvc repro
Fixes #401

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-06 01:42:06 +03:00
Ruslan Kuprieiev 6156b7e1b1 dvc: introduce 'dvc remote list'
Fixes #690

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-05 14:17:35 +03:00
Ruslan Kuprieiev 52c08b2926 dvc: checkout single file
Fixes #666

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-24 13:45:30 +03:00
Ruslan Kuprieiev 441098b35e dvc: introduce dvc install for installing git hooks
Fixes #277
Fixes #657

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-24 10:47:22 +03:00
Ruslan Kuprieiev 1e7d548ca4 dvc: add dvc metrics
Fixes #592

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-19 20:47:37 +03:00
Ruslan Kuprieiev a1460a6d92 init: properly handle dvc init in directory without scm
Fixes #660
Fixes #662

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-18 09:27:55 +03:00
Ruslan Kuprieiev 48cc9af6ca config: introduce config.local
Fixes #524

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-13 06:06:52 +03:00
Ruslan Kuprieiev 1ad63d1ba6 dvc: add dvc remote modify command
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-07 01:21:05 +03:00
Ruslan Kuprieiev d5abd797be dvc: fix logger
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-06 02:09:21 +03:00
Ruslan Kuprieiev b1135e7edc dvc: allow specifying '--remote' param for push/pull/fetch/status
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-05 23:27:02 +03:00
Ruslan Kuprieiev b652d00fd9 cli: add 'dvc remote {add|remove}'
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-05 21:31:20 +03:00
Ruslan Kuprieiev 1ae41736a2 dvc: init loglevel early
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-05 01:51:53 +03:00
Ruslan Kuprieiev b38b12962d dvc: remove fsck
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-16 11:23:54 +02:00
Ruslan Kuprieiev 71fef4d857 dvc: add basic 'dvc status'
(dvc) ➜  myrepo git:(master) ✗ dvc status
foo.dvc
        outs
                changed:  foo
foo2.dvc
        outs
                changed:  foo2
        deps
                changed:  foo1
foo1.dvc
        outs
                changed:  foo1
        deps
                changed:  foo

(dvc) ➜  myrepo git:(master) ✗ dvc status --cloud

        new:      c1/57a79031e1c40f85931829bc5fc552

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-16 10:58:09 +02:00
Ruslan Kuprieiev 2447415657 dvc: move CmdDataStatus to a separate file
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-15 10:30:12 +02:00
Ruslan Kuprieiev 79e034b493 dvc: remove 'show pipeline'
Fixes #533

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-12 01:18:52 +02:00
Ruslan Kuprieiev 2e21c39c00 cli: move push/pull from under 'dvc cache'
Fixes #528

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-08 14:03:49 +02:00
Ruslan Kuprieiev ff77d9dc46 dvc: calculate n jobs as 8*n_cpu
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-08 09:51:24 +02:00
Ruslan Kuprieiev 36be0a221a dvc: introduce 'dvc cache fetch'
Fixes #521

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-08 07:08:45 +02:00
Ruslan Kuprieiev 783fad935b remove: use stage files as targets and only remove outputs
Fixes #516

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-08 06:59:01 +02:00
Ruslan Kuprieiev dbc6e1ac88 dvc: add push/pull/status per dvc-file
Fixes #453

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-03-04 15:10:33 +02:00
Ruslan Kuprieiev 576ba96e25 Revert "cloud: process targets one-by-one"
This reverts commit 61b469144e.
2018-02-18 23:10:59 +02:00
Ruslan Kuprieiev 61b469144e cloud: process targets one-by-one
In all operations we're dealing with a single stream,
so there is no good reason to process targets in parallel
as they all use the same resource to pull\push data to.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-17 19:36:51 +02:00
Ruslan Kuprieiev 2351fc12d2 dvc: move status/pull/push under cache subcmd
Fixes #449

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-02-12 13:14:07 +02:00
Dmitry f0a54823b9 Polishing help texts and commands reordering 2018-01-28 01:43:37 -08:00
Ruslan Kuprieiev 6e037a4307 dvc: remove show-workflow logic
As discussed with @dmpetrov, removing this functionality
for the upcoming release.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-15 20:30:53 +02:00
Dmitry 58ef7b861c show workflow: target metric typo 2018-01-15 02:24:10 -08:00
Ruslan Kuprieiev cf7bafad4d dvc: remove brancher and Find
Fixes #383
Fixes #376

We discussed this with @dmpetrov and decided to
remove this ml-specific functionality from the
core product.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-14 18:15:42 +02:00
Ruslan Kuprieiev 6a6c11ffdb dvc: remove lock
As discussed with @dmpetrov, we don't really see a good usage scenario
for this and thus removing it from dvc.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-13 01:54:20 +02:00
Ruslan Kuprieiev 2b6d997fd3 dvc: remove ec2 commands
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-10 11:37:16 +02:00
Ruslan Kuprieiev cd12513c57 Merge pull request #387 from dataversioncontrol/testing_misc
Bugfixes and fsck refactoring
2018-01-09 00:15:29 +02:00
Ruslan Kuprieiev e4b9718f34 run: add --no-exec option
Fixes #385

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-08 13:19:42 +02:00
Ruslan Kuprieiev 609586eb60 test: add basic tests for cli.py
Fixes #384

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-07 16:11:24 +02:00
Dmitry 225c8a3813 fsck refactoring: extract FileFsck class. Add --all option. 2018-01-07 04:37:59 -08:00
Dmitry de533f0437 Remove --all option - empty param list instead 2018-01-06 15:47:57 -08:00
Dmitry ab3abbe87a New command: dvc fsck. Close #381. 2018-01-06 04:17:55 -08:00
Ruslan Kuprieiev 14181ede5f dvc: remove -D option
Fixes #370

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-01-04 13:34:31 +02:00
Dmitry 863e0e4b14 Use output filename as a default stage file name but do not change dir 2017-12-24 18:31:15 -08:00
Ruslan Kuprieiev a779424a36 WIP RFC
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-12-23 09:37:40 +02:00
Dmitry 282b7c6805 Use output filename as a defult stage file name. Close #351 2017-12-14 02:13:39 -08:00
Ruslan Kuprieiev 8186228043 repro: reproduce stages(Dvcfile by default)
Fixes #341

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-12-11 01:06:53 +02:00
Ruslan Kuprieiev 2ded6bf409 run: add -c|--cwd option
Fixes #343

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-12-10 06:06:29 +02:00
Ruslan Kuprieiev 300332e223 run: create 'Dvcfile' by default
Fixes #344

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-12-10 05:41:17 +02:00
Ruslan Kuprieiev 927d58cfad dvc: introduce stage files instead of state files
These describe single stage of pipeline and are allowed to
be placed anywhere in current or parent directories(up to
project's root) of the data file.

By default, 'dvc run' writes stage file to ./stage.dvc, but
it can be changed by using '-f' option(see functest/test-repro.py).

For now we're traversing project tree to find needed stage files for
specific data files. This is very wasteful and not optimal, but will
do for now, as this patch is aimed at stabilizing design of our repo
files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-12-07 22:52:18 +02:00
Dmitry 4c388089af Rename -r to -g (--out-git). Close #322 2017-12-05 01:03:06 -08:00
Dmitry 50f736d9d9 dvc run: regular file output. Close #314 2017-11-26 21:40:55 -08:00
Ruslan Kuprieiev 5acdfcde51 run: use REMAINDER for command
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-26 13:42:47 +02:00