Commit Graph
230 Commits
Author SHA1 Message Date
Dmitry b3f70d641e Collapsed commits formatting fixes 2017-09-16 12:06:06 -07:00
Dmitry 95f39de424 Keep only human commits 2017-09-13 00:58:49 -07:00
Dmitry 0ee2073dbe Add cmd options 2017-09-06 09:55:09 -07:00
Dmitry fa12ef632a Workflow graph: polish 2017-09-05 09:44:33 -07:00
Dmitry 993c802047 Workflow graph: target metric with no root fix 2017-09-04 23:44:08 -07:00
Dmitry Petrov 76287f629a Merge pull request #192 from dataversioncontrol/wrkflow_graph
First workflow graph
2017-09-04 14:02:00 -07:00
Dmitry 97b4f2bba3 Refactoring: reduce cyclomatic complexity 2017-09-04 13:41:35 -07:00
Dmitry 13ba9d0f53 Show target metric deltas 2017-09-04 13:36:51 -07:00
Dmitry df71350bbd Refactoring: reduce cyclomatic complexity 2017-09-04 12:42:29 -07:00
Dmitry 983b8f5efa Separate show pipeline and workflow 2017-09-04 12:35:17 -07:00
Dmitry db833517e8 Rename show to show_pipeline 2017-09-04 12:06:08 -07:00
Dmitry c372fe7c35 Refactoring: small renaming 2017-09-04 12:04:19 -07:00
Dmitry ee5eeea541 Show branch tips 2017-09-03 20:11:31 -07:00
Dmitry a86e08d830 Refactoring: extract Commits to a separate file 2017-09-03 19:10:00 -07:00
Dmitry a2b0cdb675 Move Workflow to graph module 2017-09-03 19:06:57 -07:00
Dmitry b3b4daf7fa Refactoring: make methods smaller 2017-09-03 19:01:05 -07:00
Dmitry a1a68c00c9 Show target metric on the graph 2017-09-03 18:47:56 -07:00
Dmitry 73339568d0 REfactoring: extract _remove_or_collapse() 2017-09-03 16:19:29 -07:00
Dmitry 237de3f58e Refactoring: exctract _redirect_edges() 2017-09-03 15:23:11 -07:00
Dmitry e32690dd71 Collapse repro command in the workflow 2017-09-03 14:45:01 -07:00
Ruslan Kuprieiev e8f3747f2b state: convert input/output/code/argv paths to unix format
This is a temporary solution that allows us to keep our state
files compatible across platforms. A more proper way to achieve
this would be to redo our core to only operate using posixpath,
same way as git does. See #198.

Fixes #78

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-03 20:10:54 +03:00
Ruslan Kuprieiev c051f513a8 logger: kwargs pass through
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-03 15:40:41 +03:00
Ruslan Kuprieiev ccd7a1339c build: fix errors on python3
These wasn't caught in pull-request as it doesn't
have secure env vars to test sync/pull/push/status.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-03 03:26:52 +03:00
Ruslan Kuprieiev ee5637f7e4 main: catch exceptions
Fixes #196

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-03 02:37:30 +03:00
Ruslan Kuprieiev ecbdd50542 status: error-out when cloud.status doesn't match expectations
Fixes #190

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-03 02:37:30 +03:00
Dmitry d77ea9877e First workflow graph 2017-09-02 01:27:39 -07:00
Ruslan Kuprieiev 42d8614837 aws: resume download/upload
Fixes #163

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-01 23:02:45 +03:00
Ruslan Kuprieiev dd8662dcfa dvc: rename 'visual' to 'show'
New name suits it much better.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-31 01:06:53 +03:00
Ruslan Kuprieiev 1eab71c97f RFC: import: pass jobs early
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-27 23:35:22 +03:00
Ruslan Kuprieiev 9d9a91d55d data: remove redundant code
Aws credentials are now managed by dvc/cloud/creds_aws.py

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-26 11:20:36 +03:00
Ruslan Kuprieiev 98c29c80d3 config: add ability to add and remove options
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-26 11:20:36 +03:00
Ruslan Kuprieiev b707dbd0fe dvc: add 'dvc visual'
This command generates dependency graph for specified target,
saves it in .dot file and also draws it into .svg file.

Fixes #39

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-26 09:18:45 +03:00
Ruslan Kuprieiev 30bacf7f95 dvc: rename empty to .empty
This will allow us to hide it.

Fixes #104

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-26 09:18:45 +03:00
Dmitry Petrov 5fdfe5060d Close #184 2017-08-25 02:38:53 -07:00
Ruslan Kuprieiev 73022d74d6 cloud: fix import
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-23 22:14:31 +03:00
Ruslan Kuprieiev fcaccfabcd data_cloud: fix cloud config for testing
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-23 22:05:46 +03:00
Dmitry Petrov 6c74a85150 Fix last merge issues 2017-08-23 01:46:36 -07:00
Dmitry Petrov 4befe3f7c6 Manual merge 2017-08-23 00:48:27 -07:00
Dmitry Petrov ee0e012f86 Config redesign 2017-08-23 00:38:28 -07:00
Ruslan Kuprieiev 6430982ef0 aws: fix progress and chunk size for multipart upload
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-21 08:30:06 +03:00
Ruslan Kuprieiev 04e66f94fc aws: use multipart to push changes, v2
Fixes #100

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-20 19:04:58 +03:00
Ruslan Kuprieiev 90762da18f cloud: fix typo
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-20 17:58:34 +03:00
Ruslan Kuprieiev 163558c9c2 Revert "aws: use multipart to push changes" 2017-08-20 17:55:23 +03:00
Ruslan Kuprieiev 78cad172c6 aws: use multipart to push changes
Fixes #100.
2017-08-20 16:12:38 +03:00
Ruslan Kuprieiev 194e1ec419 dvc: add 'config' command
Fixes #177

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-20 06:19:38 +03:00
Ruslan Kuprieiev eb533f9a9c RFC: fix issues reported by codeclimate
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-20 04:53:13 +03:00
Ruslan Kuprieiev 4fe831712e import: don't create state files for failed imports
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-19 20:10:54 +03:00
Ruslan Kuprieiev 3acc2146fa data_item: handle __eq__ if other == None
Currently it is not possible to check if data_item == None,
as __eq__ tries to access .data in 'None' object and thus
throws an exception.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-19 20:10:54 +03:00
Ruslan Kuprieiev c3a43c6d84 cloud: return data_item in sync/pull/push/import
This will help us distinguish if target was processed successfully.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-19 20:10:52 +03:00
Ruslan Kuprieiev 149c921576 dvc: add status command
This command shows status for data files. I.e.

    $ dvc status data/
        new file:       .cache/Posts-train.tsv_2ccd8e7
        new file:       data/llss
        modified:       .cache/Posts.xml_512a612
        new file:       .cache/empty_0000000
        new file:       data/oss
        new file:       .cache/matrix-test.p_69b924d
        new file:       .cache/dir21111/Posts.xml.tgz_cd71d01

so it will tell us if there are any new/modified/deleted data
files that you might want to push/pull/etc.

Fixes #158

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-19 20:10:24 +03:00