Commit Graph
448 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 68186b08fc dvc: move config/cache/state/target to .dvc
This is a more natural way to store dvc-related files and dirs
and follows git-logic much better.

Fixes #200

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-16 16:48:46 +03:00
Ruslan Kuprieiev 9593de0667 Merge pull request #206 from efiop/master
Misc data-related changes(GCP, tests and status)
2017-09-15 02:41:02 +03:00
Ruslan Kuprieiev 92ae0ba2a7 functest: add gcp sync test
Temporarily disabled for travis.

Fixes #203

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-14 22:25:10 +03:00
Ruslan Kuprieiev cc2dff765b data: check checksum before pulling data
Fixes #205

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-14 22:24:50 +03:00
Ruslan Kuprieiev ce609c5f50 status: don't return 1 if len(statuses) != len(targets)
Number of targets from command line doesn't have to match
number of actual files that we've processed, as it may as
well be a directory.

Fixes #204

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-14 22:23:28 +03:00
Ruslan Kuprieiev 0c561e7f12 google cloud: fix cloud settings and requirements
These are to allow using OAuth with your dvc, as
this is the recomended way to access gcp.

Fixes #203

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-14 22:23:22 +03:00
Ruslan Kuprieiev 94532c869d Merge pull request #202 from efiop/master
pull: create dirs before pulling
2017-09-14 00:00:48 +03:00
Ruslan Kuprieiev fc901c03ed pull: create dirs before pulling
Fixes #201

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-13 21:17:28 +03:00
Ruslan Kuprieiev 52cf1efd8b tests: fix test_workflow
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-13 21:17:28 +03:00
Ruslan Kuprieiev 9b5b4874ad tests: use python in repro test
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-13 21:17:28 +03:00
Dmitry fa12ef632a Workflow graph: polish 2017-09-05 09:44:33 -07:00
Dmitry 993c802047 Workflow graph: target metric with no root fix 2017-09-04 23:44:08 -07:00
Dmitry Petrov 76287f629a Merge pull request #192 from dataversioncontrol/wrkflow_graph
First workflow graph
2017-09-04 14:02:00 -07:00
Dmitry 97b4f2bba3 Refactoring: reduce cyclomatic complexity 2017-09-04 13:41:35 -07:00
Dmitry 13ba9d0f53 Show target metric deltas 2017-09-04 13:36:51 -07:00
Dmitry df71350bbd Refactoring: reduce cyclomatic complexity 2017-09-04 12:42:29 -07:00
Dmitry 983b8f5efa Separate show pipeline and workflow 2017-09-04 12:35:17 -07:00
Dmitry db833517e8 Rename show to show_pipeline 2017-09-04 12:06:08 -07:00
Dmitry c372fe7c35 Refactoring: small renaming 2017-09-04 12:04:19 -07:00
Dmitry ee5eeea541 Show branch tips 2017-09-03 20:11:31 -07:00
Dmitry a86e08d830 Refactoring: extract Commits to a separate file 2017-09-03 19:10:00 -07:00
Dmitry a2b0cdb675 Move Workflow to graph module 2017-09-03 19:06:57 -07:00
Dmitry b3b4daf7fa Refactoring: make methods smaller 2017-09-03 19:01:05 -07:00
Dmitry a1a68c00c9 Show target metric on the graph 2017-09-03 18:47:56 -07:00
Dmitry 73339568d0 REfactoring: extract _remove_or_collapse() 2017-09-03 16:19:29 -07:00
Dmitry 237de3f58e Refactoring: exctract _redirect_edges() 2017-09-03 15:23:11 -07:00
Dmitry e32690dd71 Collapse repro command in the workflow 2017-09-03 14:45:01 -07:00
Ruslan Kuprieiev 992c37613d Merge pull request #199 from efiop/master
Logger and state files
2017-09-03 22:12:55 +03:00
Ruslan Kuprieiev e8f3747f2b state: convert input/output/code/argv paths to unix format
This is a temporary solution that allows us to keep our state
files compatible across platforms. A more proper way to achieve
this would be to redo our core to only operate using posixpath,
same way as git does. See #198.

Fixes #78

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-03 20:10:54 +03:00
Ruslan Kuprieiev c051f513a8 logger: kwargs pass through
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-03 15:40:41 +03:00
Ruslan Kuprieiev 7180e33119 Merge pull request #197 from efiop/master
build: fix errors on python3
2017-09-03 03:51:11 +03:00
Ruslan Kuprieiev ccd7a1339c build: fix errors on python3
These wasn't caught in pull-request as it doesn't
have secure env vars to test sync/pull/push/status.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-03 03:26:52 +03:00
Ruslan Kuprieiev 76aab6f6c3 Merge pull request #195 from efiop/master
Misc enhancements
2017-09-03 03:08:23 +03:00
Ruslan Kuprieiev ee5637f7e4 main: catch exceptions
Fixes #196

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-03 02:37:30 +03:00
Ruslan Kuprieiev ecbdd50542 status: error-out when cloud.status doesn't match expectations
Fixes #190

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-03 02:37:30 +03:00
Ruslan Kuprieiev 506df4895e Merge pull request #194 from efiop/master
aws: resume download/upload
2017-09-02 17:36:45 +03:00
Dmitry d77ea9877e First workflow graph 2017-09-02 01:27:39 -07:00
Ruslan Kuprieiev 42d8614837 aws: resume download/upload
Fixes #163

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-01 23:02:45 +03:00
Ruslan Kuprieiev dd8662dcfa dvc: rename 'visual' to 'show'
New name suits it much better.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-31 01:06:53 +03:00
Ruslan Kuprieiev 8256e0b104 Merge pull request #191 from efiop/master
misc
2017-08-28 00:02:08 +03:00
Ruslan Kuprieiev 1eab71c97f RFC: import: pass jobs early
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-27 23:35:22 +03:00
Ruslan Kuprieiev 48e18cfc49 travis: check for secure env vars
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-27 01:50:10 +03:00
Ruslan Kuprieiev 0cb1461e05 travis: use printf instead of echo 2017-08-27 01:22:05 +03:00
Ruslan Kuprieiev c1aa60b7b0 travis: create aws dir
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-27 01:11:03 +03:00
Ruslan Kuprieiev 24b7bffa3a test: add awscli
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-27 00:50:41 +03:00
Ruslan Kuprieiev e0d1b68390 travis: fix pull check
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-27 00:46:55 +03:00
Ruslan Kuprieiev 126505e25b Merge pull request #187 from efiop/master
travis: enable aws tests
2017-08-27 00:37:25 +03:00
Ruslan Kuprieiev 68c06acd94 travis: enable aws tests
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-27 00:21:39 +03:00
Ruslan Kuprieiev 4625368acb Merge pull request #183 from efiop/master
misc patches
2017-08-26 11:34:38 +03:00
Ruslan Kuprieiev f0ba4c1ff9 test: add simple push/pull/status test for aws
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-26 11:20:36 +03:00