437 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 3840b8fa75 test: gc: skip if key file does not exist
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-22 04:49:20 +02:00
Ruslan Kuprieiev 4029116b85 remote: RFC: unify push/pull
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-21 18:18:33 +02:00
Ruslan Kuprieiev 141de1443c remote: RFC: unify gc code
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-20 22:09:26 +02:00
Ruslan Kuprieiev 2a46247cb2 remote: RFC: unify checksum <-> path convertions
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-20 22:09:26 +02:00
Ruslan Kuprieiev 7ecb9e87ae test: fix "overwrite" test on mac 2018-12-19 15:56:33 +02:00
Ruslan Kuprieiev eb810e617e Merge pull request #1436 from mroutis/fix-1435
repro: Fix --all-pipelines option
2018-12-18 18:35:37 +02:00
Ruslan Kuprieiev 4c753ff599 Merge pull request #1441 from efiop/1439
state: save file size
2018-12-17 13:12:53 +02:00
Ruslan Kuprieiev d5dd0fd804 test: don't use sleep
Since we now use file size to help detect file changes on filesystems
with bad mtime resolution, we no longer need these explicit sleep()
calls in our tests for mac os.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-17 12:42:35 +02:00
Ruslan Kuprieiev b7e473fc20 Merge pull request #1434 from mroutis/pipeline
RFC: Refactor pipeline definition
2018-12-17 12:30:33 +02:00
Mr. Outis e8a081030f repro: Fix --all-pipelines option
Fix #1435
2018-12-16 18:31:40 -06:00
Mr. Outis 4142f65531 Add tests for pipelines 2018-12-16 18:06:37 -06:00
Ruslan Kuprieiev 8fdb768bdd Merge pull request #1438 from mroutis/rfc-prompt
RFC: Prompt as functions instead of a class
2018-12-15 19:51:14 +02:00
Mr. Outis 948021f5b0 rfc: Prompt as functions instead of a class 2018-12-14 10:47:18 -06:00
Ruslan Kuprieiev 53e4e1c0a9 dvc: use local scheme as default
There is no way to detect if some path is a valid path in a general
case, since every filesystem has its own requirements and limitations.
Instead, just default to a local path and let fs handle the rest.

Fixes #1433

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-14 14:47:37 +02:00
Ruslan Kuprieiev 286373f9c7 test: fix whitespace 2018-12-13 08:40:24 +02:00
Ruslan Kuprieiev f5af2e1aec tests: fix test on mac os 2018-12-13 07:09:46 +02:00
Ruslan Kuprieiev eaa2d559db azure: support prefix
Fixes #1336

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-12 19:54:41 +02:00
Ruslan Kuprieiev ed3030707f cli: add dvc remote default command
Fixes #1357

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-12 19:21:34 +02:00
Ruslan Kuprieiev 7c2eb02209 repro: introduce --ignore-build-cache
Fixes #1342

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-12 19:21:34 +02:00
Mr. Outis a1ecbdd001 Merge branch 'master' into fix-1255 2018-12-11 14:56:05 -06:00
Mr. Outis 9971f7a624 run: Prevent argument duplication with deps/outs
Fix #1255
Fix #1168
Close #1259

RFC:
- Add / fix docstrings and privatize methods
- Add `__repr__` method for core objects
- Change the name of methods to make them more readable
2018-12-11 14:54:45 -06:00
Ruslan Kuprieiev e02a33f934 logger: shortcut logger in quiet and normal modes
In scenarios with millions of files, late shorcutting of
debug msgs results in massive overhead. In order to avoid
that, just shortcut logger messages ASAP if verbose mode
is not enabled.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-11 12:07:28 +02:00
Ruslan Kuprieiev a67988a80e test: enable flake8 checks for tests
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-06 06:40:55 +02:00
Ruslan Kuprieiev baa14f23f3 Merge pull request #1413 from mroutis/fix-1365
logger: Prevent adding multiple handlers
2018-12-05 07:38:57 +02:00
Mr. Outis b3b2c97f4b logger: Prevent adding multiple handlers
Fix #1365
2018-12-04 22:33:06 -06:00
Ruslan Kuprieiev de76db6f02 dvc: catch cached stages
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-05 05:47:44 +02:00
Ruslan Kuprieiev 0b01432e6c tests: fix overwrite test on mac os 2018-12-05 05:36:41 +02:00
Ruslan Kuprieiev 9f4dd2db68 Merge pull request #1400 from vernt/deterministic
Add dvc run --deterministic option.
2018-12-04 12:39:11 +02:00
Ruslan Kuprieiev 4230b8180b test: use System.is_{sym,hard}link
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-04 11:21:51 +02:00
Ruslan Kuprieiev a7c177d757 run: unprotect outs by default
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-04 09:50:30 +02:00
Ruslan Kuprieiev 83ee6e46e0 run: introduce --remove-outs option
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-04 09:15:23 +02:00
Ruslan Kuprieiev ac82426788 run: introduce --overwrite-dvcfile and --ignore-build-cache
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-04 07:17:16 +02:00
Ruslan Kuprieiev 8ad317e906 remote: properly check status for remote outputs
Fix #1402

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-04 04:33:22 +02:00
Ruslan Kuprieiev e81c6f2b34 run: introduce --force option
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-03 05:13:54 +02:00
Ruslan Kuprieiev 298ae356cd run: make --deterministic default
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-03 04:50:48 +02:00
Ruslan Kuprieiev ae5ac21bf8 run: deterministic: copare the whole dicts
We should check command, as well as any other fields. E.g. `locked`.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-03 01:29:29 +02:00
Ruslan Kuprieiev 1211abf35c test: add a proper test for dvc run --deterministic
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-02 22:55:33 +02:00
Ruslan Kuprieiev 1878c41c80 test: use quote instead of shlex.quote 2018-12-02 19:55:22 +02:00
Ruslan Kuprieiev e1f44158c8 test: use pipes.quote on py2 2018-12-02 19:45:43 +02:00
Ruslan Kuprieiev 6d4240dd8a test: fix shlex import 2018-12-02 18:58:32 +02:00
Ruslan Kuprieiev e75a2f7dde test: don't forget to import shlex 2018-12-02 18:44:01 +02:00
username b3a6d70d91 [WIP] Add dvc run --deterministic option.
Tests currently failing.
2018-12-02 00:35:20 -08:00
Ruslan Kuprieiev fe32002a7f dvc: handle KeyboardInterrupt
Fixes #1389

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-02 07:58:16 +02:00
Ruslan Kuprieiev f04ae2f74f dvc: optimize imports
Fixes #903

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-02 04:54:41 +02:00
Ruslan Kuprieiev ff40e1a016 analytics: collect cmd early
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-01 23:33:17 +02:00
Ruslan Kuprieiev 22c6ad5ba3 analytics: send user events
Fixes #693

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-01 06:02:28 +02:00
Ruslan Kuprieiev c02fe1313f config: support 'global' and 'system' configs
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-01 02:31:14 +02:00
Ruslan Kuprieiev 75ab3074a1 dvc: dynamically load default cloud
Fixes #1390

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-12-01 01:45:18 +02:00
Ruslan Kuprieiev ff577d7a87 run: use quotes to wrap arguments with spaces in them
Fixes #1372

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-11-30 10:11:49 +02:00
Ruslan Kuprieiev 98b043310d stage: properly handle dvc file md5
Fixes #1380

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-11-30 09:21:03 +02:00