Commit Graph
494 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 53e40e32ed tests: use paramiko instead of ssh cmds
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-02-08 01:35:05 +02:00
Ruslan Kuprieiev 865f3a3f05 test: fix styling
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-02-07 08:47:12 +02:00
Ruslan Kuprieiev c95e6eb856 tests: fix tests on travis
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-02-07 08:43:43 +02:00
Ruslan Kuprieiev 441fc3ad97 add: don't try to save cached stages
Cached stages are already saved, so there is no need to try to save them
once again.

Fixes #1581

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-02-06 14:26:21 +02:00
Ruslan Kuprieiev 94a8054d29 test: gs: refresh credentials
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-02-06 01:46:23 +02:00
Ruslan Kuprieiev 99ef6081c1 test: use creds when testing external gs deps/outs
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-02-06 00:13:19 +02:00
Thibault de Boissiere 2c67b59fc0 checkout: Suggest git checkout when dcv checkout fails (#1580) 2019-02-05 23:46:13 +02:00
Ruslan Kuprieiev f9ee8ed566 test: use deepcopy for TEST_CONFIG
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-02-05 04:08:41 +02:00
Ruslan Kuprieiev aaf71121b6 test: don't overwrite TEST_CONFIG
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-02-05 02:57:41 +02:00
Mehdi Hamoumi ffc94cc471 Add GCP credentials environment variable to config (#1567) 2019-02-05 01:33:04 +02:00
Paweł Redzyński 31426c1548 data cloud: lowercase remote name to match config values (#1575) 2019-02-04 22:49:15 +02:00
Paweł Redzyński 3d07c0a039 import: add resume flag (#1540)
Resume import
2019-02-04 21:40:08 +02:00
Ruslan Kuprieiev a2fb7da23d test: set maximum RLIMIT_NPROC
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-02-04 03:09:21 +02:00
Ruslan Kuprieiev 4896f08ddf dvc: comply with both flake8 and black
flake8 provides some additional features like unused vars check, etc, so
it makes total sense to use it as well.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-02-04 00:10:36 +02:00
Ruslan Kuprieiev 1cc2e0edcb tests: don't forget to import GitCommandNotFound
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-02-03 23:56:43 +02:00
Ruslan Kuprieiev 611ab96fd1 tests: fix formatting
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-02-03 21:07:44 +02:00
Ruslan Kuprieiev eaca7dc80c travis: osx: handle EAGAIN error
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-02-03 15:52:21 +02:00
Thibault de Boissiere 70a16b2dec Implement -R option for dvc metrics show (#1543) 2019-02-02 05:18:06 +02:00
Ruslan Kuprieiev ba091a6d34 checkout: handle EOFError when running in a git hook
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-31 22:56:48 +02:00
Ruslan Kuprieiev 4069e34130 dvc: use black instead of flake8
Fixes #1546

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-30 03:48:36 +02:00
Mr. Outis 3009a25ae2 remote http: use Content-MD5 header if there is not ETag available
Fix #1412
2019-01-28 19:02:41 -06:00
pared d5fecc34bd test: httpd: add lock for server 2019-01-28 22:01:34 +01:00
Ruslan Kuprieiev 3d30a43534 Merge pull request #1537 from mroutis/close-1519
status: --quiet reflects changes on its exit code
2019-01-28 21:37:01 +02:00
Mr. Outis 4218f85853 status: --quiet reflects changes on its exit code
Fix #1519
2019-01-28 11:28:44 -06:00
Mr. Outis 0d46921ec7 py2: add unicode literals
Fix #1512
2019-01-27 20:40:21 -06:00
Ruslan Kuprieiev 720d5d675f Merge pull request #1530 from efiop/master
remote: gs: don't forget to set projectname
2019-01-26 14:08:07 +02:00
Ruslan Kuprieiev e3304e14fa daemon: set PYTHONPATH
Fixes #1525

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-26 01:54:45 +02:00
Ruslan Kuprieiev a314209add remote: gs: don't forget to set projectname
Fixes #1529

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-26 00:30:08 +02:00
Ruslan Kuprieiev f5aa0da0ae stage: don't exclude md5s for deps/outs
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-24 17:02:07 +02:00
Ruslan Kuprieiev a108249db3 RFC: state: comply with pylint
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-23 03:35:46 +02:00
Ruslan Kuprieiev 9b91f60f36 Merge pull request #1431 from mroutis/fix-1348
stage: Checkout cached output when possible
2019-01-23 03:31:47 +02:00
Mr. Outis 185600d344 project: Detect circular dependencies on graph
Fix #1285
2019-01-22 18:39:56 -06:00
pared c120c8b663 move: handle directory as target argument 2019-01-21 21:37:52 +01:00
Mr. Outis 823077aa2b stage: Checkout cached output when possible
Fix #1348
2019-01-19 00:05:25 -06:00
Mr. Outis e600e3a736 remote: Use checksum instead of MD5/ETag 2019-01-19 00:02:28 -06:00
Ruslan Kuprieiev 6fec8b16cd RFC: conform to pylint
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-16 14:12:19 +02:00
pared d078e40d52 move: move stage file with target file 2019-01-15 19:14:24 +01:00
Ruslan Kuprieiev 60e9ed4f0b state: account for directories when computing size
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-15 17:17:15 +02:00
Ruslan Kuprieiev ced57a4382 state: don't forget to compute size of an individual file
Fixes #1488

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-15 13:08:25 +02:00
Paweł Redzyński 52ffae81c4 imp: refactor import message (#1501)
* imp: refactor import message

* import: reword error message

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-15 11:48:02 +02:00
pared 62967759d3 test: change test base bar content 2019-01-14 19:10:39 +01:00
Paweł Redzyński 64a4883ba1 state: cast file size to string
Fixes #1485
2019-01-13 12:09:13 +02:00
Mr. Outis 0372e1d87d move: Take into account suffix
🔨 Refactor

Fix #1491
2019-01-11 12:57:42 -06:00
pared 6f7e2095d3 project: support recursive sync operations 2019-01-10 18:02:23 +01:00
Mr. Outis 7be42c8402 run: Parse and quote correctly the command
Fix: #1478
2019-01-09 00:01:55 -06:00
Ruslan Kuprieiev 3053cf2b1f ssh: support specifying port in the url
Fixes #1473

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-08 10:12:43 +02:00
Ruslan Kuprieiev 5d381da5d9 ssh: change order of user configuration
Unfortunately this breaks backward compatibility, but we have to do it,
because current order is totally wrong. Configuring user with `dvc
remote modify myssh user` is an explicit action and should have higher
priority than implicit url. This is also important, since in the next
patch in this PR we will introduce support for `port` configuration,
that should also follow the same logic.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-08 10:12:43 +02:00
Ruslan Kuprieiev 68d965f4fb RFC: utils: create a separate module
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-07 18:20:56 +02:00
Ruslan Kuprieiev 7cd24e0c1f RFC: dependencies/outputs: unify classes
There is a lot of duplication in current Output/Dependency classes, that was
left "just in case" while developing different schemes. Since our code base is
now getting more and more stable and we now know what we need to add support
for any new dep/out type in the future, we can now safely unify most of the
code.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-01-05 23:17:55 +02:00
Paweł Redzyński 61e0ea9478 [WIP] 1445 warning on outdated stage (#1466)
* prepare test structure

* add warning on empty out info, test

* reformat line lengtha according to pep8

* change warning message
2019-01-05 14:03:13 +02:00