Commit Graph
9569 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 48cc9af6ca config: introduce config.local
Fixes #524

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-13 06:06:52 +03:00
Ruslan Kuprieiev 3748164ddb cloud: aws: migrate to boto3
This allows us to abandon our own additional config parameters for
aws cloud(like region) and use the ones from .aws/config by default.
Plus, boto3 automatically switches to multipartupload if file is bigger
than a certain limit, allowing us to remove a lot of our own code.

Fixes #650
Fixes #636
Fixes #601

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-13 06:06:52 +03:00
Ruslan Kuprieiev f1787275f2 Merge pull request #649 from efiop/master
tests: sleep(1) before modifying data files
2018-04-10 23:42:12 +03:00
Ruslan Kuprieiev 0df69a1046 tests: sleep(1) before modifying data files
This will help simulate realistic behaviour on filesystems with poor mtime resolution.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-10 23:36:50 +03:00
Ruslan Kuprieiev 28d664d53c Merge pull request #641 from efiop/master
test: call nosetests directly
2018-04-10 03:09:40 +03:00
Ruslan Kuprieiev 2dcfbad022 test: call nosetests directly
Previous method of calling nose.main() didn't really work on windows.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-10 02:59:38 +03:00
Ruslan Kuprieiev f529447d39 Merge pull request #640 from efiop/master
state: handle non-existing path
2018-04-10 02:29:48 +03:00
Ruslan Kuprieiev e5920e6a76 state: handle non-existing path
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-10 02:25:34 +03:00
Ruslan Kuprieiev cf09c891b4 Merge pull request #639 from efiop/master
cloud: cmp_checksum improvements
2018-04-10 02:04:34 +03:00
Ruslan Kuprieiev c4d3aac787 test: don't forget to increse ulimit for opened files
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-10 01:56:06 +03:00
Ruslan Kuprieiev 8839e72f07 dvc: stop using checksumdir and use our own way of checksuming a dir
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-10 01:56:06 +03:00
Ruslan Kuprieiev 6dc9fbd08e dvc: cloud: use local state for cmp_checksum
Fixes #633

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-10 01:56:06 +03:00
Ruslan Kuprieiev 0c5cc47a86 Merge pull request #632 from efiop/master
tests: cloud: fix naming scheme
2018-04-08 23:50:33 +03:00
Ruslan Kuprieiev 828f00bf86 test: add ssh key in travis script
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-08 23:46:08 +03:00
Ruslan Kuprieiev 541429c26e tests: cloud: fix naming scheme
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-08 23:17:51 +03:00
Ruslan Kuprieiev c4fa14eae8 tests: ssh: fix typo 2018-04-08 22:52:37 +03:00
Ruslan Kuprieiev dd9da04563 Merge pull request #631 from efiop/master
Add initial SSH driver
2018-04-08 22:34:44 +03:00
Ruslan Kuprieiev 52a88d6063 test: remove unittests.sh
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-08 22:26:18 +03:00
Ruslan Kuprieiev 36d924c4c2 test: add test for ssh cloud
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-08 22:26:18 +03:00
Ruslan Kuprieiev bd6688ff57 cloud: add ssh driver
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-08 22:26:18 +03:00
Ruslan Kuprieiev bdccd420dd Merge pull request #630 from efiop/master
Improve url testing for data cloud
2018-04-08 04:46:31 +03:00
Ruslan Kuprieiev 8d41959d87 dvc: don't forget the new line in version.py
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-08 00:31:02 +03:00
Ruslan Kuprieiev 9fdf949723 dvc: use DataCloud.supported() method for url testing
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-08 00:28:31 +03:00
Ruslan Kuprieiev 86d4a2bcc6 Merge pull request #629 from efiop/master
tests: data cloud: limit jobs to 2
2018-04-07 05:29:02 +03:00
Ruslan Kuprieiev 3988397a3d tests: data cloud: limit jobs to 2
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-07 05:23:58 +03:00
Ruslan Kuprieiev eef12da7b6 tests: fix typo 2018-04-07 05:14:57 +03:00
Ruslan Kuprieiev f5ef256447 test: don't forget to copy gcp credentials
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-07 05:09:45 +03:00
Ruslan Kuprieiev 30b71a4b4b Merge pull request #628 from efiop/master
Tests for 'remote' feature
2018-04-07 04:46:15 +03:00
Ruslan Kuprieiev 8d8af0518e config: schema: support windows paths
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-07 04:41:59 +03:00
Ruslan Kuprieiev e8b5af6cd9 test: test remotes in CLI
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-07 02:34:00 +03:00
Ruslan Kuprieiev 1ad63d1ba6 dvc: add dvc remote modify command
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-07 01:21:05 +03:00
Ruslan Kuprieiev 817695305e stage: write cmd only if it is not None 2018-04-06 02:52:56 +03:00
Ruslan Kuprieiev bb6d2bdb7e Merge pull request #627 from efiop/master
dvc: stage: don't write None and empty lists
2018-04-06 02:49:47 +03:00
Ruslan Kuprieiev 9383b28a06 dvc: stage: don't write None and empty lists
Fixes #622

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-06 02:45:20 +03:00
Ruslan Kuprieiev 23200908d2 Merge pull request #626 from efiop/master
Misc fixes
2018-04-06 02:16:57 +03:00
Ruslan Kuprieiev 48e3ce03d6 dvc: run: fix dvcfile name generation
Fixes #625

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-06 02:11:48 +03:00
Ruslan Kuprieiev 5dbbe5713d dvc: print msg about changed dependency
Fixes #618

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-06 02:09:33 +03:00
Ruslan Kuprieiev d5abd797be dvc: fix logger
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-06 02:09:21 +03:00
Ruslan Kuprieiev 47cfc72417 Merge pull request #624 from efiop/master
dvc: version: use autogenerated file to properly report version
2018-04-06 01:40:53 +03:00
Ruslan Kuprieiev 8ba4139f3c dvc: version: use autogenerated file to properly report version
Fixes #620

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-06 01:30:50 +03:00
Ruslan Kuprieiev 2bddeb5993 Merge pull request #617 from efiop/master
config: Introduce 'remotes' instead of 'cloud's
2018-04-06 00:37:14 +03:00
Ruslan Kuprieiev b1135e7edc dvc: allow specifying '--remote' param for push/pull/fetch/status
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-05 23:27:02 +03:00
Ruslan Kuprieiev 239401e9cd config: don't write empty lines
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-05 21:50:43 +03:00
Ruslan Kuprieiev b652d00fd9 cli: add 'dvc remote {add|remove}'
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-05 21:31:20 +03:00
Ruslan Kuprieiev f24549096b config: convert config back to configobj after validation
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-05 21:31:20 +03:00
Ruslan Kuprieiev 728c08695f exceptions: catch format_exc() exception
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-05 21:31:20 +03:00
Ruslan Kuprieiev a948f5ca90 gs: don't require ProjectName
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-05 21:31:20 +03:00
Ruslan Kuprieiev fb4633072e dvc: introduce remotes
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-05 21:31:20 +03:00
Ruslan Kuprieiev e37deca380 config: don't forget to specify the cause exception
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-05 01:51:53 +03:00
Ruslan Kuprieiev 1ae41736a2 dvc: init loglevel early
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-04-05 01:51:53 +03:00