Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-06 07:18:28 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,198 Commits 7 Branches 579 Tags
52c08b29263bc47e7dc8a4e8cf2db2313df6640b
Commit Graph
39 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 3748164ddb cloud: aws: migrate to boto3 
This allows us to abandon our own additional config parameters for
aws cloud(like region) and use the ones from .aws/config by default.
Plus, boto3 automatically switches to multipartupload if file is bigger
than a certain limit, allowing us to remove a lot of our own code.

Fixes #650
Fixes #636
Fixes #601

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-13 06:06:52 +03:00
Ruslan Kuprieiev 0df69a1046 tests: sleep(1) before modifying data files 
This will help simulate realistic behaviour on filesystems with poor mtime resolution.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-10 23:36:50 +03:00
Ruslan Kuprieiev 6dc9fbd08e dvc: cloud: use local state for cmp_checksum 
Fixes #633

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-10 01:56:06 +03:00
Ruslan Kuprieiev 828f00bf86 test: add ssh key in travis script 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-08 23:46:08 +03:00
Ruslan Kuprieiev 541429c26e tests: cloud: fix naming scheme 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-08 23:17:51 +03:00
Ruslan Kuprieiev c4fa14eae8 tests: ssh: fix typo 2018-04-08 22:52:37 +03:00
Ruslan Kuprieiev 36d924c4c2 test: add test for ssh cloud 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-08 22:26:18 +03:00
Ruslan Kuprieiev 3988397a3d tests: data cloud: limit jobs to 2 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-07 05:23:58 +03:00
Ruslan Kuprieiev eef12da7b6 tests: fix typo 2018-04-07 05:14:57 +03:00
Ruslan Kuprieiev f5ef256447 test: don't forget to copy gcp credentials 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-07 05:09:45 +03:00
Ruslan Kuprieiev e8b5af6cd9 test: test remotes in CLI 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-07 02:34:00 +03:00
Ruslan Kuprieiev a948f5ca90 gs: don't require ProjectName 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-05 21:31:20 +03:00
Ruslan Kuprieiev fb4633072e dvc: introduce remotes 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-05 21:31:20 +03:00
Ruslan Kuprieiev 5a8aef28f5 config: empty config by default + format verification 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-05 01:51:52 +03:00
Ruslan Kuprieiev 75c0ffaa68 test: test CLI failures for push/pull/fetch/status 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-14 20:11:05 +02:00
Ruslan Kuprieiev 2fe6091ffb dvc: don't change mode of files 
Since we can now detect cache corruption, we don't need
to force any permissions on our data files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-14 12:48:16 +02:00
Ruslan Kuprieiev 0068e90074 test: enable 'local cloud' tests for windows 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-10 18:46:14 +02:00
Ruslan Kuprieiev 2e21c39c00 cli: move push/pull from under 'dvc cache' 
Fixes #528

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 14:03:49 +02:00
Ruslan Kuprieiev fa43309222 config: rename 'Global' section to 'Core' 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 09:04:28 +02:00
Ruslan Kuprieiev 7f4c7783e7 dvc: store cached dir structure in a single json file 
Fixes #507

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-04 11:15:20 +02:00
Ruslan Kuprieiev 8b85d1c201 dvc: cloud: reuse connections when processing targets 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-02 04:00:40 +02:00
Ruslan Kuprieiev 44bcf9fa6b test: fix data cloud test 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-02 03:28:20 +02:00
Ruslan Kuprieiev 539ac41b70 dvc: use two-level hash for cache 
Fixes #488

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-02 02:51:20 +02:00
Ruslan Kuprieiev a05eddd746 tests: add test for cli data cloud 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-02-27 04:20:32 +02:00
Ruslan Kuprieiev d938e44ceb test: don't forget to import shutils 2018-02-15 21:30:46 +02:00
Ruslan Kuprieiev a58f3b8184 test: enable gcp tests 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-02-15 20:47:45 +02:00
Ruslan Kuprieiev bccdbfb15f Revert "travis/appveyor: test: enable gcp tests" 2018-02-14 23:18:41 +02:00
Ruslan Kuprieiev f109b69903 test: enable gcp tests 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-02-14 22:39:14 +02:00
Ruslan Kuprieiev 77e61f40be test: test AWS on appveyor 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-02-14 18:36:19 +02:00
Ruslan Kuprieiev ecea487614 Revert "test: test AWS on appveyor" 2018-02-14 14:09:17 +02:00
Ruslan Kuprieiev c5530a4830 test: test AWS on appveyor 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-02-14 13:57:26 +02:00
Ruslan Kuprieiev e4d9755a7e dvc: cloud RFC add support for directories 
Fixes #367

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-22 03:19:29 +02:00
Ruslan Kuprieiev 39328620f8 test: test gcp only when env var DVC_TEST_GCP=true 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-16 03:21:57 +02:00
Ruslan Kuprieiev a130a25e39 dvc: refactor data_cloud 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-15 21:11:25 +02:00
Ruslan Kuprieiev 487eae3f07 test: improve test coverage 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-10 17:15:42 +02:00
Ruslan Kuprieiev 96f9c50de8 cloud: fixup for #404 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-10 14:34:12 +02:00
Ruslan Kuprieiev 2b6d997fd3 dvc: remove ec2 commands 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-10 11:37:16 +02:00
Ruslan Kuprieiev e532aba6fa test: use unique aws s3 repo name 
I've setup a cleanup rule on s3 to remove old files, so
there is no need them up manualy.

Fixes #374

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-08 15:24:00 +02:00
Ruslan Kuprieiev 1c89bb50c5 test: add initial tests for LOCAL and AWS data clouds 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-07 22:33:26 +02:00