Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-05 23:09:32 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,333 Commits 7 Branches 579 Tags
83d831735c8082e4d7eaa8bbeebe3978294ceeaa
Commit Graph
41 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 88397ef430 dvc: use Remote concept in existing code 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 0a049c232b cache: configurable cache dir and cache type 
From now on we allow specifying standalone cache dirs as well as
specifying linking method(copy, symlink, hardlink, reflink) for it.
If 'cache type' is not specified in the config, dvc will try all of
them starting from reflink all the way down to copy.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-28 21:50:49 +03:00
Ruslan Kuprieiev 3748164ddb cloud: aws: migrate to boto3 
This allows us to abandon our own additional config parameters for
aws cloud(like region) and use the ones from .aws/config by default.
Plus, boto3 automatically switches to multipartupload if file is bigger
than a certain limit, allowing us to remove a lot of our own code.

Fixes #650
Fixes #636
Fixes #601

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-13 06:06:52 +03:00
Ruslan Kuprieiev 0df69a1046 tests: sleep(1) before modifying data files 
This will help simulate realistic behaviour on filesystems with poor mtime resolution.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-10 23:36:50 +03:00
Ruslan Kuprieiev 6dc9fbd08e dvc: cloud: use local state for cmp_checksum 
Fixes #633

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-10 01:56:06 +03:00
Ruslan Kuprieiev 828f00bf86 test: add ssh key in travis script 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-08 23:46:08 +03:00
Ruslan Kuprieiev 541429c26e tests: cloud: fix naming scheme 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-08 23:17:51 +03:00
Ruslan Kuprieiev c4fa14eae8 tests: ssh: fix typo 2018-04-08 22:52:37 +03:00
Ruslan Kuprieiev 36d924c4c2 test: add test for ssh cloud 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-08 22:26:18 +03:00
Ruslan Kuprieiev 3988397a3d tests: data cloud: limit jobs to 2 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-07 05:23:58 +03:00
Ruslan Kuprieiev eef12da7b6 tests: fix typo 2018-04-07 05:14:57 +03:00
Ruslan Kuprieiev f5ef256447 test: don't forget to copy gcp credentials 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-07 05:09:45 +03:00
Ruslan Kuprieiev e8b5af6cd9 test: test remotes in CLI 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-07 02:34:00 +03:00
Ruslan Kuprieiev a948f5ca90 gs: don't require ProjectName 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-05 21:31:20 +03:00
Ruslan Kuprieiev fb4633072e dvc: introduce remotes 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-05 21:31:20 +03:00
Ruslan Kuprieiev 5a8aef28f5 config: empty config by default + format verification 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-05 01:51:52 +03:00
Ruslan Kuprieiev 75c0ffaa68 test: test CLI failures for push/pull/fetch/status 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-14 20:11:05 +02:00
Ruslan Kuprieiev 2fe6091ffb dvc: don't change mode of files 
Since we can now detect cache corruption, we don't need
to force any permissions on our data files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-14 12:48:16 +02:00
Ruslan Kuprieiev 0068e90074 test: enable 'local cloud' tests for windows 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-10 18:46:14 +02:00
Ruslan Kuprieiev 2e21c39c00 cli: move push/pull from under 'dvc cache' 
Fixes #528

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 14:03:49 +02:00
Ruslan Kuprieiev fa43309222 config: rename 'Global' section to 'Core' 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 09:04:28 +02:00
Ruslan Kuprieiev 7f4c7783e7 dvc: store cached dir structure in a single json file 
Fixes #507

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-04 11:15:20 +02:00
Ruslan Kuprieiev 8b85d1c201 dvc: cloud: reuse connections when processing targets 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-02 04:00:40 +02:00
Ruslan Kuprieiev 44bcf9fa6b test: fix data cloud test 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-02 03:28:20 +02:00
Ruslan Kuprieiev 539ac41b70 dvc: use two-level hash for cache 
Fixes #488

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-02 02:51:20 +02:00
Ruslan Kuprieiev a05eddd746 tests: add test for cli data cloud 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-02-27 04:20:32 +02:00
Ruslan Kuprieiev d938e44ceb test: don't forget to import shutils 2018-02-15 21:30:46 +02:00
Ruslan Kuprieiev a58f3b8184 test: enable gcp tests 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-02-15 20:47:45 +02:00
Ruslan Kuprieiev bccdbfb15f Revert "travis/appveyor: test: enable gcp tests" 2018-02-14 23:18:41 +02:00
Ruslan Kuprieiev f109b69903 test: enable gcp tests 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-02-14 22:39:14 +02:00
Ruslan Kuprieiev 77e61f40be test: test AWS on appveyor 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-02-14 18:36:19 +02:00
Ruslan Kuprieiev ecea487614 Revert "test: test AWS on appveyor" 2018-02-14 14:09:17 +02:00
Ruslan Kuprieiev c5530a4830 test: test AWS on appveyor 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-02-14 13:57:26 +02:00
Ruslan Kuprieiev e4d9755a7e dvc: cloud RFC add support for directories 
Fixes #367

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-22 03:19:29 +02:00
Ruslan Kuprieiev 39328620f8 test: test gcp only when env var DVC_TEST_GCP=true 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-16 03:21:57 +02:00
Ruslan Kuprieiev a130a25e39 dvc: refactor data_cloud 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-15 21:11:25 +02:00
Ruslan Kuprieiev 487eae3f07 test: improve test coverage 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-10 17:15:42 +02:00
Ruslan Kuprieiev 96f9c50de8 cloud: fixup for #404 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-10 14:34:12 +02:00
Ruslan Kuprieiev 2b6d997fd3 dvc: remove ec2 commands 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-10 11:37:16 +02:00
Ruslan Kuprieiev e532aba6fa test: use unique aws s3 repo name 
I've setup a cleanup rule on s3 to remove old files, so
there is no need them up manualy.

Fixes #374

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-08 15:24:00 +02:00
Ruslan Kuprieiev 1c89bb50c5 test: add initial tests for LOCAL and AWS data clouds 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-01-07 22:33:26 +02:00