Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-07 07:18:27 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,198 Commits 7 Branches 579 Tags
52c08b29263bc47e7dc8a4e8cf2db2313df6640b
Commit Graph
195 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 52c08b2926 dvc: checkout single file 
Fixes #666

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-24 13:45:30 +03:00
Ruslan Kuprieiev 441098b35e dvc: introduce dvc install for installing git hooks 
Fixes #277
Fixes #657

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-24 10:47:22 +03:00
Ruslan Kuprieiev 5985fd3c96 metrics: don't forget to checkout() 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-20 11:04:05 +03:00
Ruslan Kuprieiev 1e7d548ca4 dvc: add dvc metrics 
Fixes #592

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-19 20:47:37 +03:00
Ruslan Kuprieiev a1460a6d92 init: properly handle dvc init in directory without scm 
Fixes #660
Fixes #662

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-18 09:27:55 +03:00
Ruslan Kuprieiev 29a44689c5 Merge pull request #658 from seqpipe/add-directory-with-slash 
Proper adding of 'directory/'
 2018-04-17 12:46:42 +03:00
Emil Gotsev 286153a609 Proper adding of 'directory/' 
* added a test for adding single level directory with forward slash in the end
 * normalizing the path that is passed to the add method
 2018-04-17 12:21:32 +03:00
Ruslan Kuprieiev 3748164ddb cloud: aws: migrate to boto3 
This allows us to abandon our own additional config parameters for
aws cloud(like region) and use the ones from .aws/config by default.
Plus, boto3 automatically switches to multipartupload if file is bigger
than a certain limit, allowing us to remove a lot of our own code.

Fixes #650
Fixes #636
Fixes #601

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-13 06:06:52 +03:00
Ruslan Kuprieiev 0df69a1046 tests: sleep(1) before modifying data files 
This will help simulate realistic behaviour on filesystems with poor mtime resolution.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-10 23:36:50 +03:00
Ruslan Kuprieiev 2dcfbad022 test: call nosetests directly 
Previous method of calling nose.main() didn't really work on windows.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-10 02:59:38 +03:00
Ruslan Kuprieiev c4d3aac787 test: don't forget to increse ulimit for opened files 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-10 01:56:06 +03:00
Ruslan Kuprieiev 8839e72f07 dvc: stop using checksumdir and use our own way of checksuming a dir 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-10 01:56:06 +03:00
Ruslan Kuprieiev 6dc9fbd08e dvc: cloud: use local state for cmp_checksum 
Fixes #633

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-10 01:56:06 +03:00
Ruslan Kuprieiev 828f00bf86 test: add ssh key in travis script 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-08 23:46:08 +03:00
Ruslan Kuprieiev 541429c26e tests: cloud: fix naming scheme 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-08 23:17:51 +03:00
Ruslan Kuprieiev c4fa14eae8 tests: ssh: fix typo 2018-04-08 22:52:37 +03:00
Ruslan Kuprieiev 52a88d6063 test: remove unittests.sh 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-08 22:26:18 +03:00
Ruslan Kuprieiev 36d924c4c2 test: add test for ssh cloud 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-08 22:26:18 +03:00
Ruslan Kuprieiev 9fdf949723 dvc: use DataCloud.supported() method for url testing 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-08 00:28:31 +03:00
Ruslan Kuprieiev 3988397a3d tests: data cloud: limit jobs to 2 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-07 05:23:58 +03:00
Ruslan Kuprieiev eef12da7b6 tests: fix typo 2018-04-07 05:14:57 +03:00
Ruslan Kuprieiev f5ef256447 test: don't forget to copy gcp credentials 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-07 05:09:45 +03:00
Ruslan Kuprieiev e8b5af6cd9 test: test remotes in CLI 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-07 02:34:00 +03:00
Ruslan Kuprieiev a948f5ca90 gs: don't require ProjectName 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-05 21:31:20 +03:00
Ruslan Kuprieiev fb4633072e dvc: introduce remotes 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-05 21:31:20 +03:00
Ruslan Kuprieiev 5a8aef28f5 config: empty config by default + format verification 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-04-05 01:51:52 +03:00
Ruslan Kuprieiev 7d5f6164d0 test: add test for stage file format 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-20 10:40:38 +02:00
Ruslan Kuprieiev 958eab2f23 dvc: fix checkout/repro with stage files without md5 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-20 00:31:30 +02:00
Ruslan Kuprieiev e9acd5a321 test: add test for state reload consistency 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-18 12:45:50 +02:00
Ruslan Kuprieiev 286002f9cb test: add '--force' test for repro 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-17 11:42:05 +02:00
Ruslan Kuprieiev b38b12962d dvc: remove fsck 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-16 11:23:54 +02:00
Ruslan Kuprieiev 2447415657 dvc: move CmdDataStatus to a separate file 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-15 10:30:12 +02:00
Ruslan Kuprieiev 8db50b88e2 test: add test for bad dir cache files 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-14 20:11:37 +02:00
Ruslan Kuprieiev 75c0ffaa68 test: test CLI failures for push/pull/fetch/status 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-14 20:11:05 +02:00
Ruslan Kuprieiev 2fe6091ffb dvc: don't change mode of files 
Since we can now detect cache corruption, we don't need
to force any permissions on our data files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-14 12:48:16 +02:00
Ruslan Kuprieiev 3ab62555bd tests: checkout: sleep(1) to emulate realistic behavior 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-13 20:51:29 +02:00
Ruslan Kuprieiev b728d942c7 state: optimize state storage and computation 
Reduces 'dvc add' time for 30K files from 25sec to 9sec.

Fixes #546

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-13 20:18:03 +02:00
Ruslan Kuprieiev c9f4a4076c test: state: sleep 1 sec to simulate realistic behavior 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-13 18:57:33 +02:00
Ruslan Kuprieiev 97643de654 test: add debug msgs for mtime issue 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-12 22:51:17 +02:00
Ruslan Kuprieiev 440768b056 tests: add debug msg 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-12 20:38:57 +02:00
Ruslan Kuprieiev 79e034b493 dvc: remove 'show pipeline' 
Fixes #533

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-12 01:18:52 +02:00
Ruslan Kuprieiev 0cd0e6700f cache: check of cache corruption 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-12 00:58:45 +02:00
Ruslan Kuprieiev 04855c8631 test: remove directory from gc test 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-10 19:13:14 +02:00
Ruslan Kuprieiev 0068e90074 test: enable 'local cloud' tests for windows 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-10 18:46:14 +02:00
Ruslan Kuprieiev 54a6532360 cache: create cache dirs only when needed 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 19:45:58 +02:00
Ruslan Kuprieiev 2e21c39c00 cli: move push/pull from under 'dvc cache' 
Fixes #528

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 14:03:49 +02:00
Ruslan Kuprieiev fa43309222 config: rename 'Global' section to 'Core' 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 09:04:28 +02:00
Ruslan Kuprieiev 783fad935b remove: use stage files as targets and only remove outputs 
Fixes #516

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 06:59:01 +02:00
Ruslan Kuprieiev 7f4c7783e7 dvc: store cached dir structure in a single json file 
Fixes #507

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-04 11:15:20 +02:00
Ruslan Kuprieiev f814269b4c dvc: properly collect used cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-03 04:25:46 +02:00