Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-08 23:09:48 +01:00
Code Issues Packages Projects Releases Wiki Activity
9,569 Commits 7 Branches 579 Tags
dependabot/github_actions/github/codeql-action-4.38.2
Commit Graph
9569 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ruslan Kuprieiev 2447415657 dvc: move CmdDataStatus to a separate file 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-15 10:30:12 +02:00
Ruslan Kuprieiev 7c34cae64b Merge pull request #551 from efiop/master 
increase test coverage to 90%
 2018-03-14 20:31:30 +02:00
Ruslan Kuprieiev 8db50b88e2 test: add test for bad dir cache files 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-14 20:11:37 +02:00
Ruslan Kuprieiev 75c0ffaa68 test: test CLI failures for push/pull/fetch/status 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-14 20:11:05 +02:00
Ruslan Kuprieiev 1d17961732 sync: capture generic exceptions 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-14 20:10:42 +02:00
Ruslan Kuprieiev 7355c15f61 Merge pull request #548 from efiop/master 
dvc: don't change mode of files
 2018-03-14 12:56:26 +02:00
Ruslan Kuprieiev 2fe6091ffb dvc: don't change mode of files 
Since we can now detect cache corruption, we don't need
to force any permissions on our data files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-14 12:48:16 +02:00
Ruslan Kuprieiev 7019b796ba Merge pull request #547 from efiop/master 
tests: checkout: sleep(1) to emulate realistic behavior
 2018-03-13 20:58:58 +02:00
Ruslan Kuprieiev 3ab62555bd tests: checkout: sleep(1) to emulate realistic behavior 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-13 20:51:29 +02:00
Ruslan Kuprieiev 3e29e29c0b Merge pull request #545 from efiop/master 
State and travis fixes
 2018-03-13 20:24:34 +02:00
Ruslan Kuprieiev 26a7562242 travis: don't install graphviz 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-13 20:18:03 +02:00
Ruslan Kuprieiev b728d942c7 state: optimize state storage and computation 
Reduces 'dvc add' time for 30K files from 25sec to 9sec.

Fixes #546

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-13 20:18:03 +02:00
Ruslan Kuprieiev c9f4a4076c test: state: sleep 1 sec to simulate realistic behavior 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-13 18:57:33 +02:00
Ruslan Kuprieiev d8bdc7fea1 Merge pull request #544 from efiop/master 
test: add debug msgs for mtime issue
 2018-03-12 22:51:39 +02:00
Ruslan Kuprieiev 97643de654 test: add debug msgs for mtime issue 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-12 22:51:17 +02:00
Ruslan Kuprieiev 786171db20 Merge pull request #543 from efiop/master 
tests: add debug msg
 2018-03-12 20:40:32 +02:00
Ruslan Kuprieiev 440768b056 tests: add debug msg 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-12 20:38:57 +02:00
Ruslan Kuprieiev 04d11c1762 Remove pygraphviz from install_requires 2018-03-12 18:58:46 +02:00
Ruslan Kuprieiev 96bb4640a3 Remove pygraphviz from requirements.txt 2018-03-12 18:58:15 +02:00
Ruslan Kuprieiev d62f9da6b0 Merge pull request #541 from efiop/master 
dvc: remove 'show pipeline'
 2018-03-12 18:57:26 +02:00
Ruslan Kuprieiev 79e034b493 dvc: remove 'show pipeline' 
Fixes #533

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-12 01:18:52 +02:00
Ruslan Kuprieiev 10293e1006 Merge pull request #540 from efiop/master 
cache: check for cache corruption
 2018-03-12 01:03:09 +02:00
Ruslan Kuprieiev 0cd0e6700f cache: check of cache corruption 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-12 00:58:45 +02:00
Ruslan Kuprieiev 3091564e10 codeclimate: specify coverage file 2018-03-11 09:27:47 +02:00
Ruslan Kuprieiev 78cbc9c790 travis: add debug info for codeclimate 2018-03-11 00:00:14 +02:00
Ruslan Kuprieiev 2f9eac0b85 Merge pull request #539 from efiop/master 
travis: try using python reporter for codeclimate
 2018-03-10 23:46:36 +02:00
Ruslan Kuprieiev 85664061a6 travis: try using python reporter for codeclimate 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-10 23:41:36 +02:00
Ruslan Kuprieiev be87288f95 Merge pull request #538 from efiop/master 
Misc fixes
 2018-03-10 19:21:21 +02:00
Ruslan Kuprieiev 200d1dec29 dvc: move remove_untracked_hardlinks to inside the project 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-10 19:15:06 +02:00
Ruslan Kuprieiev 04855c8631 test: remove directory from gc test 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-10 19:13:14 +02:00
Ruslan Kuprieiev 0068e90074 test: enable 'local cloud' tests for windows 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-10 18:46:14 +02:00
Ruslan Kuprieiev f913fd8ad9 dvc: properly remove cached dir 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-10 18:41:23 +02:00
Ruslan Kuprieiev 5a7bee4508 dvc: fix progress bar 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-10 18:41:09 +02:00
Ruslan Kuprieiev 5fa796d95c Merge pull request #537 from efiop/master 
checkout: optimize lost hardlink search
 2018-03-10 13:14:26 +02:00
Ruslan Kuprieiev dce1935651 checkout: optimize lost hardlink search 
Speeds up checkout for 30K files from 6sec to 3.5sec

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-10 13:10:15 +02:00
Ruslan Kuprieiev 066151617e Merge pull request #536 from efiop/master 
dvc: calculate 'effective inode' from getfileinfo() on windows
 2018-03-10 12:47:38 +02:00
Ruslan Kuprieiev 7094ec0151 dvc: calculate 'effective inode' from getfileinfo() on windows 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-10 12:40:46 +02:00
Ruslan Kuprieiev 4cd789bf2a Merge pull request #532 from efiop/master 
dvc: switch from yaml to json for dir cache file
 2018-03-09 08:40:07 +02:00
Ruslan Kuprieiev 3b9259ff17 dvc: switch from yaml to json for dir cache file 
yaml is extremely slow without CLoader, which caused our checkout()
and similar functions to take way too long to process dir cache files.
These files are not really meant to be read by the users, so we can
sacrifice the readability if yaml for better performance of json module.

E.g. checkout for 30K files used to take 30sec and after this patch only
takes 6sec, which is still quite slow, but much more bearable.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-09 08:22:44 +02:00
Ruslan Kuprieiev a32ac41e3c Merge pull request #531 from efiop/master 
Fixes for pull/push CLI and cache
 2018-03-08 22:48:32 +02:00
Ruslan Kuprieiev 54a6532360 cache: create cache dirs only when needed 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 19:45:58 +02:00
Ruslan Kuprieiev 2e21c39c00 cli: move push/pull from under 'dvc cache' 
Fixes #528

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 14:03:49 +02:00
Ruslan Kuprieiev 1248b56f44 Merge pull request #529 from efiop/master 
config and cloud fixes
 2018-03-08 13:27:22 +02:00
Ruslan Kuprieiev 4bc62cbf66 aws: don't forget to use relpath in progress callback 
Fixes #519

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 12:44:44 +02:00
Ruslan Kuprieiev ff77d9dc46 dvc: calculate n jobs as 8*n_cpu 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 09:51:24 +02:00
Ruslan Kuprieiev fa43309222 config: rename 'Global' section to 'Core' 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 09:04:28 +02:00
Ruslan Kuprieiev 2e83045d72 Merge pull request #526 from efiop/master 
repro: don't fail if dir cache is not present
 2018-03-08 08:44:17 +02:00
Ruslan Kuprieiev 4a1e20c219 repro: don't fail if dir cache is not present 
Fixes #518

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 08:38:13 +02:00
Ruslan Kuprieiev 8dff57eb9c Merge pull request #525 from efiop/master 
introduce 'dvc fetch' and change 'dvc remove' behavior
 2018-03-08 08:21:18 +02:00
Ruslan Kuprieiev 36be0a221a dvc: introduce 'dvc cache fetch' 
Fixes #521

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-03-08 07:08:45 +02:00