Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-09 23:10:24 +01:00
Code Issues Packages Projects Releases Wiki Activity
292 Commits 7 Branches 579 Tags
4bb569c16dc8de02c736f46f99bccfa3b74cc75e
Commit Graph
292 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Dmitry Petrov 4bb569c16d Refactoring 2017-07-25 03:27:49 -07:00
Dmitry Petrov 8a02c12042 Target logic for repro command 2017-07-25 03:06:00 -07:00
Dmitry Petrov 97088d98b1 Target cmd. First commit. 2017-07-25 02:29:49 -07:00
Dmitry Petrov 141d7872d1 Install the latest requirements. Close #119 2017-07-23 21:32:13 -07:00
Dmitry Petrov 3d4f89631d Fix mac os package issues 2017-07-19 21:52:20 -07:00
Ophir Yoktan d578ae74a9 Merge pull request #114 from ophiry/atomic_download 
download file to temp file, and rename only if success
 2017-07-14 00:26:23 +03:00
Ophir Yokatan fc9e091286 download file to temp file, and renmae only if success 2017-07-14 00:17:43 +03:00
Dmitry Petrov 69ebffd402 Build for Mac OS X 2017-07-13 09:50:00 -07:00
Dmitry Petrov a4daf3200d Merge pull request #112 from ophiry/master 
fix for allow using iam roles with s3 storage #111
 2017-07-05 22:40:10 -07:00
Ophir Yokatan ba845878c0 fix typo 2017-07-04 17:11:24 +03:00
Ophir Yokatan b304786f1b Handle missing credentials file 2017-07-04 17:06:45 +03:00
Ruslan Kuprieiev 671d87be52 Merge pull request #109 from efiop/master 
sync: handle exceptions
 2017-07-03 02:20:04 +03:00
Ruslan Kuprieiev 27bf57f415 sync: handle exceptions 
I.e. if network is gone for some reason, report that we're
able to sync some targets instead of just throwing exceptions
about broken pipe or something.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-07-03 02:12:54 +03:00
Ruslan Kuprieiev 3e0b148c44 Merge pull request #107 from efiop/master 
aws: typo fixup for #105
 2017-07-02 12:12:48 +03:00
Ruslan Kuprieiev c3ae9c3011 aws: typo fixup 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-07-02 08:13:09 +03:00
Ruslan Kuprieiev 13b83faff5 Merge pull request #105 from efiop/master 
aws: don't forget to finish_target() after sync is done
 2017-07-02 06:44:13 +03:00
Ruslan Kuprieiev c52e561adc aws: don't forget to finish_target() after sync is done 
Fixes #101

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-07-02 06:27:12 +03:00
Dmitry Petrov 2465f5589f Increment version 2017-07-01 16:43:09 -07:00
Dmitry Petrov cfa9731b3e Remove uploading info messages 2017-06-28 01:10:17 -07:00
Dmitry Petrov 3eda97d8ff download_url format 2017-06-27 02:53:49 -07:00
Dmitry Petrov a588d71a83 Small GC changes 2017-06-27 02:53:00 -07:00
Dmitry Petrov 059fcc028d Zero size file bugfix 2017-06-25 00:33:03 -04:00
Ruslan Kuprieiev a96b61bd4e Merge pull request #99 from efiop/master 
Progress bar improvements, --jobs and progress bar for LOCAL cloud and AWS
 2017-06-25 04:51:03 +03:00
Ruslan Kuprieiev 76db9db5c2 dvc: introduce --jobs option and use map_progress 
It replaces POOL_SIZE constant and by default equals to the
number of cpus available.

map_progress is a helper for 'sync' and 'import' commands to
run in a multi-threaded mode.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-06-25 04:04:19 +03:00
Ruslan Kuprieiev 7c6765c196 import/sync: add progress bar for local copy 
Currently progress bar is only supported for downloading
from web(aws,http* etc), but now it is also supported for
local files(i.e. LOCAL for 'data sync' and just local files
for 'import')

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-06-25 02:03:46 +03:00
Ruslan Kuprieiev bdb30cc602 sync: add progress bar for AWS 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-06-21 03:51:06 +03:00
Ruslan Kuprieiev 11d1fb502a progress: use global variable 'progress' 
There is no point in having more than just one
global progress bar.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-06-21 03:37:42 +03:00
Dmitry Petrov cd43160414 Increase version to 0.8.5 0.8.5 2017-06-19 23:42:39 -07:00
Dmitry Petrov fc576f3d77 Merge pull request #98 from dataversioncontrol/sync_subfolder_fix 
Sync subfolder fix
 2017-06-19 22:07:31 -07:00
Dmitry Petrov 3f962deb25 Fix: NamedTemporaryFile(mode=w) 2017-06-19 21:59:26 -07:00
Dmitry Petrov ed923db203 Import cmd unit-tests 2017-06-19 21:31:31 -07:00
Dmitry Petrov 674f20c800 Verify output refactoring. Small fixes. 2017-06-19 19:30:01 -07:00
Dmitry Petrov 47e1b421f5 Verify output refactoring. Attempt 2 2017-06-19 19:20:04 -07:00
Dmitry Petrov c16f97a3cf Verify output refactoring 2017-06-19 19:07:54 -07:00
Dmitry Petrov 15cadc44f6 Simplify output validation logic 2017-06-19 18:48:05 -07:00
Dmitry Petrov 71566b1a24 Rename CmdDataRemove class 2017-06-19 18:32:30 -07:00
Dmitry Petrov 05dfaa3d48 Rename file test_cmd_data_remove 2017-06-19 18:29:44 -07:00
Dmitry Petrov 0e3278641c Small tests headers fixes 2017-06-19 18:21:58 -07:00
Dmitry Petrov 17ffcea10f Error when syncing data subfolders. Close #94 2017-06-19 18:13:55 -07:00
Dmitry Petrov df6abc7528 Small sync and import fixes 2017-06-19 16:44:18 -07:00
Ruslan Kuprieiev 57691297a8 Merge pull request #95 from efiop/master 
progress: add progress bar to 'import'
 2017-06-19 04:52:05 +03:00
Ruslan Kuprieiev e9a9e32357 progress: add progress bar to 'import' 
This one is a bit like the one you see in yum/dnf.
It has one single line updating current progress
for different targets and once they are finished
prints them as standalone line. So it looks smth
like this:

  $ dvc import https://foo.bar/one.data \
               https://foo.bar/two.data \
               https://foo.bar/three.data
  (1/3): [########################################] 100% one.data
  (2/3): [#########################               ] 60% three.data

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-06-19 04:30:32 +03:00
Dmitry Petrov 9062da3f79 Tests for GC command 2017-06-17 17:08:17 -07:00
Dmitry Petrov f2bac9aac1 GC command 2017-06-14 23:48:58 -07:00
Ruslan Kuprieiev 5e4c11e8b5 Merge pull request #93 from efiop/master 
innosetup: add logos for installer
 2017-06-12 03:49:07 +03:00
Ruslan Kuprieiev c4bc971d26 innosetup: add logos for installer 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-06-12 03:27:08 +03:00
Dmitry Petrov edff97d4a9 Codeclimat badges 2017-06-11 16:41:17 -07:00
Ruslan Kuprieiev cf8cd9e5b0 Update travis.yml with correct code-climate token 2017-06-12 01:28:48 +03:00
Ruslan Kuprieiev 619d9691b9 Merge pull request #92 from efiop/master 
Misc changes for build and testing
 2017-06-12 00:28:36 +03:00
Ruslan Kuprieiev 4078e902d1 test_config: python3 fix 
1) use io for StringIO in python3
2) use builtins instead of __builtin__
3) use StringIO instead of BytesIO when mocking aws config
Othervise this test fails on python3.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2017-06-12 00:22:19 +03:00