Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-02 07:18:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
3,456 Commits 7 Branches 579 Tags
7c19e9e4bf673de3afa23159f465072fb95c9758
Commit Graph
3456 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ruslan Kuprieiev 7c19e9e4bf Merge pull request #2389 from Suor/streaming-clouds 
api: stream data in api.open() for S3, GS and OSS
 2019-08-13 11:30:41 +03:00
Alexander Schepanovski 641eb57b27 api: stream data in api.open() for S3, GS and OSS 
Employ the same sign url and use resumable download approach tested for
Azure.
 2019-08-13 14:09:51 +07:00
Ruslan Kuprieiev 3095b24ed4 Merge pull request #2375 from pared/2373 
remote: gs/s3: remove batch_exists
 2019-08-13 02:56:04 +03:00
Ruslan Kuprieiev 06d347178f remote: base: remove whitespace 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-13 02:25:15 +03:00
Ruslan Kuprieiev c308ad8a58 remote: base: don't forget about the progress bar 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-13 02:08:29 +03:00
pawel 8233f959c7 remote: ssh: reintroduce batch_exists 2019-08-12 14:10:16 +02:00
pawel f224790aab remote: base: remove unnecessary list casting 2019-08-12 11:01:02 +02:00
pared 394d6ffeeb remote: ssh: connection: remove open_max_sftp_channels 2019-08-12 11:01:02 +02:00
pared 132b571e72 remote: oss: fix _list_cache_args 2019-08-12 11:01:02 +02:00
pared 98de99f5a9 remote: azure: make blob_service cached property 2019-08-12 11:01:02 +02:00
pared 237f3e248b remote: base: modify cache_exists to use exists instead of batch_exists 2019-08-12 11:01:02 +02:00
pared 71abef74f5 remote: azure: implement batch_exists 2019-08-12 10:59:24 +02:00
Ruslan Kuprieiev a063f408a2 Merge pull request #2385 from efiop/azurite 
travis: use azurite v3
 2019-08-11 05:36:57 +03:00
Ruslan Kuprieiev 2f30bddfab travis: use azurite v3 
Trying to fix azure error on our ci:

https://travis-ci.com/iterative/dvc/jobs/224085273

Workaround for #2387

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-11 05:04:25 +03:00
Ruslan Kuprieiev 71ab380d03 utils: remove: catch EPERM when chmoding a file 
Fix https://github.com/iterative/dvc/pull/2298#issuecomment-520184196
 2019-08-11 03:00:08 +03:00
Ruslan Kuprieiev b2f452ef04 Merge pull request #2319 from mroutis/fix-1497 
metrics: allow multiple targets for show command
 2019-08-10 20:10:31 +03:00
Mr. Outis a17caefd50 integrate @efiop 's suggestions 2019-08-10 11:37:35 -05:00
Mr. Outis 163d872c92 fix tests for windows 2019-08-09 22:46:25 -05:00
Mr. Outis fa04c27580 add tests for recursive operations and file not found 2019-08-09 22:06:32 -05:00
Mr. Outis 0e46edd9bb fail silently but with a more sound error message 
* Add a `_missing` key to the return value of `repo.metrics.show` to
include targets not recognized as metrics or not found.
 2019-08-09 21:55:19 -05:00
Ruslan Kuprieiev 1b2823b5c5 Merge pull request #2384 from efiop/2361 
remote: base: call makedirs in move
 2019-08-10 05:30:16 +03:00
Ruslan Kuprieiev baa548eec9 remote: base: call makedirs in move 
Remotes like s3/gs/etc don't need to create dirs in advance.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-10 04:53:50 +03:00
Ruslan Kuprieiev e9b1e7797e Merge pull request #2383 from shcheklein/update-doc-links 
cli: update man links to the new scheme
 2019-08-10 04:46:59 +03:00
Ruslan Kuprieiev f5a4227554 Merge pull request #2376 from efiop/2361 
travis: speedup install time
 2019-08-10 04:44:35 +03:00
Ruslan Kuprieiev 919a49a231 travis: windows: cache chocolatey downloads 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-10 04:16:11 +03:00
Ruslan Kuprieiev eb3b3f9f4e travis: windows: skip install stage 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-10 04:15:22 +03:00
Ruslan Kuprieiev 3f19036646 travis: osx: speedup install stage 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-10 04:15:22 +03:00
Ivan Shcheklein 6ae13b5795 cli: update man links to the new scheme 2019-08-09 17:54:26 -07:00
Ruslan Kuprieiev 60bcd3dc13 Merge pull request #2371 from Suor/streaming 
api: make .open() stream data for Azure
 2019-08-09 18:42:40 +03:00
Ruslan Kuprieiev deb3372a66 Merge pull request #2298 from efiop/marcelo 
dvc: support `group` cache mode
 2019-08-09 18:34:05 +03:00
Alexander Schepanovski e5e29065c8 api: make .open() stream data for Azure 
This employs generating temporary signed public url and then streaming
from it. The bulk of the code might be reused for other remotes.

Url streaming does resume on connection error using "Range" header and
regenerates public url too.

If remote class doesn't provide .open() then this falls back to pulling
a file and opening it locally.
 2019-08-09 21:51:43 +07:00
Ruslan Kuprieiev 2b36d25f49 remote: base: remove unused argument 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 9955f1c64f utils: merge isinstance checks 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 640e737570 remote: base: remove unused argument 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 24428e47c3 remote: local: cache_exists: match parameters from the BASE 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 713e288adc remote: base: checkout: remove unnecessary return 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev b2fe3f7a71 utils: remove unnecessary else 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 9c5fd0c76c dvc: support group cache mode 
In this mode, dvc will set appropriate file/dir permissions to support
sharing cache between different users within the same group.

Fixes #2287

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 5aae88b316 local: don't try to protect file if it is already protected 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 16:46:24 +03:00
Ruslan Kuprieiev f8673e79c6 requirements: update ruamel.yaml 
Fixes #2334
 2019-08-08 14:26:35 +03:00
Mr. Outis d4ef110794 exit with 1 if targets were not found 2019-08-06 21:10:48 -05:00
Ruslan Kuprieiev 17700fc4e8 Merge pull request #2353 from GildedHonour/issue1874 
Fix #1874
 2019-08-06 18:46:21 +03:00
alex maslakoff b78843881a fix 'diff cmd message' test 2019-08-06 13:51:30 +04:00
Mr. OutisandRuslan Kuprieiev 21a2d3c6ff remove no-op 
Co-Authored-By: Ruslan Kuprieiev <[email protected]>
 2019-08-05 15:30:28 -05:00
Mr. Outis 44f1cc6200 bring back debug message 2019-08-05 15:27:17 -05:00
Ruslan Kuprieiev 8ae01de0eb metrics: allow multiple targets for show command 
Fix #1497
 2019-08-05 10:19:11 -05:00
Ruslan Kuprieiev e0e02a9f6b dvc: bump to 0.54.1 0.54.1 2019-08-05 14:53:13 +03:00
Ruslan Kuprieiev 5ea53747a9 Merge pull request #2370 from MaxRis/azure-dep-version-upgrade 
Update azure-storage-blob package (== 2.1.0)
 2019-08-05 14:14:38 +03:00
Max Risuhin 078a5c063f Update azure-storage-blob package (== 2.1.0) 2019-08-05 01:27:19 -07:00
Ruslan Kuprieiev ab6d8f9f6f Merge pull request #2351 from RahulR19/master 
Renamed git property to repo object in dvc/scm/git
 2019-08-04 21:53:25 +03:00