Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-02 07:18:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
3,465 Commits 7 Branches 579 Tags
5a9dfbb6a4c6c41768abe53f0e6538bf32b4efa2
Commit Graph
3465 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ruslan Kuprieiev 5a9dfbb6a4 config: use new remote url 2019-08-19 09:43:24 +03:00
Ruslan Kuprieiev 5b7cdd6bbf Merge pull request #2405 from efiop/master 
dvc: remove unused code
 2019-08-18 05:56:16 +03:00
Ruslan Kuprieiev 5915f17fcf output: base: remove unnecessary 'else' 
Reported by DeepSource.
 2019-08-18 05:15:08 +03:00
Ruslan Kuprieiev 875186d5a6 dvc: remove unused code 
A bunch of leftovers from a very old pkg implementation.
 2019-08-18 05:09:30 +03:00
Ruslan Kuprieiev d32515c969 Merge pull request #2393 from Suor/stream-more 
api: stream api.open() for local, SSH and HDFS
 2019-08-15 22:33:55 +03:00
Alexander Schepanovski 85289ad00b api: wrap not found errors 
api.open()/read() will now raise OutputFileMissingError and
Remote*.open() will raise FileNotFoundError if target file is absent.
 2019-08-15 23:20:48 +07:00
Ruslan Kuprieiev e1f676a191 dvc: bump to 0.55.0 0.55.0 2019-08-15 14:06:58 +03:00
Ruslan Kuprieiev 5e4d26691a version: fix typo 2019-08-14 00:34:12 +03:00
Alexander Schepanovski 60a983b63f api: stream api.open() for local, SSH and HDFS 2019-08-13 18:19:52 +07:00
Ruslan Kuprieiev 7c19e9e4bf Merge pull request #2389 from Suor/streaming-clouds 
api: stream data in api.open() for S3, GS and OSS
 2019-08-13 11:30:41 +03:00
Alexander Schepanovski 641eb57b27 api: stream data in api.open() for S3, GS and OSS 
Employ the same sign url and use resumable download approach tested for
Azure.
 2019-08-13 14:09:51 +07:00
Ruslan Kuprieiev 3095b24ed4 Merge pull request #2375 from pared/2373 
remote: gs/s3: remove batch_exists
 2019-08-13 02:56:04 +03:00
Ruslan Kuprieiev 06d347178f remote: base: remove whitespace 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-13 02:25:15 +03:00
Ruslan Kuprieiev c308ad8a58 remote: base: don't forget about the progress bar 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-13 02:08:29 +03:00
pawel 8233f959c7 remote: ssh: reintroduce batch_exists 2019-08-12 14:10:16 +02:00
pawel f224790aab remote: base: remove unnecessary list casting 2019-08-12 11:01:02 +02:00
pared 394d6ffeeb remote: ssh: connection: remove open_max_sftp_channels 2019-08-12 11:01:02 +02:00
pared 132b571e72 remote: oss: fix _list_cache_args 2019-08-12 11:01:02 +02:00
pared 98de99f5a9 remote: azure: make blob_service cached property 2019-08-12 11:01:02 +02:00
pared 237f3e248b remote: base: modify cache_exists to use exists instead of batch_exists 2019-08-12 11:01:02 +02:00
pared 71abef74f5 remote: azure: implement batch_exists 2019-08-12 10:59:24 +02:00
Ruslan Kuprieiev a063f408a2 Merge pull request #2385 from efiop/azurite 
travis: use azurite v3
 2019-08-11 05:36:57 +03:00
Ruslan Kuprieiev 2f30bddfab travis: use azurite v3 
Trying to fix azure error on our ci:

https://travis-ci.com/iterative/dvc/jobs/224085273

Workaround for #2387

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-11 05:04:25 +03:00
Ruslan Kuprieiev 71ab380d03 utils: remove: catch EPERM when chmoding a file 
Fix https://github.com/iterative/dvc/pull/2298#issuecomment-520184196
 2019-08-11 03:00:08 +03:00
Ruslan Kuprieiev b2f452ef04 Merge pull request #2319 from mroutis/fix-1497 
metrics: allow multiple targets for show command
 2019-08-10 20:10:31 +03:00
Mr. Outis a17caefd50 integrate @efiop 's suggestions 2019-08-10 11:37:35 -05:00
Mr. Outis 163d872c92 fix tests for windows 2019-08-09 22:46:25 -05:00
Mr. Outis fa04c27580 add tests for recursive operations and file not found 2019-08-09 22:06:32 -05:00
Mr. Outis 0e46edd9bb fail silently but with a more sound error message 
* Add a `_missing` key to the return value of `repo.metrics.show` to
include targets not recognized as metrics or not found.
 2019-08-09 21:55:19 -05:00
Ruslan Kuprieiev 1b2823b5c5 Merge pull request #2384 from efiop/2361 
remote: base: call makedirs in move
 2019-08-10 05:30:16 +03:00
Ruslan Kuprieiev baa548eec9 remote: base: call makedirs in move 
Remotes like s3/gs/etc don't need to create dirs in advance.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-10 04:53:50 +03:00
Ruslan Kuprieiev e9b1e7797e Merge pull request #2383 from shcheklein/update-doc-links 
cli: update man links to the new scheme
 2019-08-10 04:46:59 +03:00
Ruslan Kuprieiev f5a4227554 Merge pull request #2376 from efiop/2361 
travis: speedup install time
 2019-08-10 04:44:35 +03:00
Ruslan Kuprieiev 919a49a231 travis: windows: cache chocolatey downloads 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-10 04:16:11 +03:00
Ruslan Kuprieiev eb3b3f9f4e travis: windows: skip install stage 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-10 04:15:22 +03:00
Ruslan Kuprieiev 3f19036646 travis: osx: speedup install stage 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-10 04:15:22 +03:00
Ivan Shcheklein 6ae13b5795 cli: update man links to the new scheme 2019-08-09 17:54:26 -07:00
Ruslan Kuprieiev 60bcd3dc13 Merge pull request #2371 from Suor/streaming 
api: make .open() stream data for Azure
 2019-08-09 18:42:40 +03:00
Ruslan Kuprieiev deb3372a66 Merge pull request #2298 from efiop/marcelo 
dvc: support `group` cache mode
 2019-08-09 18:34:05 +03:00
Alexander Schepanovski e5e29065c8 api: make .open() stream data for Azure 
This employs generating temporary signed public url and then streaming
from it. The bulk of the code might be reused for other remotes.

Url streaming does resume on connection error using "Range" header and
regenerates public url too.

If remote class doesn't provide .open() then this falls back to pulling
a file and opening it locally.
 2019-08-09 21:51:43 +07:00
Ruslan Kuprieiev 2b36d25f49 remote: base: remove unused argument 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 9955f1c64f utils: merge isinstance checks 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 640e737570 remote: base: remove unused argument 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 24428e47c3 remote: local: cache_exists: match parameters from the BASE 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 713e288adc remote: base: checkout: remove unnecessary return 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev b2fe3f7a71 utils: remove unnecessary else 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 9c5fd0c76c dvc: support group cache mode 
In this mode, dvc will set appropriate file/dir permissions to support
sharing cache between different users within the same group.

Fixes #2287

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 5aae88b316 local: don't try to protect file if it is already protected 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 16:46:24 +03:00
Ruslan Kuprieiev f8673e79c6 requirements: update ruamel.yaml 
Fixes #2334
 2019-08-08 14:26:35 +03:00
Mr. Outis d4ef110794 exit with 1 if targets were not found 2019-08-06 21:10:48 -05:00