Commit Graph
3461 Commits
Author SHA1 Message Date
Casper da Costa-Luis 7665782d93 fix more callback usage 2019-08-11 01:40:22 +01:00
Casper da Costa-Luis ea8f4ba231 slight test update 2019-08-11 01:26:01 +01:00
Casper da Costa-Luis 120dfff05a naive test update 2019-08-11 01:21:50 +01:00
Casper da Costa-Luis ee4248df92 fix and update more tests 2019-08-11 01:17:42 +01:00
Casper da Costa-Luis d0315a3509 minor black, test fixes 2019-08-11 00:09:18 +01:00
Casper da Costa-Luis 2f42db0eaa fix base progress_callback 2019-08-11 00:01:40 +01:00
Casper da Costa-Luis 1925d6338b fix silly error 2019-08-10 17:18:12 +01:00
Casper da Costa-Luis 2ac99d87e5 update dvc.progress test stub 2019-08-10 17:18:12 +01:00
Casper da Costa-Luis 56db2ee5fe misc minor restructuring 2019-08-10 14:54:51 +01:00
Casper da Costa-Luis f88bf9218a tqdm auto-disabling with dynamic log level 2019-08-10 14:41:08 +01:00
Casper da Costa-Luis 9143f67ee0 black 2019-08-10 14:20:58 +01:00
Casper da Costa-Luis aed3451df9 pylint 2019-08-10 14:19:38 +01:00
Casper da Costa-Luis ca68eb4a4b add progress.Tqdm.update_desc(truncate=True) 2019-08-10 14:19:38 +01:00
Casper da Costa-Luis c02807deb3 tqdm remote.oss 2019-08-10 14:19:38 +01:00
Casper da Costa-Luis d6f816bc48 remove old progress
- progress.Progress
- progress.ProgressCallback
- progress.progress
2019-08-10 14:19:38 +01:00
Casper da Costa-Luis 82bb550e7d tqdm dvc.utils 2019-08-10 14:19:38 +01:00
Casper da Costa-Luis efd8a070ff tqdm remote.local 2019-08-10 14:19:38 +01:00
Casper da Costa-Luis bac3d9343b tqdm remote.ssh.connection 2019-08-10 14:17:49 +01:00
Casper da Costa-Luis 85d4f7ebb2 add progress.Tqdm(desc_truncate) 2019-08-10 14:17:49 +01:00
Casper da Costa-Luis f61e7d86a9 tqdm remote.azure 2019-08-10 14:17:49 +01:00
Casper da Costa-Luis d460d7e668 tqdm remote.s3, flake8 2019-08-10 14:15:16 +01:00
Casper da Costa-Luis 3f0b85cf15 add progress.Tqdm(truncate) 2019-08-10 14:15:16 +01:00
Casper da Costa-Luis 6aee6b6b16 add progress.Tqdm(bytes) 2019-08-10 14:15:16 +01:00
Casper da Costa-Luis 62cbeed8b3 tqdm remote.http 2019-08-10 14:15:16 +01:00
Casper da Costa-Luis cc281551eb tqdm repo.checkout 2019-08-10 14:15:16 +01:00
Casper da Costa-Luis c4b9d7dba7 minor bugfix 2019-08-10 14:15:16 +01:00
Casper da Costa-Luis 70ee31329f disable old progress 2019-08-10 14:15:16 +01:00
Casper da Costa-Luis 0ebce9c1e1 create dvc.progress.Tqdm, migrate dvc.remote.base 2019-08-10 14:15:16 +01:00
Casper da Costa-Luis 1511fd6dcc add preliminary tqdm work 2019-08-10 14:11:02 +01:00
Ruslan Kuprieiev 1b2823b5c5 Merge pull request #2384 from efiop/2361
remote: base: call makedirs in move
2019-08-10 05:30:16 +03:00
Ruslan Kuprieiev baa548eec9 remote: base: call makedirs in move
Remotes like s3/gs/etc don't need to create dirs in advance.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-08-10 04:53:50 +03:00
Ruslan Kuprieiev e9b1e7797e Merge pull request #2383 from shcheklein/update-doc-links
cli: update man links to the new scheme
2019-08-10 04:46:59 +03:00
Ruslan Kuprieiev f5a4227554 Merge pull request #2376 from efiop/2361
travis: speedup install time
2019-08-10 04:44:35 +03:00
Ruslan Kuprieiev 919a49a231 travis: windows: cache chocolatey downloads
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-08-10 04:16:11 +03:00
Ruslan Kuprieiev eb3b3f9f4e travis: windows: skip install stage
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-08-10 04:15:22 +03:00
Ruslan Kuprieiev 3f19036646 travis: osx: speedup install stage
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-08-10 04:15:22 +03:00
Ivan Shcheklein 6ae13b5795 cli: update man links to the new scheme 2019-08-09 17:54:26 -07:00
Ruslan Kuprieiev 60bcd3dc13 Merge pull request #2371 from Suor/streaming
api: make .open() stream data for Azure
2019-08-09 18:42:40 +03:00
Ruslan Kuprieiev deb3372a66 Merge pull request #2298 from efiop/marcelo
dvc: support `group` cache mode
2019-08-09 18:34:05 +03:00
Alexander Schepanovski e5e29065c8 api: make .open() stream data for Azure
This employs generating temporary signed public url and then streaming
from it. The bulk of the code might be reused for other remotes.

Url streaming does resume on connection error using "Range" header and
regenerates public url too.

If remote class doesn't provide .open() then this falls back to pulling
a file and opening it locally.
2019-08-09 21:51:43 +07:00
Ruslan Kuprieiev 2b36d25f49 remote: base: remove unused argument
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 9955f1c64f utils: merge isinstance checks
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 640e737570 remote: base: remove unused argument
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 24428e47c3 remote: local: cache_exists: match parameters from the BASE
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 713e288adc remote: base: checkout: remove unnecessary return
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev b2fe3f7a71 utils: remove unnecessary else
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 9c5fd0c76c dvc: support group cache mode
In this mode, dvc will set appropriate file/dir permissions to support
sharing cache between different users within the same group.

Fixes #2287

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-08-09 17:10:40 +03:00
Ruslan Kuprieiev 5aae88b316 local: don't try to protect file if it is already protected
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-08-09 16:46:24 +03:00
Ruslan Kuprieiev f8673e79c6 requirements: update ruamel.yaml
Fixes #2334
2019-08-08 14:26:35 +03:00
Ruslan Kuprieiev 17700fc4e8 Merge pull request #2353 from GildedHonour/issue1874
Fix #1874
2019-08-06 18:46:21 +03:00