Commit Graph
3403 Commits
Author SHA1 Message Date
Alexander Schepanovski e5e29065c8 api: make .open() stream data for Azure
This employs generating temporary signed public url and then streaming
from it. The bulk of the code might be reused for other remotes.

Url streaming does resume on connection error using "Range" header and
regenerates public url too.

If remote class doesn't provide .open() then this falls back to pulling
a file and opening it locally.
2019-08-09 21:51:43 +07:00
Ruslan Kuprieiev e0e02a9f6b dvc: bump to 0.54.1 0.54.1 2019-08-05 14:53:13 +03:00
Ruslan Kuprieiev 5ea53747a9 Merge pull request #2370 from MaxRis/azure-dep-version-upgrade
Update azure-storage-blob package (== 2.1.0)
2019-08-05 14:14:38 +03:00
Max Risuhin 078a5c063f Update azure-storage-blob package (== 2.1.0) 2019-08-05 01:27:19 -07:00
Ruslan Kuprieiev ab6d8f9f6f Merge pull request #2351 from RahulR19/master
Renamed git property to repo object in dvc/scm/git
2019-08-04 21:53:25 +03:00
RahulR19 371c57ac24 Renamed git to repo in dvc/scm/git along with changes in some tests. 2019-08-04 23:26:45 +05:30
Ruslan Kuprieiev 83ca54bc85 Merge pull request #2366 from SRITANU/issue_2253
dvc: Changes url description in get.py and imp.py
2019-08-04 04:31:11 +03:00
Sritanu Chakraborty ffa0c1caeb dvc: Changes url description in get.py and imp.py
Fixes #2253
2019-08-04 06:12:47 +05:30
Combalgorythm 353a32beb4 dvc:Changes UP_TO_DATE_MSG in status.py (#2364)
Fixes #2346
2019-08-03 18:55:25 +03:00
Ruslan Kuprieiev b4be9e8b78 Merge pull request #2343 from pared/2285_2
metrics show: extend NOTEs for show
2019-08-02 03:31:03 +03:00
Ruslan Kuprieiev c52e1aa5cc dvc: bump to 0.54.0 0.54.0 2019-08-01 23:35:21 +03:00
Ruslan Kuprieiev 4626fd7503 Merge pull request #2355 from efiop/2354
reproduce: properly handle --single-item case
2019-08-01 23:34:44 +03:00
Ruslan Kuprieiev 4dd221dab9 reproduce: properly handle --single-item case
Fix #2354

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-08-01 22:36:47 +03:00
Ruslan Kuprieiev cd1a616624 travis: osx: retry brew cask install
It is failing randomly.
2019-08-01 21:00:19 +03:00
Ruslan Kuprieiev 1dea4030c8 Merge pull request #2331 from kurianbenoy/master
remove show-checksums flag for dvc status commmand
2019-08-01 20:58:24 +03:00
Ruslan Kuprieiev 9f173fa174 Merge pull request #2342 from Suor/mass-ops
dvc: batch push/pull/fetch/status
2019-08-01 20:57:31 +03:00
Kurian BenoyandRuslan Kuprieiev ea5c798088 Update dvc/repo/status.py
Co-Authored-By: Ruslan Kuprieiev <[email protected]>
2019-08-01 20:28:15 +05:30
pared 394b871452 metrics show: extend NOTEs for show 2019-08-01 11:40:02 +02:00
Ruslan Kuprieiev b1f38d8e72 Merge pull request #2348 from iterative/efiop-patch-1
readme: add note about installing with conda
2019-08-01 00:22:48 +03:00
Ruslan Kuprieiev 0e056fc81e Merge pull request #2350 from efiop/2347
travis: osx: retry brew update
2019-07-31 22:29:52 +03:00
Ruslan Kuprieiev 56b162d2d0 readme: fixed formatting 2019-07-31 21:09:46 +03:00
Ruslan Kuprieiev 3bdcaba39f travis: osx: retry brew update
Fixes #2347

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-07-31 20:49:08 +03:00
Ruslan Kuprieiev 79052ddd5c readme: fix message about the number of install options
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-07-31 20:37:30 +03:00
RahulR19 79557ffb3c Renamed git property to repo object in dvc/scm/git 2019-07-31 21:56:53 +05:30
kurianbenoy 1f27e66133 refactor status_info as values in for better performance 2019-07-31 21:03:39 +05:30
Ruslan Kuprieiev c7d4fb05af readme: add note about installing with conda 2019-07-31 17:18:46 +03:00
kurianbenoy cba4c45bdb removed show-checksums for files pull, push, data_sync.py and from test files 2019-07-30 23:34:06 +05:30
Alexander Schepanovski 50b5b87304 dvc: batch push/pull/fetch/status
This will speed up cache collection and then run single cloud op for all
collected cache.

Fixes #2308.
2019-07-30 13:33:01 +03:00
Ruslan Kuprieiev c5c248c098 Merge pull request #2323 from pared/2135
get: use StateBase
2019-07-29 17:34:50 +03:00
Gunnlaugur Thor Briem e917ce0ae8 dvc: hooks only act in branches where dvc active (#2338)
* dvc: hooks only act in branches where dvc active

In a branch where DVC hasn't been initialized (as detected by
`git ls-files .dvc` not listing any files), don't invoke dvc in the git hooks.
This avoids trouble when switching between branches with and without dvc
initialized.

Fixes #2208

* dvc: simplify hooks per PR comment
2019-07-29 16:26:49 +03:00
pared 40c2c48573 get: use StateBase 2019-07-29 14:40:14 +02:00
Ruslan Kuprieiev df0359fad0 Merge pull request #2337 from efiop/2336
version: don't skip link info and skip if there is no psutil
2019-07-29 04:28:31 +03:00
Ruslan Kuprieiev 5e02a90e13 version: don't skip link info and skip if there is no psutil
Fixes #2336

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-07-29 03:33:07 +03:00
Ruslan Kuprieiev 32425e9069 dvc: bump to 0.53.2 0.53.2 2019-07-29 00:55:05 +03:00
Alex JozandRuslan Kuprieiev 2500ce64a6 Restrict ruamel.yaml version due import error (#2335)
* restrict ruamel.yaml version due import error

* Update setup.py

Co-Authored-By: Ruslan Kuprieiev <[email protected]>
2019-07-29 00:49:29 +03:00
Ruslan Kuprieiev 386793ae14 Merge pull request #2317 from mroutis/fix-1475
scm: reset tracked files after every operation
2019-07-28 02:39:47 +03:00
kurianbenoy 7059ccb851 update completion scripts and remove show_checksums from status 2019-07-28 04:56:46 +05:30
Mr. OutisandRuslan Kuprieiev dc5dd1e443 change set.update to set.add
created a set with `{}` but resulted in a dictionary, making me think about `set` not supporting the `add` method.

Thanks for the correction, @efiop !

Co-Authored-By: Ruslan Kuprieiev <[email protected]>
2019-07-27 17:44:45 -05:00
Mr. Outis 405dfde23f use set instead of list for deduplication 2019-07-27 16:34:22 -05:00
kurianbenoy 2930ea7136 remove show-checksums flag for dvc status commmand 2019-07-28 02:37:44 +05:30
Ruslan Kuprieiev a4aef6751e Merge pull request #2304 from pared/2285
metric: show: xpath should override stage file xpath
2019-07-25 18:43:29 +03:00
pared f5e0024137 metrics: show: add comment clarifying metric type and xpath usage 2019-07-25 16:33:49 +02:00
pawel 7c52f65736 metric: show: xpath should override xpath set after run 2019-07-25 10:07:02 +02:00
Ruslan Kuprieiev 7fea91387e dvc: bump to 0.53.1 0.53.1 2019-07-25 03:49:29 +03:00
Ruslan Kuprieiev 25a782e538 Merge pull request #2320 from efiop/2284
version: temporarily make psutil optional
2019-07-25 03:48:44 +03:00
Ruslan Kuprieiev 4a4ddf078c version: temporarily make psutil optional
Workaround for https://github.com/iterative/dvc/issues/2284

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2019-07-25 01:52:11 +03:00
Ruslan Kuprieiev 590c2dcbfc Merge pull request #2293 from pared/2258
remote: base: try to retrieve path_info checksum from database upon dir checksum calculation
2019-07-24 16:43:50 +03:00
Mr. Outis 9ca5452603 scm: reset tracked files after every operation
Fix #1475
2019-07-23 15:10:48 -05:00
Ruslan Kuprieiev 507879e841 Merge pull request #2315 from Suor/ask
ssh: do not ask for same password repeatedly
2019-07-23 19:54:08 +03:00
Ruslan Kuprieiev 12461cf356 Merge pull request #2314 from Suor/meta-md5
dvc: ignore Stage.meta in md5 calculations plus some polish
2019-07-23 19:53:23 +03:00