Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-07 15:28:28 +01:00
Code Issues Packages Projects Releases Wiki Activity
3,501 Commits 7 Branches 579 Tags
f88c2fe5fcd17ff12d1dc18c3cd4e8d26eb198f7
Commit Graph
846 Commits
Author SHA1 Message Date
Casper da Costa-Luis f88c2fe5fc remove old test 2019-08-14 00:19:44 +01:00
Casper da Costa-Luis 3f8caeccc4 Merge remote-tracking branch 'upstream/master' into tqdm 
major updates across dvc/remote/
 2019-08-13 23:29:59 +01:00
Casper da Costa-Luis ea8f4ba231 slight test update 2019-08-11 01:26:01 +01:00
Casper da Costa-Luis 120dfff05a naive test update 2019-08-11 01:21:50 +01:00
Casper da Costa-Luis ee4248df92 fix and update more tests 2019-08-11 01:17:42 +01:00
Casper da Costa-Luis d0315a3509 minor black, test fixes 2019-08-11 00:09:18 +01:00
Ruslan Kuprieiev b2f452ef04 Merge pull request #2319 from mroutis/fix-1497 
metrics: allow multiple targets for show command
 2019-08-10 20:10:31 +03:00
Casper da Costa-Luis 2ac99d87e5 update dvc.progress test stub 2019-08-10 17:18:12 +01:00
Casper da Costa-Luis 70ee31329f disable old progress 2019-08-10 14:15:16 +01:00
Mr. Outis 163d872c92 fix tests for windows 2019-08-09 22:46:25 -05:00
Mr. Outis fa04c27580 add tests for recursive operations and file not found 2019-08-09 22:06:32 -05:00
Mr. Outis 0e46edd9bb fail silently but with a more sound error message 
* Add a `_missing` key to the return value of `repo.metrics.show` to
include targets not recognized as metrics or not found.
 2019-08-09 21:55:19 -05:00
Ruslan Kuprieiev 60bcd3dc13 Merge pull request #2371 from Suor/streaming 
api: make .open() stream data for Azure
 2019-08-09 18:42:40 +03:00
Alexander Schepanovski e5e29065c8 api: make .open() stream data for Azure 
This employs generating temporary signed public url and then streaming
from it. The bulk of the code might be reused for other remotes.

Url streaming does resume on connection error using "Range" header and
regenerates public url too.

If remote class doesn't provide .open() then this falls back to pulling
a file and opening it locally.
 2019-08-09 21:51:43 +07:00
Ruslan Kuprieiev 9c5fd0c76c dvc: support group cache mode 
In this mode, dvc will set appropriate file/dir permissions to support
sharing cache between different users within the same group.

Fixes #2287

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-09 17:10:40 +03:00
Mr. Outis d4ef110794 exit with 1 if targets were not found 2019-08-06 21:10:48 -05:00
Ruslan Kuprieiev 17700fc4e8 Merge pull request #2353 from GildedHonour/issue1874 
Fix #1874
 2019-08-06 18:46:21 +03:00
alex maslakoff b78843881a fix 'diff cmd message' test 2019-08-06 13:51:30 +04:00
Ruslan Kuprieiev 8ae01de0eb metrics: allow multiple targets for show command 
Fix #1497
 2019-08-05 10:19:11 -05:00
Ruslan Kuprieiev ab6d8f9f6f Merge pull request #2351 from RahulR19/master 
Renamed git property to repo object in dvc/scm/git
 2019-08-04 21:53:25 +03:00
RahulR19 371c57ac24 Renamed git to repo in dvc/scm/git along with changes in some tests. 2019-08-04 23:26:45 +05:30
alex maslakoff 619f53a555 remove unused imports 2019-08-03 20:31:28 +03:00
alex maslakoff 10fa6eddb1 fix 2 tests 2019-08-03 20:25:07 +03:00
alex maslakoff 60359d8b98 merge 2 tests 2019-08-03 11:10:09 +03:00
alex maslakoff 81c8ed9da5 add a test for 'dir changes' 2019-08-02 16:09:10 +03:00
alex maslakoff 433a43e5f0 reformat 2019-08-02 00:26:41 +03:00
Ruslan Kuprieiev 1dea4030c8 Merge pull request #2331 from kurianbenoy/master 
remove show-checksums flag for dvc status commmand
 2019-08-01 20:58:24 +03:00
alex maslakoff 7347701145 add test for modified file content 2019-08-01 11:27:28 +03:00
kurianbenoy cba4c45bdb removed show-checksums for files pull, push, data_sync.py and from test files 2019-07-30 23:34:06 +05:30
Alexander Schepanovski 50b5b87304 dvc: batch push/pull/fetch/status 
This will speed up cache collection and then run single cloud op for all
collected cache.

Fixes #2308.
 2019-07-30 13:33:01 +03:00
Gunnlaugur Thor Briem e917ce0ae8 dvc: hooks only act in branches where dvc active (#2338) 
* dvc: hooks only act in branches where dvc active

In a branch where DVC hasn't been initialized (as detected by
`git ls-files .dvc` not listing any files), don't invoke dvc in the git hooks.
This avoids trouble when switching between branches with and without dvc
initialized.

Fixes #2208

* dvc: simplify hooks per PR comment
 2019-07-29 16:26:49 +03:00
Ruslan Kuprieiev 5e02a90e13 version: don't skip link info and skip if there is no psutil 
Fixes #2336

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-29 03:33:07 +03:00
pawel 7c52f65736 metric: show: xpath should override xpath set after run 2019-07-25 10:07:02 +02:00
Alexander Schepanovski 35a8d69c4f dvc: ignore Stage.meta in md5 calculations 
Meta change surely should not trigger a repro run. Closes #2209.
 2019-07-23 16:00:22 +03:00
Ruslan Kuprieiev ecb28a285c Merge pull request #2307 from efiop/2238 
import-url: lock by-default
 2019-07-23 01:44:04 +03:00
Ruslan Kuprieiev 641edacef6 import-url: lock by-default 
Fixes #2238

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-22 20:24:00 +03:00
Alexander Schepanovski 6afc2a38ba test: close pools on tests cleanup 
This avoids weird errors as pools are collected by gc in broken env.
 2019-07-21 13:40:29 +07:00
Ruslan Kuprieiev b6bc65fcbf Merge pull request #2302 from shcheklein/fix-2259 
url info: fix infinite recustion on deepcopy
 2019-07-21 04:32:30 +03:00
Ivan Shcheklein 164c2e8dc1 url info: fix infinite recustion on deepcopy 2019-07-20 15:26:00 -07:00
Jorge Orpinel c7ef6592fe output: remove a couple more "(s)" left 
Per https://github.com/iterative/dvc/pull/2281#issuecomment-513053199
 2019-07-20 13:44:36 -06:00
Ruslan Kuprieiev 68bebe7944 remote: hdfs: use pyarrow and connection pool 
Related to #1629

Speeds up HDFS tests significantly. E.g. ExternalHDFS test goes from 600
sec to 190sec. test_open_external[HDFS] from 160sec to 3sec.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-20 01:12:17 +03:00
Ruslan Kuprieiev 958a4fbd3c tests: s3: use moto for multipart test 
Fixes #1889

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-18 20:51:49 +03:00
Ruslan Kuprieiev 6598b88b77 Merge pull request #2290 from pared/2221 
data_cloud: remove backward compatibilty on get_remote
 2019-07-18 14:10:50 +03:00
pared e39be6d1aa data_cloud: remove compat methods and tests 2019-07-18 10:29:40 +02:00
Alexander Schepanovski ed387d824d remote: do not swallow exceptions by ssh pool 2019-07-17 22:20:43 +07:00
Georgy Dyuldin 840318dd22 git: Fix submodule names issue (#2274) 
GitPython creates submodules nodes during tree iterate without explicit
passing name attribute. This path replaces such submodules with new
instances with filled name attribute.

Fixes: #1898
 2019-07-16 16:38:42 +03:00
Alexander Schepanovski db19957b8a Download refactor (#2275) 
* remote: drop not working http resume

Closes #2136

* remote: drop @transfer_context()

It is not needed for ssh anymore and GS/S3 are switched to client
instances in cached properties.

* remote: drop upload/download chunking
 2019-07-16 16:27:44 +03:00
Ruslan Kuprieiev e215364e6d test: http: use random port (#2269) 
Fixes #1878

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-15 13:18:10 +03:00
Ruslan Kuprieiev 10121411e0 import: don't forget to add outs to gitignore (#2266) 
Fixes #2263

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-14 21:35:23 +03:00
Ruslan Kuprieiev 94fe86afe8 tests: import-url: rewrite and move error msg test (#2262) 
This one was failing randomly.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-14 03:09:08 +03:00