Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-02 07:18:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
3,465 Commits 7 Branches 579 Tags
5a9dfbb6a4c6c41768abe53f0e6538bf32b4efa2
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ruslan Kuprieiev 5a9dfbb6a4 config: use new remote url 2019-08-19 09:43:24 +03:00
Ruslan Kuprieiev 5b7cdd6bbf Merge pull request #2405 from efiop/master 
dvc: remove unused code
 2019-08-18 05:56:16 +03:00
Ruslan Kuprieiev 5915f17fcf output: base: remove unnecessary 'else' 
Reported by DeepSource.
 2019-08-18 05:15:08 +03:00
Ruslan Kuprieiev 875186d5a6 dvc: remove unused code 
A bunch of leftovers from a very old pkg implementation.
 2019-08-18 05:09:30 +03:00
Ruslan Kuprieiev d32515c969 Merge pull request #2393 from Suor/stream-more 
api: stream api.open() for local, SSH and HDFS
 2019-08-15 22:33:55 +03:00
Ruslan Kuprieiev e1f676a191 dvc: bump to 0.55.0 2019-08-15 14:06:58 +03:00
Ruslan Kuprieiev 5e4d26691a version: fix typo 2019-08-14 00:34:12 +03:00
Ruslan Kuprieiev 7c19e9e4bf Merge pull request #2389 from Suor/streaming-clouds 
api: stream data in api.open() for S3, GS and OSS
 2019-08-13 11:30:41 +03:00
Ruslan Kuprieiev 3095b24ed4 Merge pull request #2375 from pared/2373 
remote: gs/s3: remove batch_exists
 2019-08-13 02:56:04 +03:00
Ruslan Kuprieiev a063f408a2 Merge pull request #2385 from efiop/azurite 
travis: use azurite v3
 2019-08-11 05:36:57 +03:00
Ruslan Kuprieiev 2f30bddfab travis: use azurite v3 
Trying to fix azure error on our ci:

https://travis-ci.com/iterative/dvc/jobs/224085273

Workaround for #2387

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-11 05:04:25 +03:00
Ruslan Kuprieiev 71ab380d03 utils: remove: catch EPERM when chmoding a file 
Fix https://github.com/iterative/dvc/pull/2298#issuecomment-520184196
 2019-08-11 03:00:08 +03:00
Ruslan Kuprieiev b2f452ef04 Merge pull request #2319 from mroutis/fix-1497 
metrics: allow multiple targets for show command
 2019-08-10 20:10:31 +03:00
Ruslan Kuprieiev 1b2823b5c5 Merge pull request #2384 from efiop/2361 
remote: base: call makedirs in move
 2019-08-10 05:30:16 +03:00
Ruslan Kuprieiev e9b1e7797e Merge pull request #2383 from shcheklein/update-doc-links 
cli: update man links to the new scheme
 2019-08-10 04:46:59 +03:00
Ruslan Kuprieiev f5a4227554 Merge pull request #2376 from efiop/2361 
travis: speedup install time
 2019-08-10 04:44:35 +03:00
Ruslan Kuprieiev 60bcd3dc13 Merge pull request #2371 from Suor/streaming 
api: make .open() stream data for Azure
 2019-08-09 18:42:40 +03:00
Ruslan Kuprieiev deb3372a66 Merge pull request #2298 from efiop/marcelo 
dvc: support `group` cache mode
 2019-08-09 18:34:05 +03:00
Ruslan Kuprieiev f8673e79c6 requirements: update ruamel.yaml 
Fixes #2334
 2019-08-08 14:26:35 +03:00
Ruslan Kuprieiev 17700fc4e8 Merge pull request #2353 from GildedHonour/issue1874 
Fix #1874
 2019-08-06 18:46:21 +03:00
Ruslan Kuprieiev 8ae01de0eb metrics: allow multiple targets for show command 
Fix #1497
 2019-08-05 10:19:11 -05:00
Ruslan Kuprieiev e0e02a9f6b dvc: bump to 0.54.1 2019-08-05 14:53:13 +03:00
Ruslan Kuprieiev 5ea53747a9 Merge pull request #2370 from MaxRis/azure-dep-version-upgrade 
Update azure-storage-blob package (== 2.1.0)
 2019-08-05 14:14:38 +03:00
Ruslan Kuprieiev ab6d8f9f6f Merge pull request #2351 from RahulR19/master 
Renamed git property to repo object in dvc/scm/git
 2019-08-04 21:53:25 +03:00
Ruslan Kuprieiev 83ca54bc85 Merge pull request #2366 from SRITANU/issue_2253 
dvc: Changes url description in get.py and imp.py
 2019-08-04 04:31:11 +03:00
Ruslan Kuprieiev b4be9e8b78 Merge pull request #2343 from pared/2285_2 
metrics show: extend NOTEs for show
 2019-08-02 03:31:03 +03:00
Ruslan Kuprieiev c52e1aa5cc dvc: bump to 0.54.0 2019-08-01 23:35:21 +03:00
Ruslan Kuprieiev 4626fd7503 Merge pull request #2355 from efiop/2354 
reproduce: properly handle --single-item case
 2019-08-01 23:34:44 +03:00
Ruslan Kuprieiev cd1a616624 travis: osx: retry brew cask install 
It is failing randomly.
 2019-08-01 21:00:19 +03:00
Ruslan Kuprieiev 1dea4030c8 Merge pull request #2331 from kurianbenoy/master 
remove show-checksums flag for dvc status commmand
 2019-08-01 20:58:24 +03:00
Ruslan Kuprieiev 9f173fa174 Merge pull request #2342 from Suor/mass-ops 
dvc: batch push/pull/fetch/status
 2019-08-01 20:57:31 +03:00
Ruslan Kuprieiev b1f38d8e72 Merge pull request #2348 from iterative/efiop-patch-1 
readme: add note about installing with conda
 2019-08-01 00:22:48 +03:00
Ruslan Kuprieiev 0e056fc81e Merge pull request #2350 from efiop/2347 
travis: osx: retry brew update
 2019-07-31 22:29:52 +03:00
Ruslan Kuprieiev c7d4fb05af readme: add note about installing with conda 2019-07-31 17:18:46 +03:00
Ruslan Kuprieiev c5c248c098 Merge pull request #2323 from pared/2135 
get: use StateBase
 2019-07-29 17:34:50 +03:00
Ruslan Kuprieiev df0359fad0 Merge pull request #2337 from efiop/2336 
version: don't skip link info and skip if there is no psutil
 2019-07-29 04:28:31 +03:00
Ruslan Kuprieiev 32425e9069 dvc: bump to 0.53.2 2019-07-29 00:55:05 +03:00
Ruslan Kuprieiev 386793ae14 Merge pull request #2317 from mroutis/fix-1475 
scm: reset tracked files after every operation
 2019-07-28 02:39:47 +03:00
Ruslan Kuprieiev a4aef6751e Merge pull request #2304 from pared/2285 
metric: show: xpath should override stage file xpath
 2019-07-25 18:43:29 +03:00
Ruslan Kuprieiev 7fea91387e dvc: bump to 0.53.1 2019-07-25 03:49:29 +03:00
Ruslan Kuprieiev 25a782e538 Merge pull request #2320 from efiop/2284 
version: temporarily make psutil optional
 2019-07-25 03:48:44 +03:00
Ruslan Kuprieiev 590c2dcbfc Merge pull request #2293 from pared/2258 
remote: base: try to retrieve path_info checksum from database upon dir checksum calculation
 2019-07-24 16:43:50 +03:00
Ruslan Kuprieiev 507879e841 Merge pull request #2315 from Suor/ask 
ssh: do not ask for same password repeatedly
 2019-07-23 19:54:08 +03:00
Ruslan Kuprieiev 12461cf356 Merge pull request #2314 from Suor/meta-md5 
dvc: ignore Stage.meta in md5 calculations plus some polish
 2019-07-23 19:53:23 +03:00
Ruslan Kuprieiev 6b84dbb985 Merge pull request #2303 from Suor/push-jobs 
remote: fixed Repo.push() to default to 1 job
 2019-07-23 14:44:54 +03:00
Ruslan Kuprieiev 93f0062482 setup: freeze pyarrow version 2019-07-23 14:27:51 +03:00
Ruslan Kuprieiev f346300a13 cache: don't forget about -q and -v options 
https://github.com/iterative/dvc/issues/1924#issuecomment-496755449
 2019-07-23 03:13:02 +03:00
Ruslan Kuprieiev ecb28a285c Merge pull request #2307 from efiop/2238 
import-url: lock by-default
 2019-07-23 01:44:04 +03:00
Ruslan Kuprieiev ffc828df6f dvc: bump to 0.53.0 2019-07-23 01:38:37 +03:00
Ruslan Kuprieiev 33511902c3 Merge pull request #2306 from efiop/2252 
import: only download specific output
 2019-07-22 15:55:16 +03:00
Ruslan Kuprieiev a1143c532c Merge pull request #2289 from Suor/exists-jobs 
remote: honor --jobs for status collection and other fixes
 2019-07-21 19:24:30 +03:00
Ruslan Kuprieiev b6bc65fcbf Merge pull request #2302 from shcheklein/fix-2259 
url info: fix infinite recustion on deepcopy
 2019-07-21 04:32:30 +03:00
Ruslan Kuprieiev bd13d6f9d6 Merge pull request #2299 from jorgeorpinel/master 
output: remove a couple more "(s)" left
 2019-07-21 02:17:42 +03:00
Ruslan Kuprieiev df28309403 Merge pull request #2300 from efiop/moto 
tests: use moto pre-release
 2019-07-20 17:12:38 +03:00
Ruslan Kuprieiev c2d25f455f travis: hadoop: fix typo 2019-07-20 03:00:39 +03:00
Ruslan Kuprieiev 3ccb80466a travis: hadoop: add openjdk-7 ppa 2019-07-20 02:45:38 +03:00
Ruslan Kuprieiev a4e461fc02 travis: hadoop: use openjdk-7 2019-07-20 02:32:49 +03:00
Ruslan Kuprieiev 3becd5c20b Merge pull request #2297 from efiop/hdfs 
remote: hdfs: use pyarrow and connection pool
 2019-07-20 02:14:56 +03:00
Ruslan Kuprieiev 1e9f1d0619 Merge pull request #2281 from jorgeorpinel/master 
help: finish pluralizing "the pipeline" term in output
 2019-07-19 12:55:10 +03:00
Ruslan Kuprieiev 993b1df8ef Merge pull request #2282 from efiop/moto 
tests: s3: use moto for multipart test
 2019-07-18 23:09:50 +03:00
Ruslan Kuprieiev 958a4fbd3c tests: s3: use moto for multipart test 
Fixes #1889

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-18 20:51:49 +03:00
Ruslan Kuprieiev 36c07b8abe Merge pull request #2278 from Suor/ssh-md5-jobs 
remote: speed up ssh dir checksum
 2019-07-18 19:28:23 +03:00
Ruslan Kuprieiev 432373fb42 stage: properly quote command in exception 2019-07-18 16:10:38 +03:00
Ruslan Kuprieiev 6598b88b77 Merge pull request #2290 from pared/2221 
data_cloud: remove backward compatibilty on get_remote
 2019-07-18 14:10:50 +03:00
Ruslan Kuprieiev 598ef02558 Merge pull request #2277 from pared/1900 
reproduce: use kwargs instead of explicit arguments
 2019-07-18 13:57:15 +03:00
Ruslan Kuprieiev 9b37c6b021 Merge pull request #2288 from Suor/pool-fixes 
remote: pool fixes
 2019-07-17 19:56:04 +03:00
Ruslan Kuprieiev fc5d3c182c dvc: bump to 0.52.1 2019-07-15 20:33:54 +03:00
Ruslan Kuprieiev a59fdfdd35 stage: don't ignore SIGINT in the child (#2271) 
Signal mask is inherited by the child, so when we set it up before
Popen, our child ignores SIGINT, which is wrong. What we should've
done ideally, is to setup the signal handler after fork() but before
exec(). That is pretty much what preexec_fn is used for in Popen, but
unfortunately for us, it is not available on windows, so we can't use
it. What we will do instead is just setup signal handler after Popen()
but before communicate(), which would leave a slight gap where we might
also get affected by SIGINTS meant for the child, but that is the best
we can do.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-15 20:17:10 +03:00
Ruslan Kuprieiev e215364e6d test: http: use random port (#2269) 
Fixes #1878

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-15 13:18:10 +03:00
Ruslan Kuprieiev 8c303512e8 dvc: bump to 0.52.0 2019-07-15 11:41:30 +03:00
Ruslan Kuprieiev 10121411e0 import: don't forget to add outs to gitignore (#2266) 
Fixes #2263

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-14 21:35:23 +03:00
Ruslan Kuprieiev 94fe86afe8 tests: import-url: rewrite and move error msg test (#2262) 
This one was failing randomly.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-14 03:09:08 +03:00
Ruslan Kuprieiev 2c2f573897 import: remove beta warnings (#2257) 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-13 23:29:36 +03:00
Ruslan Kuprieiev 95110a865c dvc: bump to 0.51.2 2019-07-11 12:36:35 +03:00
Ruslan Kuprieiev eaab968036 build: windows: don't forget to pull images 2019-07-11 08:52:22 +03:00
Ruslan Kuprieiev 72a61b5599 build: windows: don't use abs path for iscc 2019-07-10 20:59:04 +03:00
Ruslan Kuprieiev 375dc261d0 build: windows: use call to call refreshenv 2019-07-10 18:03:15 +03:00
Ruslan Kuprieiev ccb0d7d1b3 travis: build_package: use which 2019-07-10 15:46:51 +03:00
Ruslan Kuprieiev d5c473acd4 travis: fix build_package.sh 2019-07-10 15:41:52 +03:00
Ruslan Kuprieiev 9eb06fee3b travis: before_install: don't set -x,-e in env.sh 2019-07-10 15:22:22 +03:00
Ruslan Kuprieiev c02137d7ba travis: adjust job names 2019-07-10 14:20:48 +03:00
Ruslan Kuprieiev 1edd2ffaec dvc: bump to 0.51.1 2019-07-10 13:03:49 +03:00
Ruslan Kuprieiev fa89e84baa travis: use stages (#2249) 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-10 12:12:11 +03:00
Ruslan Kuprieiev 99065bd42e dvc: networkx 2.3 doesn't support py2 anymore (#2250) 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-10 05:58:23 +03:00
Ruslan Kuprieiev 8e8dc921a3 travis: try build packages on regular builds (#2244) 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-10 03:25:52 +03:00
Ruslan Kuprieiev 0ab55f84ba travis: don't uninstall awscli on win 2019-07-08 21:42:08 +03:00
Ruslan Kuprieiev fcc8938b33 test: repro: fix formatting 2019-07-08 21:27:32 +03:00
Ruslan Kuprieiev e8b0d2d987 test: disable repro s3 test on windows 2019-07-08 21:24:23 +03:00
Ruslan Kuprieiev a8bd68c848 travis: windows: fix typo in choco command 2019-07-08 21:05:02 +03:00
Ruslan Kuprieiev 5ac6509ffd travis: win: install awscli using choco 2019-07-08 18:21:49 +03:00
Ruslan Kuprieiev d0299b3edf travis: debug windows s3 test 2019-07-08 17:47:54 +03:00
Ruslan Kuprieiev f3c4aff6c5 test: don't use python to call awscli 2019-07-08 17:44:18 +03:00
Ruslan Kuprieiev 912ec6b425 dvc: bump to 0.51.0 2019-07-08 17:19:48 +03:00
Ruslan Kuprieiev 7ad3c56865 travis: don't override before_install (#2239) 2019-07-07 15:57:08 +03:00
Ruslan Kuprieiev af34867d96 test: try calling awscli through python 2019-07-06 02:49:08 +03:00
Ruslan Kuprieiev 932b0d7af9 introduce dvc update for ext repos (#2218) 
* erepo: dvc: implement `update` for imports from ext repos

Fixes #1774
Fixes #2139
Fixes #2201

Signed-off-by: Ruslan Kuprieiev <[email protected]>

* deps: repo: make  private

Signed-off-by: Ruslan Kuprieiev <[email protected]>

* update: only support repo imports

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-06 02:28:35 +03:00
Ruslan Kuprieiev fb06306ea8 Merge pull request #2231 from efiop/2146 
checkout: safe_remove output if no checksum is found
 2019-07-06 02:25:38 +03:00
Ruslan Kuprieiev 384043592a Merge pull request #2227 from Suor/optimize-isin 
dvc: optmize PathInfo.isin()
 2019-07-05 15:39:40 +03:00
Ruslan Kuprieiev 36f72cbe63 Merge pull request #2230 from shcheklein/optimize-2203 
graph outputs overlapping check optimization
 2019-07-05 15:35:49 +03:00
Ruslan Kuprieiev fb58204de4 Merge pull request #2232 from Witiko/fix-progress-bar 
remote: base: fix progress bar in _collect_dir
 2019-07-05 13:37:20 +03:00