Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-02 07:18:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
3,347 Commits 7 Branches 579 Tags
6b84dbb985f2b3472de8e3379e29918d1b9a093a
Commit Graph
3347 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ruslan Kuprieiev 6b84dbb985 Merge pull request #2303 from Suor/push-jobs 
remote: fixed Repo.push() to default to 1 job
 2019-07-23 14:44:54 +03:00
Ruslan Kuprieiev 93f0062482 setup: freeze pyarrow version 2019-07-23 14:27:51 +03:00
Alexander Schepanovski 20f1976e03 remote: fixed Repo.push/pull/fetch/status() to default to 1 job 2019-07-23 12:23:43 +03:00
Ruslan Kuprieiev f346300a13 cache: don't forget about -q and -v options 
https://github.com/iterative/dvc/issues/1924#issuecomment-496755449
 2019-07-23 03:13:02 +03:00
Ruslan Kuprieiev ecb28a285c Merge pull request #2307 from efiop/2238 
import-url: lock by-default
 2019-07-23 01:44:04 +03:00
Ruslan Kuprieiev ffc828df6f dvc: bump to 0.53.0 2019-07-23 01:38:37 +03:00
Ruslan Kuprieiev 641edacef6 import-url: lock by-default 
Fixes #2238

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-22 20:24:00 +03:00
Ruslan Kuprieiev 33511902c3 Merge pull request #2306 from efiop/2252 
import: only download specific output
 2019-07-22 15:55:16 +03:00
Ruslan Kuprieiev 4a0b3a807d import: only donwload specific output 
Fixes #2252

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-22 15:04:10 +03:00
Ruslan Kuprieiev a1143c532c Merge pull request #2289 from Suor/exists-jobs 
remote: honor --jobs for status collection and other fixes
 2019-07-21 19:24:30 +03:00
Alexander Schepanovski 1f90b426fb remote: prettify get_connection/pool() signatures 2019-07-21 13:41:04 +07:00
Alexander Schepanovski 6afc2a38ba test: close pools on tests cleanup 
This avoids weird errors as pools are collected by gc in broken env.
 2019-07-21 13:40:29 +07:00
Alexander Schepanovski 31f1ded315 remote: don't close sftp connections until parent ssh conn closed 
Since this is multiplexing over the same TCP connection no system
resources are withheld, so this should be a no-brainer optimization.

As a side-effect this should fix "open max - close all - try open -
Administratively prohobited" error @darabi experiencing in #2280.
 2019-07-21 13:38:44 +07:00
Alexander Schepanovski 624ccfc744 remote: honor --jobs for status collection 2019-07-21 12:50:35 +07:00
Ruslan Kuprieiev b6bc65fcbf Merge pull request #2302 from shcheklein/fix-2259 
url info: fix infinite recustion on deepcopy
 2019-07-21 04:32:30 +03:00
Ruslan Kuprieiev bd13d6f9d6 Merge pull request #2299 from jorgeorpinel/master 
output: remove a couple more "(s)" left
 2019-07-21 02:17:42 +03:00
Ivan Shcheklein ef013c8472 url info: minor fix typo in a comment 2019-07-20 15:51:11 -07:00
Ivan Shcheklein 164c2e8dc1 url info: fix infinite recustion on deepcopy 2019-07-20 15:26:00 -07:00
Jorge Orpinel 80c30cebea update: better short desc in command help outut 
per https://github.com/iterative/dvc.org/pull/490#discussion_r305584059
 2019-07-20 13:47:00 -06:00
Jorge Orpinel 0575104c20 update: small autocomplete scripts reformat 2019-07-20 13:44:36 -06:00
Jorge Orpinel c7ef6592fe output: remove a couple more "(s)" left 
Per https://github.com/iterative/dvc/pull/2281#issuecomment-513053199
 2019-07-20 13:44:36 -06:00
Ruslan Kuprieiev df28309403 Merge pull request #2300 from efiop/moto 
tests: use moto pre-release
 2019-07-20 17:12:38 +03:00
Ruslan Kuprieiev f901ba5c10 tests: use moto pre-release 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-20 16:09:44 +03:00
Ruslan Kuprieiev c2d25f455f travis: hadoop: fix typo 2019-07-20 03:00:39 +03:00
Ruslan Kuprieiev 3ccb80466a travis: hadoop: add openjdk-7 ppa 2019-07-20 02:45:38 +03:00
Ruslan Kuprieiev a4e461fc02 travis: hadoop: use openjdk-7 2019-07-20 02:32:49 +03:00
Ruslan Kuprieiev 3becd5c20b Merge pull request #2297 from efiop/hdfs 
remote: hdfs: use pyarrow and connection pool
 2019-07-20 02:14:56 +03:00
Ruslan Kuprieiev 68bebe7944 remote: hdfs: use pyarrow and connection pool 
Related to #1629

Speeds up HDFS tests significantly. E.g. ExternalHDFS test goes from 600
sec to 190sec. test_open_external[HDFS] from 160sec to 3sec.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-20 01:12:17 +03:00
Ruslan Kuprieiev 1e9f1d0619 Merge pull request #2281 from jorgeorpinel/master 
help: finish pluralizing "the pipeline" term in output
 2019-07-19 12:55:10 +03:00
Jorge Orpinel 6f5449fb83 term: remove "(s)" and "(are) related to the previous commit 
PR #2281 feedback
 2019-07-18 17:51:20 -06:00
Jorge Orpinel d4f4126ddd help: finish singularizing "pipeline" term... 
(in status and repro command help outputs)

Per #2158
 2019-07-18 17:51:20 -06:00
Ruslan Kuprieiev 993b1df8ef Merge pull request #2282 from efiop/moto 
tests: s3: use moto for multipart test
 2019-07-18 23:09:50 +03:00
Ruslan Kuprieiev 958a4fbd3c tests: s3: use moto for multipart test 
Fixes #1889

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-18 20:51:49 +03:00
Ruslan Kuprieiev 36c07b8abe Merge pull request #2278 from Suor/ssh-md5-jobs 
remote: speed up ssh dir checksum
 2019-07-18 19:28:23 +03:00
Alexander Schepanovski 67e50cd71e remote: speed up ssh dir checksum 2019-07-18 22:13:42 +07:00
Ruslan Kuprieiev 432373fb42 stage: properly quote command in exception 2019-07-18 16:10:38 +03:00
Ruslan Kuprieiev 6598b88b77 Merge pull request #2290 from pared/2221 
data_cloud: remove backward compatibilty on get_remote
 2019-07-18 14:10:50 +03:00
Ruslan Kuprieiev 598ef02558 Merge pull request #2277 from pared/1900 
reproduce: use kwargs instead of explicit arguments
 2019-07-18 13:57:15 +03:00
pared e39be6d1aa data_cloud: remove compat methods and tests 2019-07-18 10:29:40 +02:00
pawel 14c4a9c52f data_cloud: remove backward compatibilty on get_remote 2019-07-17 23:02:13 +02:00
pared 11cfd663ac reproduce: use kwargs instead of explicit arguments 2019-07-17 21:47:46 +02:00
Ruslan Kuprieiev 9b37c6b021 Merge pull request #2288 from Suor/pool-fixes 
remote: pool fixes
 2019-07-17 19:56:04 +03:00
Alexander Schepanovski ed387d824d remote: do not swallow exceptions by ssh pool 2019-07-17 22:20:43 +07:00
Alexander Schepanovski 6010ce54cd remote: manually close all ssh pools at the end 
Python 2 fails to do it automatically occasionally and shows weird error
messages.

This was harmless but confusing.
 2019-07-17 22:20:43 +07:00
Andrew Grigorev 7d3e9808b5 ci: unify pip cache location for all platforms (#2286) 2019-07-17 15:42:38 +03:00
Nabanita Dash 89541b73fa Autocompletion of commands and files (#2226) 
* changed " to '

* autocompletion of commands and files

* Revert "autocompletion of commands and files"

This reverts commit 0b394ec841c68357cec6eb1cfa2cb20b636d3739.

revert the changes made

* changed

* bash complete

* modified

* shows subcommands but not files

* modified
 2019-07-17 00:29:09 +03:00
Georgy Dyuldin 840318dd22 git: Fix submodule names issue (#2274) 
GitPython creates submodules nodes during tree iterate without explicit
passing name attribute. This path replaces such submodules with new
instances with filled name attribute.

Fixes: #1898
 2019-07-16 16:38:42 +03:00
Alexander Schepanovski db19957b8a Download refactor (#2275) 
* remote: drop not working http resume

Closes #2136

* remote: drop @transfer_context()

It is not needed for ssh anymore and GS/S3 are switched to client
instances in cached properties.

* remote: drop upload/download chunking
 2019-07-16 16:27:44 +03:00
Alexander Schepanovski 9766d34cec remote: support older linuxes as ssh remotes (#2276) 
* remote: support older linuxes as ssh remotes

Work around md5sum not having --tag in Red Hat 6.3 and friends.
Fixes #2242.

* remote: optimize consequent ssh md5 calls
 2019-07-16 14:15:28 +03:00
Ruslan Kuprieiev fc5d3c182c dvc: bump to 0.52.1 0.52.1 2019-07-15 20:33:54 +03:00