Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-02 07:18:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
3,504 Commits 7 Branches 579 Tags
8955a606c4acaf3a567daacb2cdf82118da6afbc
Commit Graph
3504 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ruslan Kuprieiev 12461cf356 Merge pull request #2314 from Suor/meta-md5 
dvc: ignore Stage.meta in md5 calculations plus some polish
 2019-07-23 19:53:23 +03:00
Alexander Schepanovski 59eb929516 ssh: do not ask for same password repeatedly 2019-07-23 16:25:40 +03:00
Alexander Schepanovski 35a8d69c4f dvc: ignore Stage.meta in md5 calculations 
Meta change surely should not trigger a repro run. Closes #2209.
 2019-07-23 16:00:22 +03:00
Alexander Schepanovski f00a325114 dvc: refactor dict_md5() 
- stop using mutable default value
- use list and dict comprehensions to speed it up and make nicer
- employ exhaustive if..elif..else
 2019-07-23 16:00:12 +03:00
Ruslan Kuprieiev 6b84dbb985 Merge pull request #2303 from Suor/push-jobs 
remote: fixed Repo.push() to default to 1 job
 2019-07-23 14:44:54 +03:00
Ruslan Kuprieiev 93f0062482 setup: freeze pyarrow version 2019-07-23 14:27:51 +03:00
pawel e78afefc97 remote: base: refactor _collect_dir 2019-07-23 13:03:08 +02:00
pared 7885b0404f remote: base: try to retrieve path_info checksum from database upon dir checksum calculation 2019-07-23 13:03:08 +02:00
Alexander Schepanovski 20f1976e03 remote: fixed Repo.push/pull/fetch/status() to default to 1 job 2019-07-23 12:23:43 +03:00
Alexander Schepanovski f37ab9431b perf: stop on first changed thing in Stage.changed() 2019-07-23 15:29:49 +07:00
Ruslan Kuprieiev f346300a13 cache: don't forget about -q and -v options 
https://github.com/iterative/dvc/issues/1924#issuecomment-496755449
 2019-07-23 03:13:02 +03:00
Ruslan Kuprieiev ecb28a285c Merge pull request #2307 from efiop/2238 
import-url: lock by-default
 2019-07-23 01:44:04 +03:00
Ruslan Kuprieiev ffc828df6f dvc: bump to 0.53.0 2019-07-23 01:38:37 +03:00
Ruslan Kuprieiev 641edacef6 import-url: lock by-default 
Fixes #2238

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-22 20:24:00 +03:00
Ruslan Kuprieiev 33511902c3 Merge pull request #2306 from efiop/2252 
import: only download specific output
 2019-07-22 15:55:16 +03:00
Ruslan Kuprieiev 4a0b3a807d import: only donwload specific output 
Fixes #2252

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-22 15:04:10 +03:00
Ruslan Kuprieiev a1143c532c Merge pull request #2289 from Suor/exists-jobs 
remote: honor --jobs for status collection and other fixes
 2019-07-21 19:24:30 +03:00
Alexander Schepanovski 1f90b426fb remote: prettify get_connection/pool() signatures 2019-07-21 13:41:04 +07:00
Alexander Schepanovski 6afc2a38ba test: close pools on tests cleanup 
This avoids weird errors as pools are collected by gc in broken env.
 2019-07-21 13:40:29 +07:00
Alexander Schepanovski 31f1ded315 remote: don't close sftp connections until parent ssh conn closed 
Since this is multiplexing over the same TCP connection no system
resources are withheld, so this should be a no-brainer optimization.

As a side-effect this should fix "open max - close all - try open -
Administratively prohobited" error @darabi experiencing in #2280.
 2019-07-21 13:38:44 +07:00
Alexander Schepanovski 624ccfc744 remote: honor --jobs for status collection 2019-07-21 12:50:35 +07:00
Ruslan Kuprieiev b6bc65fcbf Merge pull request #2302 from shcheklein/fix-2259 
url info: fix infinite recustion on deepcopy
 2019-07-21 04:32:30 +03:00
Ruslan Kuprieiev bd13d6f9d6 Merge pull request #2299 from jorgeorpinel/master 
output: remove a couple more "(s)" left
 2019-07-21 02:17:42 +03:00
Ivan Shcheklein ef013c8472 url info: minor fix typo in a comment 2019-07-20 15:51:11 -07:00
Ivan Shcheklein 164c2e8dc1 url info: fix infinite recustion on deepcopy 2019-07-20 15:26:00 -07:00
Jorge Orpinel 80c30cebea update: better short desc in command help outut 
per https://github.com/iterative/dvc.org/pull/490#discussion_r305584059
 2019-07-20 13:47:00 -06:00
Jorge Orpinel 0575104c20 update: small autocomplete scripts reformat 2019-07-20 13:44:36 -06:00
Jorge Orpinel c7ef6592fe output: remove a couple more "(s)" left 
Per https://github.com/iterative/dvc/pull/2281#issuecomment-513053199
 2019-07-20 13:44:36 -06:00
Ruslan Kuprieiev df28309403 Merge pull request #2300 from efiop/moto 
tests: use moto pre-release
 2019-07-20 17:12:38 +03:00
Ruslan Kuprieiev f901ba5c10 tests: use moto pre-release 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-20 16:09:44 +03:00
Ruslan Kuprieiev c2d25f455f travis: hadoop: fix typo 2019-07-20 03:00:39 +03:00
Ruslan Kuprieiev 3ccb80466a travis: hadoop: add openjdk-7 ppa 2019-07-20 02:45:38 +03:00
Ruslan Kuprieiev a4e461fc02 travis: hadoop: use openjdk-7 2019-07-20 02:32:49 +03:00
Ruslan Kuprieiev 3becd5c20b Merge pull request #2297 from efiop/hdfs 
remote: hdfs: use pyarrow and connection pool
 2019-07-20 02:14:56 +03:00
Ruslan Kuprieiev 68bebe7944 remote: hdfs: use pyarrow and connection pool 
Related to #1629

Speeds up HDFS tests significantly. E.g. ExternalHDFS test goes from 600
sec to 190sec. test_open_external[HDFS] from 160sec to 3sec.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-20 01:12:17 +03:00
Ruslan Kuprieiev 1e9f1d0619 Merge pull request #2281 from jorgeorpinel/master 
help: finish pluralizing "the pipeline" term in output
 2019-07-19 12:55:10 +03:00
Jorge Orpinel 6f5449fb83 term: remove "(s)" and "(are) related to the previous commit 
PR #2281 feedback
 2019-07-18 17:51:20 -06:00
Jorge Orpinel d4f4126ddd help: finish singularizing "pipeline" term... 
(in status and repro command help outputs)

Per #2158
 2019-07-18 17:51:20 -06:00
Ruslan Kuprieiev 993b1df8ef Merge pull request #2282 from efiop/moto 
tests: s3: use moto for multipart test
 2019-07-18 23:09:50 +03:00
Ruslan Kuprieiev 958a4fbd3c tests: s3: use moto for multipart test 
Fixes #1889

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-07-18 20:51:49 +03:00
Ruslan Kuprieiev 36c07b8abe Merge pull request #2278 from Suor/ssh-md5-jobs 
remote: speed up ssh dir checksum
 2019-07-18 19:28:23 +03:00
Alexander Schepanovski 67e50cd71e remote: speed up ssh dir checksum 2019-07-18 22:13:42 +07:00
Ruslan Kuprieiev 432373fb42 stage: properly quote command in exception 2019-07-18 16:10:38 +03:00
Ruslan Kuprieiev 6598b88b77 Merge pull request #2290 from pared/2221 
data_cloud: remove backward compatibilty on get_remote
 2019-07-18 14:10:50 +03:00
Ruslan Kuprieiev 598ef02558 Merge pull request #2277 from pared/1900 
reproduce: use kwargs instead of explicit arguments
 2019-07-18 13:57:15 +03:00
pared e39be6d1aa data_cloud: remove compat methods and tests 2019-07-18 10:29:40 +02:00
pawel 14c4a9c52f data_cloud: remove backward compatibilty on get_remote 2019-07-17 23:02:13 +02:00
pared 11cfd663ac reproduce: use kwargs instead of explicit arguments 2019-07-17 21:47:46 +02:00
Ruslan Kuprieiev 9b37c6b021 Merge pull request #2288 from Suor/pool-fixes 
remote: pool fixes
 2019-07-17 19:56:04 +03:00
Alexander Schepanovski ed387d824d remote: do not swallow exceptions by ssh pool 2019-07-17 22:20:43 +07:00