Commit Graph
4110 Commits
Author SHA1 Message Date
Max Risuhin e7227898e4 Support GDrive as remote 2019-11-29 01:21:10 -08:00
Ruslan Kuprieiev 510ff8a9da Merge pull request #2863 from Suor/locks
remote: protect all remote client/session creation code with locks
2019-11-29 11:18:56 +02:00
Ruslan Kuprieiev 593ab17d25 setup: don't forget contextlib2 2019-11-29 02:14:25 +02:00
Ruslan Kuprieiev 6b4242a904 Merge pull request #2861 from danihodovic/refactor/remove-redundant-vars
test: refactor & remove redundant test fixtures
2019-11-29 01:24:27 +02:00
Alexander Schepanovski 8af1aeefb4 remote: refactor ssh ask password code 2019-11-28 21:10:35 +01:00
Alexander Schepanovski 73eac3b6cc remote: protect all remote client/session creation code with locks
With @cached_property last write wins, so all threads will use the same
session. However, several might be created concurrently wasting
resources and even potentially asking something from the user.

This change guarantees only one client instance will be created for a
remote.
2019-11-28 21:05:20 +01:00
Dani Hodovic 78c505f6cb test: refactor & remove redundant test fixtures
https://github.com/iterative/dvc/pull/2837#discussion_r351318487
2019-11-28 19:04:56 +01:00
Ruslan Kuprieiev 838efb293f Merge pull request #2836 from Suor/lazy-cache-paths
perf: optimize cache listing for local, ssh and hdfs
2019-11-28 13:23:46 +02:00
Ruslan Kuprieiev 00744bc794 Merge pull request #2835 from Suor/opt-checkout
remote: small .save_info()/.get_checksum() cleanup
2019-11-28 08:55:25 +02:00
Ruslan Kuprieiev 78942ca4da Merge pull request #2854 from pared/2711_2
RemoteNotSpecifiedInExternalRepoError: dont pass cause of exception
2019-11-27 22:30:05 +02:00
Paweł Redzyński 31aed9b27b NoRemoteInExternalRepoError: dont pass cause of exception 2019-11-27 10:05:16 +01:00
Ruslan Kuprieiev f9d4ef8abd Update version.py 0.71.0 2019-11-26 20:55:49 +02:00
Ruslan Kuprieiev 5703b17190 Merge pull request #2856 from peper0/master
Possible fix for #2850.
2019-11-26 20:48:07 +02:00
Ruslan Kuprieiev a1cc2e66e1 Merge pull request #2821 from kaiogu/master
remote: fix remote default call with no arguments
2019-11-26 20:37:31 +02:00
Ruslan Kuprieiev 424931f54a Merge pull request #2855 from skshetry/fix-typo
Fix typos
2019-11-26 20:28:44 +02:00
Kaio Giurizatto Utsch 82a535b97e Change logging to print
Python logging recommends using print instead of logging for ordinary
output of command line program.

Also changed the test to reflect this.
2019-11-26 15:02:03 -03:00
Tomasz Łakota a986c6a09d Possible fix for #2850. 2019-11-26 18:25:36 +01:00
Kaio Giurizatto Utsch 95924a34e6 Undo last commit
Turns out that the argument was needed after all
2019-11-26 14:19:09 -03:00
Saugat Pachhai 461a79e1e8 Fix typos 2019-11-26 20:07:20 +05:45
Kaio Giurizatto Utsch 9611107896 Remove unused argument 2019-11-25 17:51:49 -03:00
Kaio Giurizatto Utsch c2def64dc7 remote: add test case to show default 2019-11-25 17:35:45 -03:00
Ruslan Kuprieiev 38be142497 Merge pull request #2842 from skshetry/fix-typo
Fix typo and grammar
2019-11-24 12:58:03 +02:00
Saugat Pachhai 7a678f3322 dvc: fix grammar in PR template 2019-11-24 15:44:42 +05:45
Saugat Pachhai 2859b53cae dvc: fix typo in data_cloud.py module docstring 2019-11-24 15:38:54 +05:45
Alexander Schepanovski 8681cc3cd1 perf: optimize cache listing for local, ssh and hdfs
- make all three lazy
- simplify local one
- use deque instead of list for hdfs
2019-11-22 14:43:01 +01:00
Alexander Schepanovski 8da0390c57 remote: small .save_info()/.get_checksum() cleanup 2019-11-22 12:58:08 +01:00
Ruslan Kuprieiev 3de46dd25f Merge pull request #2832 from skshetry/refactor-startswith-pathisin
Refactor `startswith` with `path_isin` util
2019-11-22 05:08:48 +02:00
saugat pachhai 9ae74073f2 dvc: remove extra newline 2019-11-22 05:36:06 +05:45
Saugat Pachhai 751bdb2197 dvc: refactor startswith usage with path_isin util 2019-11-21 22:22:08 +05:45
Ruslan Kuprieiev f5c8d5d73e Merge pull request #2827 from Suor/bc-remnants
dvc: remove unused config paths
2019-11-21 17:45:10 +02:00
Ruslan Kuprieiev 7bc7a572f2 Merge pull request #2809 from casperdcl/gs-progress
GS progress for push & pull
2019-11-21 05:38:35 +02:00
Ruslan Kuprieiev 5c5d1eda1d Merge pull request #2817 from casperdcl/si-progress
use SI prefixes for progress
2019-11-21 05:10:49 +02:00
Alexander Schepanovski 0c2a475e93 dvc: remove unused config paths
These are remnants from old style remotes configuration
2019-11-20 20:33:46 +01:00
Kaio Utsch 142eb47557 remote: fix default --unset break of last commit 2019-11-20 10:29:10 +00:00
Ruslan Kuprieiev 91ac75d023 Merge pull request #2798 from skshetry/fix-str-rel-repo
Display path relative to temporary repo when get/import-ing files
2019-11-20 11:34:31 +02:00
Kaio Utsch 67ceed0d25 remote: fix remote default call with no arguments
remote default command with no arguments now returns default remote instead of
setting default remote to None.

Fixes #2813
2019-11-20 09:21:41 +00:00
Ruslan Kuprieiev 2bae5e4622 stage: remove unused import 2019-11-20 11:04:49 +02:00
Ruslan Kuprieiev c7c852a42f Merge pull request #2796 from Suor/opt-validate
perf: switch schema validation library
2019-11-20 11:00:39 +02:00
Ruslan Kuprieiev a1433ba356 Merge branch 'master' into opt-validate 2019-11-20 11:00:28 +02:00
Ruslan Kuprieiev f563892760 dvc: bump to 0.70.0 0.70.0 2019-11-20 08:29:12 +02:00
Ruslan Kuprieiev 1683511da5 Merge pull request #2777 from pared/2602
import: intercept and rephrase OutputNotFound message
2019-11-20 06:27:58 +02:00
Casper da Costa-Luis 43da704083 use SI prefixes for progress 2019-11-19 20:28:37 +00:00
Casper da Costa-Luis b2f7c841ef fix deepsource issues 2019-11-19 17:49:32 +00:00
Casper da Costa-Luis b811a773c6 update dynamic chunk tests 2019-11-19 17:44:01 +00:00
Ruslan Kuprieiev 404620e267 test: update: use dvc_repo fixture
To fix test failure.
2019-11-19 19:12:49 +02:00
Ruslan Kuprieiev 7fae34ee5d test: freeze pytest-mock version
To address failing tests.
2019-11-19 18:52:10 +02:00
Casper da Costa-Luis 28b99dc4c7 expose and use name, no_progress_bar
Fixes https://github.com/iterative/dvc/pull/2809#discussion_r347180388
2019-11-19 16:19:54 +00:00
Saugat Pachhai 83c8ab5c26 test: Refactor tests 2019-11-19 21:55:13 +05:45
Saugat Pachhai 58624e0230 utils/fs: use fspath_py35 instead of fspath 2019-11-19 21:55:01 +05:45
Casper da Costa-Luis 5eefacdf2c back to gs multiple
Fixes https://github.com/iterative/dvc/pull/2809#discussion_r347954033
2019-11-19 14:39:31 +00:00