Commit Graph
4126 Commits
Author SHA1 Message Date
Casper da Costa-Luis 75f8b9cd8b start to clean up gdrive 2019-12-01 02:31:57 +00:00
Casper da Costa-Luis ecdc608e13 clean up gs progress using Tqdm.wrapattr
- fixes #2829
2019-12-01 02:22:04 +00:00
Ruslan Kuprieiev f09517ad09 travis: windows: use python 3.7.5 2019-11-30 20:11:11 +02:00
Ruslan Kuprieiev 30848306e8 Merge pull request #2870 from Suor/test-api-fast-skip
test: skip non supported remotes fast in api tests
2019-11-30 15:15:00 +02:00
Ruslan Kuprieiev 0404a2324e Merge pull request #2551 from MaxRis/gdrive-support
GDrive remote support
2019-11-30 01:21:31 +02:00
Alexander Schepanovski 865ed6f8ea test: skip non supported remotes fast in api tests 2019-11-29 23:42:26 +01:00
Ruslan Kuprieiev 94f803e043 Merge pull request #2683 from mroutis/fix-2678
s3: ignore empty directories while walking files
2019-11-29 21:00:39 +02:00
Mr. Outis 1f9a0f0e0f address @efiop's suggestions 2019-11-29 12:38:12 -06:00
Mr. Outis 845cd352f7 s3: add support for top level empty directories 2019-11-29 11:46:28 -06:00
Ruslan Kuprieiev 6ad278f54c Merge pull request #2794 from pared/2510
remote: http: raise exception when response with error status code
2019-11-29 16:58:47 +02:00
pawel 03c27192a6 remote: http: calculate length basing on response and not head call 2019-11-29 15:31:04 +01:00
pawel f7846a5bed test: remote: http: clear test file name 2019-11-29 15:30:55 +01:00
pawel c102a781c2 HTTPError: reformat error message 2019-11-29 15:30:55 +01:00
Paweł RedzyńskiandAlexander Schepanovski e084b427e3 Update dvc/remote/http.py
Co-Authored-By: Alexander Schepanovski <[email protected]>
2019-11-29 15:30:55 +01:00
Paweł Redzyński 7218ff202c remote: http: rename http error, refactor test 2019-11-29 15:30:55 +01:00
Paweł Redzyński 72abfb0572 remote: http: raise exception when download response with error status code 2019-11-29 15:30:55 +01:00
Max Risuhin e7227898e4 Support GDrive as remote 2019-11-29 01:21:10 -08:00
Ruslan Kuprieiev 510ff8a9da Merge pull request #2863 from Suor/locks
remote: protect all remote client/session creation code with locks
2019-11-29 11:18:56 +02:00
Ruslan Kuprieiev 593ab17d25 setup: don't forget contextlib2 2019-11-29 02:14:25 +02:00
Ruslan Kuprieiev 6b4242a904 Merge pull request #2861 from danihodovic/refactor/remove-redundant-vars
test: refactor & remove redundant test fixtures
2019-11-29 01:24:27 +02:00
Alexander Schepanovski 8af1aeefb4 remote: refactor ssh ask password code 2019-11-28 21:10:35 +01:00
Alexander Schepanovski 73eac3b6cc remote: protect all remote client/session creation code with locks
With @cached_property last write wins, so all threads will use the same
session. However, several might be created concurrently wasting
resources and even potentially asking something from the user.

This change guarantees only one client instance will be created for a
remote.
2019-11-28 21:05:20 +01:00
Dani Hodovic 78c505f6cb test: refactor & remove redundant test fixtures
https://github.com/iterative/dvc/pull/2837#discussion_r351318487
2019-11-28 19:04:56 +01:00
Ruslan Kuprieiev 838efb293f Merge pull request #2836 from Suor/lazy-cache-paths
perf: optimize cache listing for local, ssh and hdfs
2019-11-28 13:23:46 +02:00
Ruslan Kuprieiev 00744bc794 Merge pull request #2835 from Suor/opt-checkout
remote: small .save_info()/.get_checksum() cleanup
2019-11-28 08:55:25 +02:00
Ruslan Kuprieiev 78942ca4da Merge pull request #2854 from pared/2711_2
RemoteNotSpecifiedInExternalRepoError: dont pass cause of exception
2019-11-27 22:30:05 +02:00
Paweł Redzyński 31aed9b27b NoRemoteInExternalRepoError: dont pass cause of exception 2019-11-27 10:05:16 +01:00
Ruslan Kuprieiev f9d4ef8abd Update version.py 0.71.0 2019-11-26 20:55:49 +02:00
Ruslan Kuprieiev 5703b17190 Merge pull request #2856 from peper0/master
Possible fix for #2850.
2019-11-26 20:48:07 +02:00
Ruslan Kuprieiev a1cc2e66e1 Merge pull request #2821 from kaiogu/master
remote: fix remote default call with no arguments
2019-11-26 20:37:31 +02:00
Ruslan Kuprieiev 424931f54a Merge pull request #2855 from skshetry/fix-typo
Fix typos
2019-11-26 20:28:44 +02:00
Kaio Giurizatto Utsch 82a535b97e Change logging to print
Python logging recommends using print instead of logging for ordinary
output of command line program.

Also changed the test to reflect this.
2019-11-26 15:02:03 -03:00
Tomasz Łakota a986c6a09d Possible fix for #2850. 2019-11-26 18:25:36 +01:00
Kaio Giurizatto Utsch 95924a34e6 Undo last commit
Turns out that the argument was needed after all
2019-11-26 14:19:09 -03:00
Saugat Pachhai 461a79e1e8 Fix typos 2019-11-26 20:07:20 +05:45
Kaio Giurizatto Utsch 9611107896 Remove unused argument 2019-11-25 17:51:49 -03:00
Kaio Giurizatto Utsch c2def64dc7 remote: add test case to show default 2019-11-25 17:35:45 -03:00
Ruslan Kuprieiev 38be142497 Merge pull request #2842 from skshetry/fix-typo
Fix typo and grammar
2019-11-24 12:58:03 +02:00
Saugat Pachhai 7a678f3322 dvc: fix grammar in PR template 2019-11-24 15:44:42 +05:45
Saugat Pachhai 2859b53cae dvc: fix typo in data_cloud.py module docstring 2019-11-24 15:38:54 +05:45
Alexander Schepanovski 8681cc3cd1 perf: optimize cache listing for local, ssh and hdfs
- make all three lazy
- simplify local one
- use deque instead of list for hdfs
2019-11-22 14:43:01 +01:00
Alexander Schepanovski 8da0390c57 remote: small .save_info()/.get_checksum() cleanup 2019-11-22 12:58:08 +01:00
Ruslan Kuprieiev 3de46dd25f Merge pull request #2832 from skshetry/refactor-startswith-pathisin
Refactor `startswith` with `path_isin` util
2019-11-22 05:08:48 +02:00
saugat pachhai 9ae74073f2 dvc: remove extra newline 2019-11-22 05:36:06 +05:45
Saugat Pachhai 751bdb2197 dvc: refactor startswith usage with path_isin util 2019-11-21 22:22:08 +05:45
Ruslan Kuprieiev f5c8d5d73e Merge pull request #2827 from Suor/bc-remnants
dvc: remove unused config paths
2019-11-21 17:45:10 +02:00
Ruslan Kuprieiev 7bc7a572f2 Merge pull request #2809 from casperdcl/gs-progress
GS progress for push & pull
2019-11-21 05:38:35 +02:00
Ruslan Kuprieiev 5c5d1eda1d Merge pull request #2817 from casperdcl/si-progress
use SI prefixes for progress
2019-11-21 05:10:49 +02:00
Alexander Schepanovski 0c2a475e93 dvc: remove unused config paths
These are remnants from old style remotes configuration
2019-11-20 20:33:46 +01:00
Kaio Utsch 142eb47557 remote: fix default --unset break of last commit 2019-11-20 10:29:10 +00:00