Alexander Schepanovski
6ccae711fe
dvc: refactor config ( #3298 )
...
* dvc: refactor config
Advantages:
- read like a dict
- modify as a dict for testing or manipulation purposes
- wrap modifications into context manager to save them:
with config.edit("local") as conf:
conf["core"]["remote"] = "new-default"
Design decisions:
- dropped string constants
- remote sections are parsed into a simple subdict upon load
- remote config schema is now defined by url scheme
- relative paths are handled transparently upon load/save
- user config and remote manipulations are moved to commands
- same dev manipulations are done by simply modifying a config dict
* test: do not set cache.type for remotes that doesn't support it
* dvc: fix windows absolute paths validation in config
* test: fix windows separate drive test
* dvc: stylistic fixes in config
2020-02-13 19:35:37 +02:00
Ivan Shcheklein
5e98a702a2
GDrive improvements and code cleanup ( #3294 )
...
* cleanup gdrive code, fix remote ids resolving
* fixes after testing GDrive cleanup
* address CodeClimate complexity, simplify a litte bit
* address CodeClimate complexity, further simplify complexity
* further refactoring need to fix GDrive tests
* tests: minor setup gdrive cloud simplification
2020-02-11 19:37:03 +02:00
Max Risuhin
cb38b1a0f1
Update Google Project credentials to run tests
2020-01-22 12:19:21 -08:00
Saugat Pachhai
37b9d32e04
test: refactor: use helper remotes in TestCases
2020-01-14 19:25:19 +05:45
Saugat Pachhai
a27910d71d
test: merge local related function in Local helper class
2020-01-14 14:04:02 +05:45
Saugat Pachhai
26d85f1a52
test: merge gcp related functions to GCP helper class
2020-01-13 23:49:22 +05:45
Saugat Pachhai
d55427dbd9
test: refactor hdfs related functions in HDFS test helpers
2020-01-13 16:30:15 +05:45
Saugat Pachhai
141f308a6a
test: refactor ssh related functions in SSH and SSHMocked test helpers
2020-01-13 14:23:42 +05:45
Mr. Outis
71b15d259a
py3: remove code related to py2 limitations
2020-01-06 23:03:33 -06:00
Ruslan Kuprieiev
4f312f69a9
Merge branch 'master' into refactor-remote-s3
2020-01-06 20:43:10 +02:00
Saugat Pachhai
78dd4896ca
test: merge _should_test_aws and _get_aws_url inside S3 test helper
2020-01-06 22:08:28 +05:45
Saugat Pachhai
96c87d5643
test: merge _should_oss_azure and _get_oss_url inside OSS class
2020-01-05 10:25:01 +05:45
Ruslan Kuprieiev
60e512112e
Merge branch 'master' into refactor-remote-azure
2020-01-05 04:24:59 +02:00
Ruslan Kuprieiev
b6c77f7668
Merge pull request #3056 from skshetry/refactor-gdrive
...
test: add _should_test_gdrive and _get_gdrive_url inside GDrive
2020-01-04 20:18:49 +02:00
Saugat Pachhai
c0616fcee2
test: add _should_test_gdrive and _get_gdrive_url inside GDrive
2020-01-04 22:03:49 +05:45
Saugat Pachhai
c4783f4930
test: merge _should_test_azure and _get_azure_url inside Azure class
2020-01-04 21:54:12 +05:45
Alexander Schepanovski
0352adc639
py3: use yield from where appropriate
2020-01-04 11:03:30 +07:00
Saugat Pachhai
4f011f62c7
use yield and staticmethod
2019-12-01 16:24:22 +05:45
Saugat Pachhai
22c0a644e5
address @efiop's suggestions
2019-12-01 16:08:53 +05:45
Saugat Pachhai
433d2f8017
test: remove nested contextmanagers, return False on exists()
2019-11-30 19:12:35 +05:45
Saugat Pachhai
42991d3b75
Move more stuff from data_cloud to tests/remotes.py
2019-11-30 10:04:45 +05:45
Saugat Pachhai
63cf117ee9
Move to tests/remotes.py
2019-11-30 08:58:43 +05:45
Alexander Schepanovski
Ivan Shcheklein
Max Risuhin
Saugat Pachhai
Mr. Outis
Ruslan Kuprieiev