Batuhan Taskaya d4a3df73df s3: fsspec migration (#5683) ...

* s3: migrate to s3fs

* s3: strip etag

* s3: disable instance cache

* tests: use the proper remote:// form in test_checkout

* tests: move/drop some tests

* setup: depend on s3fs

* tests: normalize s3 tests with some cleanups

* Use _download/_upload with old implementation

* fsspec: cache .exists() results

* setup: pin the boto version

* setup: install s3fs[boto3]

* s3: proper exception management

* s3: config improvements

* setup: reference without quotes

* setup: install boto separately

* setup: install moto server

* s3: mocking adjustments for moto_server

* s3: mark some fixtures with scope=session

* s3: s3_fake_creds_file scopes to func

* fsspec: add some docs regarding exists() optimization

* fsspec: exists() fallback

* fsspec: revert exists() optimization

* tests: ssl_verify => verify

* setup: temporarily fetch from master

* s3: add boto as a requirement

* tests: do an extra check regarding race conditions

* tests: use motoserver docker image

* tests: wrap config deletion with try/finally

* tests: disable s3 by default

* setup: upgrade fsspec

2021-05-05 11:36:10 +03:00

..

experiments

exp run: error out when trying to resume from intermediate checkpoint w/no modifications (#5829)

2021-04-30 15:12:44 +09:00

metrics

metrics diff/show: rollback to rounding fractional digits with precision (#5904)

2021-05-02 16:56:00 +03:00

params

params: read from ParamsDependency if possible (#5550)

2021-04-12 17:08:02 +02:00

parsing

parsing: resolve relative paths when loading parameters (#5734)

2021-03-30 23:50:04 +03:00

plots

plots: quote and resolve paths properly (#5670)

2021-03-24 20:27:24 +05:45

remote

dvc: refactor objects (#5607)

2021-03-12 01:10:34 +02:00

utils

html: enable providing custom html page templates (#5694)

2021-04-20 11:02:14 +02:00

__init__.py

test: move func tests to tests/func

2019-04-16 20:19:22 +03:00

conftest.py

plots: modify: handle --unset for nonexistent options (#4044)

2020-06-15 20:31:08 +03:00

test_add.py

tests: rerun gdrive and gs on failures (#5959)

2021-05-04 17:59:50 +03:00

test_analytics.py

Drop Python 3.5 support (#3792)

2020-05-14 01:46:42 +03:00

test_api.py

tests: rerun gdrive and gs on failures (#5959)

2021-05-04 17:59:50 +03:00

test_check_ignore.py

check-ignore show sub-repo patterns (#4564)

2020-09-15 06:59:41 +03:00

test_checkout.py

s3: fsspec migration (#5683)

2021-05-05 11:36:10 +03:00

test_cli.py

stage:add: use remainder as a command script (#5350)

2021-02-01 17:50:04 +02:00

test_commit.py

dvc: introduce File/Tree cache objects (#5424)

2021-02-09 04:00:06 +02:00

test_config.py

gdrive: support service auth with json (#5485)

2021-02-18 17:10:35 +02:00

test_data_cloud.py

tests: rerun gdrive and gs on failures (#5959)

2021-05-04 17:59:50 +03:00

test_dependency.py

Enable most of the pylint checks (#4111)

2020-06-25 18:10:14 +03:00

test_diff.py

diff: clear calculated renamed files from inverted hashmap (#5652)

2021-03-22 15:13:52 +02:00

test_dvcfile.py

Add versioning scheme in the dvc.lock (#5128)

2021-01-06 15:44:19 +05:45

test_external_repo.py

pull: skip isdir() checks on downloading files (#5696)

2021-03-26 15:22:45 +02:00

test_fs.py

tests: rerun gdrive and gs on failures (#5959)

2021-05-04 17:59:50 +03:00

test_gc.py

gs: use etag for the checksum parameter (#5534)

2021-03-02 12:43:27 +02:00

test_get_url.py

erepo: refactor download/fetch logic (#5234)

2021-01-10 10:48:36 +02:00

test_get.py

dvc: rename cache -> odb (#5481)

2021-02-16 22:49:25 +02:00

test_ignore.py

dvcignore: ignore file '.git' by default (#5745)

2021-03-31 13:47:34 +03:00

test_import_url.py

s3: fsspec migration (#5683)

2021-05-05 11:36:10 +03:00

test_import.py

dvc: rename cache -> odb (#5481)

2021-02-16 22:49:25 +02:00

test_init.py

state: use diskcache (#5505)

2021-02-23 20:51:34 +02:00

test_install.py

dvc: rename tree -> fs (#5461)

2021-02-13 15:40:44 +02:00

test_live.py

live integration: get rid of dvc from live (#5466)

2021-03-03 00:45:35 +09:00

test_lock.py

lock: added troubleshooting doc link in error message (#4325) (#4721)

2020-10-19 20:47:08 +03:00

test_lockfile.py

dvc: redefine is_callback as cmd and no outs/deps (#5187)

2021-01-14 17:23:20 +02:00

test_ls.py

support subrepos for get/list/api/import/ls (#4465)

2020-09-03 13:47:14 +03:00

test_merge_driver.py

term: replace 'DVC-file' and 'stage file' with correct terms (#3960) (#5280)

2021-02-05 16:01:42 +09:00

test_move.py

move: validate new stage before move (#5953)

2021-05-05 13:09:55 +09:00

test_odb.py

objects: split into separate files (#5609)

2021-03-12 04:12:46 +02:00

test_output.py

gs: use etag for the checksum parameter (#5534)

2021-03-02 12:43:27 +02:00

test_remote.py

dvc: refactor objects (#5607)

2021-03-12 01:10:34 +02:00

test_remove.py

dvc: rename cache -> odb (#5481)

2021-02-16 22:49:25 +02:00

test_repo.py

dvc: rename cache -> odb (#5481)

2021-02-16 22:49:25 +02:00

test_repro_multistage.py

live/checkpoints: test continue (#5300)

2021-01-24 22:06:37 +02:00

test_repro.py

refactor diff and show to use new table ui and new data structure (#5872)

2021-04-27 11:05:52 +05:45

test_root.py

config: read merged config by default (#5179)

2020-12-31 00:37:39 +02:00

test_run_cache.py

dvc: move checkout out of cache (#5415)

2021-02-05 03:27:00 +02:00

test_run_multistage.py

gs: use etag for the checksum parameter (#5534)

2021-03-02 12:43:27 +02:00

test_run_single_stage.py

state: use diskcache (#5505)

2021-02-23 20:51:34 +02:00

test_scm.py

tests: mark test_stash_pop as xfail on linux (#5952)

2021-05-04 11:22:57 +05:45

test_stage_load.py

stage collection: do not collect .gitignored dvcfiles (#5265)

2021-01-26 14:51:02 +02:00

test_stage.py

state: use diskcache (#5505)

2021-02-23 20:51:34 +02:00

test_state.py

state: use diskcache (#5505)

2021-02-23 20:51:34 +02:00

test_status.py

scm: move logic to gitpython backend (#5022)

2020-12-03 20:25:20 +02:00

test_system.py

Fix typos

2019-11-26 20:07:20 +05:45

test_unprotect.py

remove: try deleting before trying to chmod (#3620)

2020-04-10 23:21:16 +03:00

test_update.py

tests: rerun gdrive and gs on failures (#5959)

2021-05-04 17:59:50 +03:00

test_utils.py

dvc: rename tree -> fs (#5461)

2021-02-13 15:40:44 +02:00

test_version.py

dvc: include cache urls in info output. (#4848)

2020-11-19 05:59:33 +02:00