Paulo Olveira 75b4d0e483 s3: fix for corrupted cache on multipart uploads (#1867) ...

* s3: fixed wrong etag when copying multipart objects

The etag of multipart objects depends of the number of parts, when copying to the cache we should do so in the same number of parts that the original object was moved/uploaded in.

Fixes part of #1410

* s3: added check on copy for equal etag

* s3: added specific exception for ETag mismatch

* s3: use multipart copy to preserve etags

Signed-off-by: Ruslan Kuprieiev <[email protected]>

* test: add tests for etag preservation on s3

Signed-off-by: Ruslan Kuprieiev <[email protected]>

* test: requirements: use dev version moto

Specifically because of this https://github.com/spulec/moto/issues/1941

Signed-off-by: Ruslan Kuprieiev <[email protected]>

* test: requirements: install dev moto without -e

Signed-off-by: Ruslan Kuprieiev <[email protected]>

* test: stop using moto

Turned out to be quite buggy.

Signed-off-by: Ruslan Kuprieiev <[email protected]>

2019-04-15 21:03:22 +03:00

..

unit

ignore: introduce .dvcignore, apply when searching for stage files

2019-04-15 14:31:34 +02:00

utils

tests: use pytest caplog instead of custom mock

2019-04-06 20:35:30 -06:00

__init__.py

test: set maximum RLIMIT_NPROC

2019-02-04 03:09:21 +02:00

__main__.py

set timeouts method to thread to avoid problems in parallel run

2019-03-17 20:11:01 -07:00

basic_env.py

tests: use pytest caplog instead of custom mock

2019-04-06 20:35:30 -06:00

requirements.txt

checkout/remove: properly handle broken symlinks

2019-04-09 14:09:54 +03:00

test_add.py

tests: use pytest caplog instead of custom mock

2019-04-06 20:35:30 -06:00

test_analytics.py

tests: fix for globally disabled analytics

2019-03-28 14:54:04 +03:00

test_cache.py

cache: make reflink, copy default links

2019-04-15 11:27:44 +02:00

test_checkout.py

cache: make reflink, copy default links

2019-04-15 11:27:44 +02:00

test_cli.py

dvc: refactor dvc project class

2019-02-13 03:31:23 +02:00

test_commit.py

stage: extract yaml loading to util method

2019-02-28 16:27:16 +01:00

test_config.py

dvc: use black instead of flake8

2019-01-30 03:48:36 +02:00

test_data_cloud.py

tests: use pytest caplog instead of custom mock

2019-04-06 20:35:30 -06:00

test_dependency.py

dvc: use black instead of flake8

2019-01-30 03:48:36 +02:00

test_destroy.py

dvc: use black instead of flake8

2019-01-30 03:48:36 +02:00

test_diff.py

command: refactoring of _show function in diff.py

2019-04-05 15:02:28 +06:00

test_gc.py

dvc: refactor dvc project class

2019-02-13 03:31:23 +02:00

test_ignore.py

ignore: introduce .dvcignore, apply when searching for stage files

2019-04-15 14:31:34 +02:00

test_import.py

tests: use pytest caplog instead of custom mock

2019-04-06 20:35:30 -06:00

test_init.py

dvc: refactor dvc project class

2019-02-13 03:31:23 +02:00

test_install.py

tests: fix #1754

2019-03-21 19:47:42 +03:00

test_lock.py

dvc: use black instead of flake8

2019-01-30 03:48:36 +02:00

test_metrics.py

tests: use pytest caplog instead of custom mock

2019-04-06 20:35:30 -06:00

test_move.py

[WIP] Pkg install (#1742)

2019-03-20 04:09:12 +02:00

test_output.py

run: add --outs-persist option

2019-03-25 09:43:58 +01:00

test_pipeline.py

cli: add pipeline show --tree

2019-03-26 01:29:49 +09:00

test_pkg.py

[WIP] Pkg install (#1742)

2019-03-20 04:09:12 +02:00

test_remote.py

config: allow cross-referenced remotes

2019-04-08 22:10:03 -05:00

test_remove.py

checkout/remove: properly handle broken symlinks

2019-04-09 14:09:54 +03:00

test_repo.py

ignore: introduce .dvcignore, apply when searching for stage files

2019-04-15 14:31:34 +02:00

test_repro.py

test: move corrupted hardlink cache test test_repro -> test_run

2019-04-15 12:55:50 +02:00

test_run.py

test: move corrupted hardlink cache test test_repro -> test_run

2019-04-15 12:55:50 +02:00

test_s3.py

s3: fix for corrupted cache on multipart uploads (#1867)

2019-04-15 21:03:22 +03:00

test_scm.py

tests: fix get_gitignore_content

2019-03-21 19:47:42 +03:00

test_stage.py

config: allow cross-referenced remotes

2019-04-08 22:10:03 -05:00

test_state.py

apply inode value mapping when checking for an existing entry

2019-03-11 19:12:58 -07:00

test_status.py

status: imply --cloud when a remote is given

2019-02-21 18:32:48 -06:00

test_system.py

dvc: use black instead of flake8

2019-01-30 03:48:36 +02:00

test_tag.py

tests: use pytest caplog instead of custom mock

2019-04-06 20:35:30 -06:00

test_tree.py

dvc.repo.tree -> dvc.scm.tree

2019-03-22 19:53:41 +03:00

test_unprotect.py

dvc: comply with both flake8 and black

2019-02-04 00:10:36 +02:00

test_updater.py

dvc: use black instead of flake8

2019-01-30 03:48:36 +02:00

test_utils.py

tests: use pytest caplog instead of custom mock

2019-04-06 20:35:30 -06:00