Paulo Olveira
75b4d0e483
s3: fix for corrupted cache on multipart uploads ( #1867 )
...
* s3: fixed wrong etag when copying multipart objects
The etag of multipart objects depends of the number of parts, when copying to the cache we should do so in the same number of parts that the original object was moved/uploaded in.
Fixes part of #1410
* s3: added check on copy for equal etag
* s3: added specific exception for ETag mismatch
* s3: use multipart copy to preserve etags
Signed-off-by: Ruslan Kuprieiev <[email protected] [email protected] https://github.com/spulec/moto/issues/1941
Signed-off-by: Ruslan Kuprieiev <[email protected] [email protected] [email protected]
2019-04-15 21:03:22 +03:00
Ruslan Kuprieiev
a74e4226a1
Merge pull request #1820 from pared/1499
...
ignore: introduce .dvcignore
2019-04-15 17:43:21 +03:00
pared
c467ccebcb
ignore: introduce .dvcignore, apply when searching for stage files
2019-04-15 14:31:34 +02:00
pared
074b6eaa9e
test: move corrupted hardlink cache test test_repro -> test_run
2019-04-15 12:55:50 +02:00
pared
9049475412
test_repro: make cache use hardlink
2019-04-15 11:27:44 +02:00
pared
e505c38f20
cache: make reflink, copy default links
2019-04-15 11:27:44 +02:00
Mr. Outis
1cac81430e
tests: be paranoic with caplog
2019-04-11 14:09:02 -05:00
Ruslan Kuprieiev
4953110feb
Merge pull request #1855 from mroutis/fix-1614
...
config: allow cross-referenced remotes
2019-04-09 15:19:41 +03:00
Ruslan Kuprieiev
56b52cc9bf
checkout/remove: properly handle broken symlinks
...
Fixes #1856
Signed-off-by: Ruslan Kuprieiev <[email protected]
2019-04-09 14:09:54 +03:00
Mr. Outis
d355b1e66e
config: allow cross-referenced remotes
...
Close #1614
2019-04-08 22:10:03 -05:00
Mr. Outis
727bfd955e
version: privatize version.py methods and vars
2019-04-07 16:48:34 -05:00
Ruslan Kuprieiev
54f7b43aac
dvc: version: detect release
...
See failed release at [1]. Previously we used to look at TRAVIS_TAG env
var, but now we will try to detect release by matching current tag with
base version.
[1] https://travis-ci.com/iterative/dvc/builds/107365596
Signed-off-by: Ruslan Kuprieiev <[email protected]
2019-04-07 22:55:20 +03:00
Ruslan Kuprieiev
7c540da5c4
daemon: don't spawn recursively
...
Fixes #1803
Signed-off-by: Ruslan Kuprieiev <[email protected]
2019-04-07 20:12:23 +03:00
Mr. Outis
921b39dbfe
tests: use pytest caplog instead of custom mock
...
Close #1753
2019-04-06 20:35:30 -06:00
Ruslan Kuprieiev
6124a23138
Merge pull request #1831 from mroutis/fix-1824
...
dvc: refactor package versioning logic
2019-04-07 03:16:39 +03:00
Mr. Outis
b4d0d37ac8
dvc: refactor package versioning logic
...
- Use `version.py` to compute a dynamic version stored in `__version__`.
Version information was scattered across the source code
(`VERSION_BASE`, `VERSION`, `__version__`, and `version.py`).
- Read `__version__` from `setup.py` and **pin** it using custom
`build_py` command class.
This way, we can maintain consistancy between the build version
and the runtime one.
Also, this gives us the ability to run `setup.py` without depending on
on `dvc` itself.
Close #1824
2019-04-06 18:06:11 -06:00
Ruslan Kuprieiev
8ef5976ac8
add: check if output is local when generating stage name
...
When adding a remote file with
```
$ dvc add s3://bucket/path
```
it results in
```
Error: failed to add file - is local is not supported for s3
```
Signed-off-by: Ruslan Kuprieiev <[email protected]
2019-04-06 03:25:53 +03:00
Zhanibek
a5c04e9296
command: refactoring of _show function in diff.py
2019-04-05 15:02:28 +06:00
Zhanibek
fcca6aebe8
tests: add tests for CLI message output
2019-04-05 15:02:28 +06:00
Zhanibek
7b3790e701
repo: fix macros placement from dvc/scm to dvc/repo/diff
2019-04-05 15:02:28 +06:00
Zhanibek
e5d62187b3
tests: fix the test for dvc diff command
2019-04-05 15:02:28 +06:00
Zhanibek
c235850540
scm: change the order of dvc diff with one argument
...
Now the dvc diff reference command will return
the difference betweent from specified commit to current HEAD.
2019-04-05 15:02:28 +06:00
Zhanibek
5f68b8e5a0
dvc: replace keys in dictionary with macros in dvc/repo/diff.py
2019-04-05 15:02:28 +06:00
Zhanibek
44e2ff7f83
repo: change the returning value of repo.diff
...
repo.diff now returns list of dictionaries for each file/directory change
2019-04-05 15:02:28 +06:00
Zhanibek
23b420554f
dvc: change help output of diff command and minor fixes
2019-04-05 15:02:28 +06:00
Zhanibek
49dead0474
tests: add CmdDiff command line parsing test
2019-04-05 15:02:28 +06:00
Zhanibek
f0a9255ddb
tests: fix test_diff with new logic
2019-04-05 15:02:28 +06:00
Zhanibek
73b3b57200
test: change some test logic for test_diff.py
2019-04-05 15:02:28 +06:00
Zhanibek
3499c277ff
dvc: fix comment style
2019-04-05 15:02:28 +06:00
Zhanibek
c2639cfb3a
dvc: add support for dvc diff command
...
Some summary statistics regarding the folder/file.
How many files were added/deleted/modified. How size changed.
TO DO things:
1)To support for detecting diff after `dvc move`
command.
2)To add unit tests.
2019-04-05 15:02:28 +06:00
Ruslan Kuprieiev
aeff967a13
dvc: exclude persist when computing md5 for the stage
...
Fixes #1828
Signed-off-by: Ruslan Kuprieiev <[email protected]
2019-04-04 17:12:16 +03:00
Ruslan Kuprieiev
5d41763066
test: requirements: update pytest
2019-04-04 08:27:12 +03:00
Shao-Chun Ma
1a75866e72
metrics: automatic type detection ( #1809 )
...
Fixes #1553
2019-04-01 21:22:10 +03:00
Ruslan Kuprieiev
cbdb18ff8c
Merge pull request #1808 from puhoshville/issue-1760
...
cli: fix overwriting remotes in `dvc remote add`
2019-03-31 23:00:04 +03:00
Ruslan Kuprieiev
b21b55e479
Merge pull request #1817 from pared/1807
...
checkout: reset progress bar on checkout
2019-03-31 22:56:49 +03:00
pared
0f5216cb14
checkout: reset progress bar on checkout
2019-03-31 21:48:21 +02:00
Ruslan Kuprieiev
3794f364d8
status: properly handle STATUS_MISSING case
...
Signed-off-by: Ruslan Kuprieiev <[email protected]
2019-03-31 21:04:19 +03:00
Ruslan Kuprieiev and puhoshville
180b844f46
Update tests/test_remote.py
...
test_overwrite: fix case of none-zero result on initial stage
Co-Authored-By: puhoshville <[email protected]
2019-03-30 21:21:37 +09:00
Dmitrii Pukhov
06052a8f6a
cli: fix overwriting remotes in dvc remote add
...
Now dvc remote add requires user confirmation in case of overwriting of
an already existing remote.
Fixes #1760
2019-03-30 14:48:07 +09:00
Ruslan Kuprieiev
b3addbd283
Merge pull request #1733 from mroutis/fix-1716
...
metrics: shows formatted multiline metrics
2019-03-30 03:14:55 +02:00
Mr. Outis
298770efe9
metrics: shows formatted multiline metrics
...
Close #1716
2019-03-29 16:24:54 -07:00
Ruslan Kuprieiev
4c5cb7afae
checkout: reorganize "git checkout hint" exception
...
Signed-off-by: Ruslan Kuprieiev <[email protected]
2019-03-29 13:44:32 +02:00
Ruslan Kuprieiev
c03b1c1693
test: add tests for dvc tag
...
Signed-off-by: Ruslan Kuprieiev <[email protected]
2019-03-29 13:44:11 +02:00
Paweł Redzyński
6f9dac280f
stage: remove outs upon import ( #1796 )
...
* stage: remove outs upon import
* Update dvc/remote/local.py
Co-Authored-By: pared <[email protected]
2019-03-28 16:45:47 +02:00
Ruslan Kuprieiev
c48a5e99be
Merge pull request #1795 from ei-grad/fix-test-analytics
...
tests: fix for globally disabled analytics
2019-03-28 14:45:53 +02:00
Andrew Grigorev
e0bf7314a0
tests: fix for globally disabled analytics
2019-03-28 14:54:04 +03:00
pared
ace92cb422
repo: fix stages gathering for checkout
2019-03-28 12:13:39 +01:00
pared
bf68fbffec
run: make run respect persist flag
2019-03-27 13:28:53 +01:00
Ruslan Kuprieiev
35218a77ab
Merge pull request #1781 from puhoshville/fix-1038
...
cli: add pipeline show --tree
2019-03-26 17:21:33 +02:00
Ruslan Kuprieiev
b791e1f57b
Merge pull request #1782 from pared/1740
...
metrics: rename show, repro: display metrics
2019-03-26 13:10:46 +02:00
Paulo Olveira
Ruslan Kuprieiev
pared
Mr. Outis
Ruslan Kuprieiev
Zhanibek
Shao-Chun Ma
Andrew Grigorev