Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-07 07:18:27 +01:00
Code Issues Packages Projects Releases Wiki Activity
4,931 Commits 7 Branches 579 Tags
0.82.1
Commit Graph
4931 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ruslan Kuprieiev 04161ad6f2 dvc: bump to 0.82.1 0.82.1 2020-01-21 00:41:45 +02:00
Ruslan Kuprieiev 503401dde5 Merge pull request #3202 from efiop/flatten 
dvc: replace flatten_dict with flatten_json
 2020-01-21 00:38:19 +02:00
Ruslan Kuprieiev 81029f8f75 Merge pull request #3201 from efiop/traverse_gdrive 
gdrive: allow configuring no_traverse
 2020-01-21 00:19:11 +02:00
Ruslan Kuprieiev 1eb82ac707 dvc: replace flatten_dict with flatten_json 
flatten_json has a conda package, while flatten_dict doesn't and I'm not
willing to maintain yet another conda package :)
 2020-01-21 00:14:22 +02:00
Ruslan Kuprieiev e848bcb9d6 gdrive: allow configuring no_traverse 2020-01-20 23:49:49 +02:00
Ruslan Kuprieiev 39bf7c0d43 Merge pull request #3199 from skshetry/remove-use-six 
py2: remove use of `six`
 2020-01-20 19:19:23 +02:00
Saugat Pachhai 8dd2dbb46e py2: remove use of six 2020-01-20 21:47:56 +05:45
Ruslan Kuprieiev 0be5046a72 Merge pull request #3197 from Suor/refactor-tmpdir 
test: refactor tmp_dir/erepo_dir
 2020-01-20 16:02:13 +02:00
Alexander Schepanovski 91e024c8fa test: do not commit copy.py to git 2020-01-20 20:35:10 +07:00
Ruslan Kuprieiev b2b3587c0b Merge pull request #3190 from Suor/refactor-erepo 
external: refactor external_repo() and its users
 2020-01-20 14:49:36 +02:00
Alexander Schepanovski 1d891a6e77 test: provide make_tmp_dir fixture 2020-01-20 11:57:54 +07:00
Alexander Schepanovski 4117206c67 test: drop repo_template fixture 2020-01-20 11:49:13 +07:00
Ruslan Kuprieiev ec2c8ad8bc Merge pull request #2956 from casperdcl/snap 
add snap tests
 2020-01-19 21:36:47 +02:00
Casper da Costa-Luis f80626b5d0 recompress conditional snap channel 2020-01-19 19:10:25 +00:00
Casper da Costa-Luis de358d661a explicitly spilt snap stable/edge deployments 
- (re) fix #3152
 2020-01-19 19:10:05 +00:00
Casper da Costa-Luis 22ed9cb5dc Remove travis-incompatible tests 
- reverts
  + 205077e3a0.
  + 46e0616614.
 2020-01-19 18:27:59 +00:00
Casper da Costa-Luis 205077e3a0 debugging 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis 2fe9b3a967 connectivity debugging 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis 5ac849377a minor comment update 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis 0a0b4e019e debugging 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis d020c3d8b0 test snaps even where tag is undefined 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis b756f77787 revert whitespace changes, but keep stderr errors 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis 46e0616614 promote snap tests for debugging 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis 39ef3dba1a add snap tests 
- fixes #2954
 2020-01-19 18:17:16 +00:00
Ruslan Kuprieiev 430b9bbdc0 dvc: bump to 0.82.0 0.82.0 2020-01-19 20:04:41 +02:00
Alexander Schepanovski 72812b519e api: fix get_url() non-dvc repo error message 2020-01-19 23:01:53 +07:00
Alexander Schepanovski eb97e0b393 external: do not fail with no remote if cache is available 2020-01-19 21:39:32 +07:00
Alexander Schepanovski ee022eada0 api: adjust get_url requiring dvc repo to the new reality 2020-01-19 21:38:37 +07:00
Alexander Schepanovski 9de0643d97 api: allow rev on local repos 2020-01-19 21:38:30 +07:00
Alexander Schepanovski 033ef88a4e external: refactor external_repo() and its users 
Some things are fixed along the way:
- no cache shared between incompatible funcs
- some incosistent exceptions are now consistent
- import updates for git files now works both for dvc and git repos
- "auto-generated-upstream already exists" fixed
- dvc.api.open()/read() works with git repos now

Fixes #3124, #2976. Closes #3172.
 2020-01-19 21:38:06 +07:00
Ruslan Kuprieiev 7d65002bf0 Merge pull request #3178 from efiop/1843 
logger: remote: use lazy formatting
 2020-01-19 12:16:01 +02:00
Ruslan Kuprieiev 19acded31f logger: utils: fs: use lazy formatting 2020-01-19 11:53:29 +02:00
Ruslan Kuprieiev 65c0c7e60d logger: state: use lazy formatting 2020-01-19 11:53:29 +02:00
Ruslan Kuprieiev c2dae4b49c logger: remote: use lazy formatting 
Part of #1843

As our previous investigations showed, path stringification and stuff
like relpath are taking a very large chunk of time when working with
giant directories. This patch removes `format()`s and uses lazy
formatting provided by logger instead, so stuff like path_info is not
stringified until actually needed (e.g. on `-v`).
 2020-01-19 11:53:29 +02:00
Ruslan Kuprieiev 6f8ac0c1b1 logger: support {} formatting 2020-01-19 11:53:29 +02:00
Ruslan Kuprieiev 3987086275 Merge pull request #3169 from fabiosantoscode/feature/2963-dvc-pull-of-s3-remote-with-https-url 
pull: treat HTTP redirects without Location header as error
 2020-01-19 10:00:05 +02:00
Ruslan Kuprieiev 74c5af1a84 Merge pull request #3130 from jorgeorpinel/master 
api: better code documentation
 2020-01-19 09:05:52 +02:00
Ruslan Kuprieiev cf013576d4 Merge pull request #3120 from sharidas/no_remote_issue 
Fix import issue without remote config in the target
 2020-01-19 09:03:38 +02:00
Ruslan Kuprieiev 1fb79fa6e9 Merge pull request #3188 from mroutis/fix-3184 
completion: get --show-url
 2020-01-19 08:55:48 +02:00
Ruslan Kuprieiev 3c73e94b4e Merge pull request #3195 from mroutis/fix-boto3-import 
s3: import boto3 inside _copy instead of module level
 2020-01-19 08:29:52 +02:00
Sujith H 1b7eda2745 Fix import issue without remote config in the target 
Fix the import issue when target does not have
remote config.

Signed-off-by: Sujith H <[email protected]>
 2020-01-19 11:42:05 +05:30
Mr. Outis de1de68f90 s3: import boto3 inside _copy instead of module level 
Kudos to @skshetry for bringing this out during a review
 2020-01-18 23:01:50 -06:00
Mr. Outis 6ad55ec3b0 completion: get --show-url 2020-01-17 18:50:08 -06:00
Jorge Orpinel 2b818e203f api: note get_url doesn't chekc file existence 
per https://github.com/iterative/dvc/pull/3130#discussion_r367359439
 2020-01-17 17:40:02 -06:00
Jorge Orpinel 4d05ad2789 Merge branch 'master' of github.com:iterative/dvc 2020-01-17 17:39:51 -06:00
Ruslan Kuprieiev 7f5e4a9fe0 Merge pull request #3187 from iterative/pull-3186-restyled 
Restyle s3: copy large objects without chunking
 2020-01-17 20:38:36 +02:00
Restyled.io c3628c87d5 Restyled by black 2020-01-17 18:00:19 +00:00
Andy Sarroff 0bd433d153 s3: copy large objects without chunking 
When executing `boto3.s3.Client.Copy`, large files are chunked into
multiple parts. The default chunk threshold and size is 8MB. This
caused an issue when caching an object larger than 8M, where the
original object had not been uploaded in multiple parts. The original
object and the cached object would have different ETags, causing an
exception. This fixes the issue by dynamically setting the chunk
threshold to be one byte larger than the size of the original object
therefore avoiding multipart copies.

Fixes #3174
 2020-01-17 12:00:42 -05:00
Ruslan Kuprieiev 4d49b6ba1d Merge pull request #3170 from pared/3105 
utils: resolve_output: normpath before extracting basename
 2020-01-17 12:41:25 +02:00
Paweł Redzyński cf08529362 utils: add tests for resolve out 2020-01-17 09:51:07 +01:00