Commit Graph
100 Commits
Author SHA1 Message Date
Ruslan Kuprieiev a42d4f2c90 dvc: bump to 0.82.3 2020-01-24 23:36:32 +02:00
Ruslan Kuprieiev 4d5faab19c Merge pull request #3213 from fabiosantoscode/feature/3121-push-no-remote-specified-hint
push: improve 'no remote specified' hint
2020-01-24 22:46:55 +02:00
Ruslan Kuprieiev 0bd0c7a61e Merge pull request #3232 from iterative/2865
Remove usage of google-api-python-client deps
2020-01-24 18:02:24 +02:00
Ruslan Kuprieiev c2def08551 Merge pull request #3228 from efiop/3107
install: post-checkout: run only on branches/tags
2020-01-24 17:02:53 +02:00
Ruslan Kuprieiev 4457df334b Merge pull request #3225 from pared/2647_no_cache_external_dir
remote: verify cache exists on dir checksum
2020-01-24 15:21:36 +02:00
Ruslan Kuprieiev a65b6c7a2b Merge pull request #3231 from pared/link_fixes
some doc link fixes
2020-01-24 13:33:16 +02:00
Ruslan Kuprieiev 6718622549 Merge pull request #3227 from Suor/git-pull
erepo: pull each time
2020-01-24 10:14:43 +02:00
Ruslan Kuprieiev 2f1224b27b setup: update pydrive2 version 2020-01-24 09:47:52 +02:00
Ruslan Kuprieiev a11b5f4377 install: post-checkout: run only on branches/tags
We shouldn't try to automatically checkout in detached HEAD state, as we
might break the rebase process.

Fixes #3107
2020-01-23 23:10:41 +02:00
Ruslan Kuprieiev 1bc39e7e99 dvc: bump to 0.82.2 2020-01-23 16:36:42 +02:00
Ruslan Kuprieiev 4f61932c71 Merge pull request #3224 from pared/fix_import_url_test
import-url: test: prevent in-repo testing
2020-01-23 15:59:20 +02:00
Ruslan Kuprieiev bbb3a831b5 Merge pull request #3216 from MaxRis/3157
Update Google Project credentials to run tests
2020-01-23 13:25:25 +02:00
Ruslan Kuprieiev 1a7eb8fdec Merge pull request #3222 from skshetry/fallback-external-repo
api: fallback to external_repo if not a DVC repository
2020-01-23 13:24:33 +02:00
Ruslan Kuprieiev a0419173ba Merge pull request #3088 from efiop/3080
dvc: add sanity checks for hard/symlinks
2020-01-23 11:48:19 +02:00
Ruslan Kuprieiev 49039968f7 Merge pull request #3208 from fabiosantoscode/feature/3198-remove-spy-method
tests: replace spy() with pytest-mock spy
2020-01-23 10:52:43 +02:00
Ruslan Kuprieiev ad6e58a457 Merge pull request #3223 from efiop/3107
hooks: checkout: fix incorrect dvc repo detection
2020-01-23 10:41:27 +02:00
Ruslan Kuprieiev f6f931be87 hooks: checkout: fix incorrect dvc repo detection
When running from non-root directory `git ls-files .dvc` will treat it
as a relative path to the current location, so if you run `git checkout`
from a directory that is not a git/dvc root, our hook will think that
it is being run in a non-dvc repo and will do nothing. To fix that, need
to use `--full-name` flag.
2020-01-23 10:21:26 +02:00
Ruslan Kuprieiev da6399dc3c Merge pull request #3220 from jorgeorpinel/master
get: copy edits aroud --show-url, "dvc", et al.
2020-01-23 09:14:00 +02:00
Ruslan Kuprieiev e9caa44b55 Merge pull request #3214 from jorgeorpinel/master
get/imp: update help output descriptions
2020-01-22 23:03:07 +02:00
Ruslan Kuprieiev 000c524983 Merge pull request #3212 from casperdcl/snap-deploy
another attempt at travis dpl snap
2020-01-22 21:01:56 +02:00
Ruslan Kuprieiev d863c46859 dvc: add sanity checks for hard/symlinks
Fixed #3080
2020-01-22 18:47:37 +02:00
Ruslan Kuprieiev b99c5e4aad Merge pull request #3211 from skshetry/fix-brancher-noscm
brancher: do not get tree if there's no revs
2020-01-22 14:09:53 +02:00
Ruslan Kuprieiev d2d887bb50 Merge pull request #3200 from pared/2676_trust_checksum
fetch: trust remote checksums
2020-01-22 12:36:29 +02:00
Ruslan Kuprieiev d942542c84 tests: fix index.remove misuse 2020-01-22 10:53:48 +02:00
Ruslan Kuprieiev a99fa4e4e5 Merge pull request #3209 from casperdcl/snap-deploy
fix snap stable & edge release errors
2020-01-22 08:26:02 +02:00
Ruslan Kuprieiev aa86eab2cc Merge pull request #3206 from Suor/tests
test: add git_dir
2020-01-21 20:19:35 +02:00
Ruslan Kuprieiev 6958901d98 Merge pull request #3204 from efiop/3087
erepo: fix DependencyREPO schema
2020-01-21 15:31:22 +02:00
Ruslan Kuprieiev cb64491512 build: don't upgrade pip 2020-01-21 14:41:59 +02:00
Ruslan Kuprieiev 8d8a1c0f0c travis: don't upgrade pip 2020-01-21 14:14:54 +02:00
Ruslan Kuprieiev 7c9e0345a0 Merge pull request #3205 from skshetry/fix-spell
exception: fix spelling
2020-01-21 13:56:59 +02:00
Ruslan Kuprieiev 2305549460 erepo: fix DependencyREPO schema
URL should be required and rev or rev_lock should be optional.

Related to #3087
2020-01-21 12:58:33 +02:00
Ruslan Kuprieiev 10a7b9d9a8 readme: add a release label
To avoid accidentally looking like an unstable project.
2020-01-21 10:03:16 +02:00
Ruslan Kuprieiev 04161ad6f2 dvc: bump to 0.82.1 2020-01-21 00:41:45 +02:00
Ruslan Kuprieiev 503401dde5 Merge pull request #3202 from efiop/flatten
dvc: replace flatten_dict with flatten_json
2020-01-21 00:38:19 +02:00
Ruslan Kuprieiev 81029f8f75 Merge pull request #3201 from efiop/traverse_gdrive
gdrive: allow configuring no_traverse
2020-01-21 00:19:11 +02:00
Ruslan Kuprieiev 1eb82ac707 dvc: replace flatten_dict with flatten_json
flatten_json has a conda package, while flatten_dict doesn't and I'm not
willing to maintain yet another conda package :)
2020-01-21 00:14:22 +02:00
Ruslan Kuprieiev e848bcb9d6 gdrive: allow configuring no_traverse 2020-01-20 23:49:49 +02:00
Ruslan Kuprieiev 39bf7c0d43 Merge pull request #3199 from skshetry/remove-use-six
py2: remove use of `six`
2020-01-20 19:19:23 +02:00
Ruslan Kuprieiev 0be5046a72 Merge pull request #3197 from Suor/refactor-tmpdir
test: refactor tmp_dir/erepo_dir
2020-01-20 16:02:13 +02:00
Ruslan Kuprieiev b2b3587c0b Merge pull request #3190 from Suor/refactor-erepo
external: refactor external_repo() and its users
2020-01-20 14:49:36 +02:00
Ruslan Kuprieiev ec2c8ad8bc Merge pull request #2956 from casperdcl/snap
add snap tests
2020-01-19 21:36:47 +02:00
Ruslan Kuprieiev 430b9bbdc0 dvc: bump to 0.82.0 2020-01-19 20:04:41 +02:00
Ruslan Kuprieiev 7d65002bf0 Merge pull request #3178 from efiop/1843
logger: remote: use lazy formatting
2020-01-19 12:16:01 +02:00
Ruslan Kuprieiev 19acded31f logger: utils: fs: use lazy formatting 2020-01-19 11:53:29 +02:00
Ruslan Kuprieiev 65c0c7e60d logger: state: use lazy formatting 2020-01-19 11:53:29 +02:00
Ruslan Kuprieiev c2dae4b49c logger: remote: use lazy formatting
Part of #1843

As our previous investigations showed, path stringification and stuff
like relpath are taking a very large chunk of time when working with
giant directories. This patch removes `format()`s and uses lazy
formatting provided by logger instead, so stuff like path_info is not
stringified until actually needed (e.g. on `-v`).
2020-01-19 11:53:29 +02:00
Ruslan Kuprieiev 6f8ac0c1b1 logger: support {} formatting 2020-01-19 11:53:29 +02:00
Ruslan Kuprieiev 3987086275 Merge pull request #3169 from fabiosantoscode/feature/2963-dvc-pull-of-s3-remote-with-https-url
pull: treat HTTP redirects without Location header as error
2020-01-19 10:00:05 +02:00
Ruslan Kuprieiev 74c5af1a84 Merge pull request #3130 from jorgeorpinel/master
api: better code documentation
2020-01-19 09:05:52 +02:00
Ruslan Kuprieiev cf013576d4 Merge pull request #3120 from sharidas/no_remote_issue
Fix import issue without remote config in the target
2020-01-19 09:03:38 +02:00
Ruslan Kuprieiev 1fb79fa6e9 Merge pull request #3188 from mroutis/fix-3184
completion: get --show-url
2020-01-19 08:55:48 +02:00
Ruslan Kuprieiev 3c73e94b4e Merge pull request #3195 from mroutis/fix-boto3-import
s3: import boto3 inside _copy instead of module level
2020-01-19 08:29:52 +02:00
Ruslan Kuprieiev 7f5e4a9fe0 Merge pull request #3187 from iterative/pull-3186-restyled
Restyle s3: copy large objects without chunking
2020-01-17 20:38:36 +02:00
Ruslan Kuprieiev 4d49b6ba1d Merge pull request #3170 from pared/3105
utils: resolve_output: normpath before extracting basename
2020-01-17 12:41:25 +02:00
Ruslan Kuprieiev bdd1d61803 Merge pull request #3156 from skshetry/get-url-from-cache
get: implement --show-url to display only url/path to remote
2020-01-17 10:15:06 +02:00
Ruslan Kuprieiev 6ebd053c0f Merge pull request #3165 from mroutis/remove-py2-compat
setup: remove py2 backports
2020-01-17 04:28:22 +02:00
Ruslan Kuprieiev 422ff579f4 Merge pull request #3173 from casperdcl/snap-deploy
minor comments
2020-01-17 01:11:49 +02:00
Ruslan Kuprieiev 74bbc3bc04 Merge pull request #3135 from rxxg/master
Perf improvement for file copies
2020-01-16 18:46:58 +02:00
Ruslan Kuprieiev d081627501 Merge pull request #3150 from fabiosantoscode/feature/2959-status-of-imported-files
status: implement support for imported files
2020-01-16 17:11:31 +02:00
Ruslan Kuprieiev 1f1fb03138 Merge pull request #3142 from pared/remove_fixtures
conftest: remove dvc_repo, erepo, git, git_erepo
2020-01-16 13:20:45 +02:00
Ruslan Kuprieiev d160f83717 Merge pull request #3017 from pared/errno_24_message
point to troubleshooting guide on too many open files error
2020-01-16 12:56:14 +02:00
Ruslan Kuprieiev d1f172f332 Merge pull request #3158 from casperdcl/snap-deploy
major deploy tidy
2020-01-16 12:23:22 +02:00
Ruslan Kuprieiev 7d249d23e1 Merge pull request #3166 from mroutis/fix-3111
api: identify local repos with os.path.exists
2020-01-16 05:51:55 +02:00
Ruslan Kuprieiev 6753e7b1e6 Merge pull request #3133 from JIoJIaJIu/core_checksum
remote: config checksum_jobs
2020-01-15 23:36:33 +02:00
Ruslan Kuprieiev ed0bc38e15 Merge pull request #3163 from MaxRis/3162
Fix gdrive multiple parents file list query
2020-01-15 23:32:57 +02:00
Ruslan Kuprieiev d2f81da696 Merge pull request #3161 from efiop/pydrive2
dvc: use pydrive2 instead of pydrive
2020-01-15 20:34:25 +02:00
Ruslan Kuprieiev 97a29a1f7e dvc: use pydrive2 instead of pydrive
PyDrive2 is our maintained fork.
2020-01-15 19:13:29 +02:00
Ruslan Kuprieiev 0be0931fcd Merge pull request #3151 from efiop/3087
import: don't forget to set rev_lock for git files
2020-01-15 01:06:04 +02:00
Ruslan Kuprieiev 410a8f8aeb travis: don't deploy snap on PRs 2020-01-15 00:55:34 +02:00
Ruslan Kuprieiev 7d6ecd1ccb import: don't forget to set rev_lock for git files
Related to #3087
2020-01-15 00:38:55 +02:00
Ruslan Kuprieiev b9e221a49c Merge pull request #3145 from iterative/efiop-patch-1
travis: build snap in parallel with other packages
2020-01-14 20:29:51 +02:00
Ruslan Kuprieiev 42784816c3 Merge pull request #3149 from skshetry/refactor-remote
test: use helper remotes in external repro
2020-01-14 20:27:25 +02:00
Ruslan Kuprieiev fe6d51fa77 Merge pull request #3148 from skshetry/refactor-datacloud-clibase
test: use helper remotes in child classes of TestDataCloudCLIBase
2020-01-14 19:35:03 +02:00
Ruslan Kuprieiev b865a48b92 Merge pull request #3146 from pared/2896_fs_repo
fs: tests: remove repo_dir
2020-01-14 16:49:23 +02:00
Ruslan Kuprieiev 9c934c8abf Merge pull request #3147 from pared/2896_ssh_utils
ssh: test: unit, utils: test: unit: remove repo_dir
2020-01-14 16:38:08 +02:00
Ruslan Kuprieiev b0f83f1486 travis: deploy snap on tag or master 2020-01-14 16:28:03 +02:00
Ruslan Kuprieiev 6bd53273da Merge pull request #3143 from pared/2896_connection_unit
connection: test: unit: remove repo_dir
2020-01-14 16:25:11 +02:00
Ruslan Kuprieiev d5290e2a5c travis: build snap in parallel with other packages 2020-01-14 16:21:05 +02:00
Ruslan Kuprieiev 2d1e32748c Merge pull request #3136 from skshetry/refactor-remotes-inherit
test: use helper remotes in TestCases
2020-01-14 16:14:29 +02:00
Ruslan Kuprieiev 88fb097275 Merge pull request #3138 from pared/2896_repro_cmd
tests: repro: unit: migrate to dir helpers
2020-01-14 15:29:03 +02:00
Ruslan Kuprieiev 6869ee65e0 Merge pull request #3139 from pared/2896_run_cmd
tests: run: unit: migrate to dir helpers
2020-01-14 15:28:56 +02:00
Ruslan Kuprieiev 63a3c678cf Merge pull request #3141 from pared/2896_update_cmd
update: tests: unit: migrate to dir helpers
2020-01-14 15:28:47 +02:00
Ruslan Kuprieiev e7626b8500 Merge pull request #3140 from pared/2896_stage_unit
stage: tests: unit: migrate to dir helpers
2020-01-14 15:27:14 +02:00
Ruslan Kuprieiev 6781a534f9 Merge pull request #3137 from pared/2896_unit_local
tests: local: unit: migrate to dir helpers
2020-01-14 15:10:13 +02:00
Ruslan Kuprieiev 9cafef1fdd Merge pull request #3051 from efiop/2995
metrics: introduce `diff`
2020-01-14 14:18:40 +02:00
Ruslan Kuprieiev 482473aa69 dvc: bump to 0.81.3 2020-01-14 11:23:10 +02:00
Ruslan Kuprieiev f18bfdc674 setup: fix typo 2020-01-14 11:22:29 +02:00
Ruslan Kuprieiev 8da898d483 dvc: bump to 0.81.2 2020-01-14 11:15:36 +02:00
Ruslan Kuprieiev ebb0243e87 setup: rollback pydrive dep
pypi doesn't allow direct github deps https://travis-ci.com/iterative/dvc/jobs/275282583
2020-01-14 11:15:11 +02:00
Ruslan Kuprieiev 58cc31cbe4 Merge pull request #3134 from skshetry/refactor-local
test: merge local related function in Local helper class
2020-01-14 10:56:01 +02:00
Ruslan Kuprieiev a09bfaf9db dvc: bump to 0.81.1 2020-01-14 10:29:01 +02:00
Ruslan Kuprieiev 876b659c2c remote: config: add a comment about section existence check
https://github.com/iterative/dvc/pull/3132#discussion_r366202037
2020-01-14 10:27:29 +02:00
Ruslan Kuprieiev 69e91f2bf9 Merge pull request #3132 from mroutis/fix-3131
remote: error out when modifying a non-existing remote
2020-01-14 10:26:16 +02:00
Ruslan Kuprieiev 563f75ebf7 Merge pull request #3129 from mroutis/fix-version
version: decode correctly commands output
2020-01-14 10:20:12 +02:00
Ruslan Kuprieiev efa655ecf1 Merge pull request #3128 from skshetry/refactor-hdfs-gcp
test: move hdfs and gcp functions into helper classes
2020-01-14 10:16:57 +02:00
Ruslan Kuprieiev fe635a5040 dvc: bump to 0.81.0 2020-01-13 16:59:05 +02:00
Ruslan Kuprieiev 0ead08805e Merge pull request #3116 from efiop/2896-scm
test: scm: convert to dir helpers
2020-01-13 16:13:22 +02:00
Ruslan Kuprieiev 0710dc2453 Merge pull request #3114 from iterative/efiop-patch-2
get: refactor handling of git files and git-only repos
2020-01-13 15:38:27 +02:00
Ruslan Kuprieiev e9dee8a103 Merge pull request #3115 from efiop/2896
test: get_url: convert to dir helpers
2020-01-13 15:38:02 +02:00
Ruslan Kuprieiev 92f3f8a624 Merge pull request #3117 from efiop/2896-init
test: init: convert to dir helpers
2020-01-13 15:37:17 +02:00