Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-02 07:18:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
4,911 Commits 7 Branches 579 Tags
22ed9cb5dc8e8f3a9e792311718db613552eeeb0
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ruslan Kuprieiev 430b9bbdc0 dvc: bump to 0.82.0 2020-01-19 20:04:41 +02:00
Ruslan Kuprieiev 7d65002bf0 Merge pull request #3178 from efiop/1843 
logger: remote: use lazy formatting
 2020-01-19 12:16:01 +02:00
Ruslan Kuprieiev 19acded31f logger: utils: fs: use lazy formatting 2020-01-19 11:53:29 +02:00
Ruslan Kuprieiev 65c0c7e60d logger: state: use lazy formatting 2020-01-19 11:53:29 +02:00
Ruslan Kuprieiev c2dae4b49c logger: remote: use lazy formatting 
Part of #1843

As our previous investigations showed, path stringification and stuff
like relpath are taking a very large chunk of time when working with
giant directories. This patch removes `format()`s and uses lazy
formatting provided by logger instead, so stuff like path_info is not
stringified until actually needed (e.g. on `-v`).
 2020-01-19 11:53:29 +02:00
Ruslan Kuprieiev 6f8ac0c1b1 logger: support {} formatting 2020-01-19 11:53:29 +02:00
Ruslan Kuprieiev 3987086275 Merge pull request #3169 from fabiosantoscode/feature/2963-dvc-pull-of-s3-remote-with-https-url 
pull: treat HTTP redirects without Location header as error
 2020-01-19 10:00:05 +02:00
Ruslan Kuprieiev 74c5af1a84 Merge pull request #3130 from jorgeorpinel/master 
api: better code documentation
 2020-01-19 09:05:52 +02:00
Ruslan Kuprieiev cf013576d4 Merge pull request #3120 from sharidas/no_remote_issue 
Fix import issue without remote config in the target
 2020-01-19 09:03:38 +02:00
Ruslan Kuprieiev 1fb79fa6e9 Merge pull request #3188 from mroutis/fix-3184 
completion: get --show-url
 2020-01-19 08:55:48 +02:00
Ruslan Kuprieiev 3c73e94b4e Merge pull request #3195 from mroutis/fix-boto3-import 
s3: import boto3 inside _copy instead of module level
 2020-01-19 08:29:52 +02:00
Ruslan Kuprieiev 7f5e4a9fe0 Merge pull request #3187 from iterative/pull-3186-restyled 
Restyle s3: copy large objects without chunking
 2020-01-17 20:38:36 +02:00
Ruslan Kuprieiev 4d49b6ba1d Merge pull request #3170 from pared/3105 
utils: resolve_output: normpath before extracting basename
 2020-01-17 12:41:25 +02:00
Ruslan Kuprieiev bdd1d61803 Merge pull request #3156 from skshetry/get-url-from-cache 
get: implement --show-url to display only url/path to remote
 2020-01-17 10:15:06 +02:00
Ruslan Kuprieiev 6ebd053c0f Merge pull request #3165 from mroutis/remove-py2-compat 
setup: remove py2 backports
 2020-01-17 04:28:22 +02:00
Ruslan Kuprieiev 422ff579f4 Merge pull request #3173 from casperdcl/snap-deploy 
minor comments
 2020-01-17 01:11:49 +02:00
Ruslan Kuprieiev 74bbc3bc04 Merge pull request #3135 from rxxg/master 
Perf improvement for file copies
 2020-01-16 18:46:58 +02:00
Ruslan Kuprieiev d081627501 Merge pull request #3150 from fabiosantoscode/feature/2959-status-of-imported-files 
status: implement support for imported files
 2020-01-16 17:11:31 +02:00
Ruslan Kuprieiev 1f1fb03138 Merge pull request #3142 from pared/remove_fixtures 
conftest: remove dvc_repo, erepo, git, git_erepo
 2020-01-16 13:20:45 +02:00
Ruslan Kuprieiev d160f83717 Merge pull request #3017 from pared/errno_24_message 
point to troubleshooting guide on too many open files error
 2020-01-16 12:56:14 +02:00
Ruslan Kuprieiev d1f172f332 Merge pull request #3158 from casperdcl/snap-deploy 
major deploy tidy
 2020-01-16 12:23:22 +02:00
Ruslan Kuprieiev 7d249d23e1 Merge pull request #3166 from mroutis/fix-3111 
api: identify local repos with os.path.exists
 2020-01-16 05:51:55 +02:00
Ruslan Kuprieiev 6753e7b1e6 Merge pull request #3133 from JIoJIaJIu/core_checksum 
remote: config checksum_jobs
 2020-01-15 23:36:33 +02:00
Ruslan Kuprieiev ed0bc38e15 Merge pull request #3163 from MaxRis/3162 
Fix gdrive multiple parents file list query
 2020-01-15 23:32:57 +02:00
Ruslan Kuprieiev d2f81da696 Merge pull request #3161 from efiop/pydrive2 
dvc: use pydrive2 instead of pydrive
 2020-01-15 20:34:25 +02:00
Ruslan Kuprieiev 97a29a1f7e dvc: use pydrive2 instead of pydrive 
PyDrive2 is our maintained fork.
 2020-01-15 19:13:29 +02:00
Ruslan Kuprieiev 0be0931fcd Merge pull request #3151 from efiop/3087 
import: don't forget to set rev_lock for git files
 2020-01-15 01:06:04 +02:00
Ruslan Kuprieiev 410a8f8aeb travis: don't deploy snap on PRs 2020-01-15 00:55:34 +02:00
Ruslan Kuprieiev 7d6ecd1ccb import: don't forget to set rev_lock for git files 
Related to #3087
 2020-01-15 00:38:55 +02:00
Ruslan Kuprieiev b9e221a49c Merge pull request #3145 from iterative/efiop-patch-1 
travis: build snap in parallel with other packages
 2020-01-14 20:29:51 +02:00
Ruslan Kuprieiev 42784816c3 Merge pull request #3149 from skshetry/refactor-remote 
test: use helper remotes in external repro
 2020-01-14 20:27:25 +02:00
Ruslan Kuprieiev fe6d51fa77 Merge pull request #3148 from skshetry/refactor-datacloud-clibase 
test: use helper remotes in child classes of TestDataCloudCLIBase
 2020-01-14 19:35:03 +02:00
Ruslan Kuprieiev b865a48b92 Merge pull request #3146 from pared/2896_fs_repo 
fs: tests: remove repo_dir
 2020-01-14 16:49:23 +02:00
Ruslan Kuprieiev 9c934c8abf Merge pull request #3147 from pared/2896_ssh_utils 
ssh: test: unit, utils: test: unit: remove repo_dir
 2020-01-14 16:38:08 +02:00
Ruslan Kuprieiev b0f83f1486 travis: deploy snap on tag or master 2020-01-14 16:28:03 +02:00
Ruslan Kuprieiev 6bd53273da Merge pull request #3143 from pared/2896_connection_unit 
connection: test: unit: remove repo_dir
 2020-01-14 16:25:11 +02:00
Ruslan Kuprieiev d5290e2a5c travis: build snap in parallel with other packages 2020-01-14 16:21:05 +02:00
Ruslan Kuprieiev 2d1e32748c Merge pull request #3136 from skshetry/refactor-remotes-inherit 
test: use helper remotes in TestCases
 2020-01-14 16:14:29 +02:00
Ruslan Kuprieiev 88fb097275 Merge pull request #3138 from pared/2896_repro_cmd 
tests: repro: unit: migrate to dir helpers
 2020-01-14 15:29:03 +02:00
Ruslan Kuprieiev 6869ee65e0 Merge pull request #3139 from pared/2896_run_cmd 
tests: run: unit: migrate to dir helpers
 2020-01-14 15:28:56 +02:00
Ruslan Kuprieiev 63a3c678cf Merge pull request #3141 from pared/2896_update_cmd 
update: tests: unit: migrate to dir helpers
 2020-01-14 15:28:47 +02:00
Ruslan Kuprieiev e7626b8500 Merge pull request #3140 from pared/2896_stage_unit 
stage: tests: unit: migrate to dir helpers
 2020-01-14 15:27:14 +02:00
Ruslan Kuprieiev 6781a534f9 Merge pull request #3137 from pared/2896_unit_local 
tests: local: unit: migrate to dir helpers
 2020-01-14 15:10:13 +02:00
Ruslan Kuprieiev 9cafef1fdd Merge pull request #3051 from efiop/2995 
metrics: introduce `diff`
 2020-01-14 14:18:40 +02:00
Ruslan Kuprieiev 482473aa69 dvc: bump to 0.81.3 2020-01-14 11:23:10 +02:00
Ruslan Kuprieiev f18bfdc674 setup: fix typo 2020-01-14 11:22:29 +02:00
Ruslan Kuprieiev 8da898d483 dvc: bump to 0.81.2 2020-01-14 11:15:36 +02:00
Ruslan Kuprieiev ebb0243e87 setup: rollback pydrive dep 
pypi doesn't allow direct github deps https://travis-ci.com/iterative/dvc/jobs/275282583
 2020-01-14 11:15:11 +02:00
Ruslan Kuprieiev 58cc31cbe4 Merge pull request #3134 from skshetry/refactor-local 
test: merge local related function in Local helper class
 2020-01-14 10:56:01 +02:00
Ruslan Kuprieiev a09bfaf9db dvc: bump to 0.81.1 2020-01-14 10:29:01 +02:00
Ruslan Kuprieiev 876b659c2c remote: config: add a comment about section existence check 
https://github.com/iterative/dvc/pull/3132#discussion_r366202037
 2020-01-14 10:27:29 +02:00
Ruslan Kuprieiev 69e91f2bf9 Merge pull request #3132 from mroutis/fix-3131 
remote: error out when modifying a non-existing remote
 2020-01-14 10:26:16 +02:00
Ruslan Kuprieiev 563f75ebf7 Merge pull request #3129 from mroutis/fix-version 
version: decode correctly commands output
 2020-01-14 10:20:12 +02:00
Ruslan Kuprieiev efa655ecf1 Merge pull request #3128 from skshetry/refactor-hdfs-gcp 
test: move hdfs and gcp functions into helper classes
 2020-01-14 10:16:57 +02:00
Ruslan Kuprieiev fe635a5040 dvc: bump to 0.81.0 2020-01-13 16:59:05 +02:00
Ruslan Kuprieiev 0ead08805e Merge pull request #3116 from efiop/2896-scm 
test: scm: convert to dir helpers
 2020-01-13 16:13:22 +02:00
Ruslan Kuprieiev 0710dc2453 Merge pull request #3114 from iterative/efiop-patch-2 
get: refactor handling of git files and git-only repos
 2020-01-13 15:38:27 +02:00
Ruslan Kuprieiev e9dee8a103 Merge pull request #3115 from efiop/2896 
test: get_url: convert to dir helpers
 2020-01-13 15:38:02 +02:00
Ruslan Kuprieiev 92f3f8a624 Merge pull request #3117 from efiop/2896-init 
test: init: convert to dir helpers
 2020-01-13 15:37:17 +02:00
Ruslan Kuprieiev 7d2fa8885a test: scm: convert to dir helpers 
Related to #2896
 2020-01-13 15:34:27 +02:00
Ruslan Kuprieiev e833fd22d3 Merge pull request #3118 from efiop/2896-external-repo 
tests: external_repo: convert to dir helpers
 2020-01-13 15:21:53 +02:00
Ruslan Kuprieiev af821444f7 get: remove unused var 2020-01-13 13:39:45 +02:00
Ruslan Kuprieiev 64431f8930 test: get_url: convert to dir helpers 
Related to #2896
 2020-01-13 13:34:33 +02:00
Ruslan Kuprieiev 3e3869ffd0 Merge pull request #3126 from pared/fix_import_help 
add space for import help text
 2020-01-13 12:52:45 +02:00
Ruslan Kuprieiev 2ab6860b90 Update tests/func/test_init.py 2020-01-13 11:25:37 +02:00
Ruslan Kuprieiev 028d30e22d Merge pull request #3123 from skshetry/refactor-ssh 
test: refactor ssh related functions in test helper classes
 2020-01-13 11:14:26 +02:00
Ruslan Kuprieiev 100dde1c9a Merge pull request #3101 from Suor/prepare-summon 
summon: fixes and dvcx prereq
 2020-01-13 10:51:27 +02:00
Ruslan Kuprieiev d831044cb6 tests: external_repo: convert to dir helpers 
Related to #2896
 2020-01-13 04:15:27 +02:00
Ruslan Kuprieiev 537a0af5f7 travis: update mac machine 2020-01-13 03:56:31 +02:00
Ruslan Kuprieiev 21c75502c5 test: init: convert to dir helpers 2020-01-12 06:07:21 +02:00
Ruslan Kuprieiev 5b5810e1c0 Merge pull request #3016 from efiop/3015 
gdrive: add support for teamDriveId
 2020-01-12 04:52:01 +02:00
Ruslan Kuprieiev a79f04a28c get: refactor handling of git files and git-only repos 2020-01-12 03:05:20 +02:00
Ruslan Kuprieiev f920afd5dd travis: fix aws config condition 
Close #3113
 2020-01-12 02:23:15 +02:00
Ruslan Kuprieiev 3e97886ccc Merge pull request #3076 from efiop/rwlock_sync 
rwlock: flush and fsync
 2020-01-12 01:35:13 +02:00
Ruslan Kuprieiev b7f9e7365d Merge pull request #3097 from fabiosantoscode/feature/3089-get-non-dvc-repositories 
get: handle non-DVC repositories
 2020-01-11 07:05:35 +02:00
Ruslan Kuprieiev 9e9f37e06a Merge pull request #3094 from pared/2896_run 
run: tests: migrate to dir helpers
 2020-01-11 05:36:07 +02:00
Ruslan Kuprieiev d6092c1c95 Merge pull request #3096 from pared/2896_state 
state: tests: migrate to dir helpers
 2020-01-11 05:35:32 +02:00
Ruslan Kuprieiev 62d0fa1afa Merge pull request #3100 from pared/2896_update 
update: tests: migrate to dir helpers
 2020-01-11 05:34:52 +02:00
Ruslan Kuprieiev 7f9bbd94a5 Merge pull request #3099 from pared/2896_stage 
stage: tests: migrate to dir helpers
 2020-01-11 05:33:39 +02:00
Ruslan Kuprieiev 5b85db3e04 Merge pull request #3104 from efiop/ssh_dir_out 
tests: remove redundant native ssh tests
 2020-01-11 05:20:21 +02:00
Ruslan Kuprieiev bc619f1c41 pyinstaller: remove Crypto hook 2020-01-11 04:55:34 +02:00
Ruslan Kuprieiev c064865c80 build: use build-requirements.txt 2020-01-11 04:55:34 +02:00
Ruslan Kuprieiev 795e4ce6b8 pyinstaller: delete oss hook 
It is already available in the standard hooks.
 2020-01-11 04:38:57 +02:00
Ruslan Kuprieiev 2a9d19f116 tests: use mocked ssh 2020-01-11 03:14:45 +02:00
Ruslan Kuprieiev f6a00f35ae ssh: fix bug in remove() 2020-01-11 03:14:45 +02:00
Ruslan Kuprieiev 8154c89c3f tests: remove redundant native ssh tests 
We already have mocked ones, which are more reliable as they use their
own paramiko server instead of relying on the sshd running on the test
machine. Native tests are also quite flaky and fail sometimes due to
network issues.
 2020-01-11 03:14:45 +02:00
Ruslan Kuprieiev 01103585d7 Merge pull request #3090 from mroutis/py3-system 
py3: use links from os module
 2020-01-11 02:45:10 +02:00
Ruslan Kuprieiev 84ec0d49a3 Merge pull request #3091 from pared/2896_repro 
repro: tests: migrate to dir helpers
 2020-01-10 18:38:30 +02:00
Ruslan Kuprieiev 90152ea8b8 Merge pull request #3053 from Suor/is-tracked 
dvc: optimize Git.is_tracked()
 2020-01-10 06:34:30 +02:00
Ruslan Kuprieiev 095464d851 Merge pull request #3093 from iterative/move-fs-utilities 
Move fs utilities to fs.py from __init__.py
 2020-01-09 17:25:58 +02:00
Ruslan Kuprieiev 238b4e8e7e Merge pull request #3072 from pared/2896_import_url 
import url: test: migrate to dir helpers
 2020-01-09 16:33:57 +02:00
Ruslan Kuprieiev 277d28c6cb Merge pull request #3083 from pared/2896_output 
output: tests: migrate to dir helpers
 2020-01-08 22:14:07 +02:00
Ruslan Kuprieiev 049367e475 Merge pull request #3034 from mroutis/remove-py2-comments 
py3: remove code related to py2 limitations
 2020-01-08 20:14:40 +02:00
Ruslan Kuprieiev 82cdce0934 Merge pull request #3086 from pared/2896_remote 
remote: test: migrate to dir helpers
 2020-01-08 19:16:30 +02:00
Ruslan Kuprieiev 27774705cf Merge pull request #3085 from pared/2896_pipeline 
pipeline: test: migrate to dir helpers
 2020-01-08 19:14:21 +02:00
Ruslan Kuprieiev 2966924e47 Merge pull request #3074 from pared/2896_install 
install: tests: migrate to dir helpers
 2020-01-08 06:20:19 +02:00
Ruslan Kuprieiev fb37cd0ab2 Merge pull request #3082 from efiop/reqs 
setup: get rid of py2 reqs
 2020-01-08 02:42:19 +02:00
Ruslan Kuprieiev e8b0e22a6b Merge pull request #3078 from mroutis/py3-logger 
py3: use format_exc instead of print_exception
 2020-01-08 01:27:07 +02:00
Ruslan Kuprieiev ee0a8fa92d Merge pull request #3075 from efiop/assert_stage 
rwlock: check that .dvc/lock is locked
 2020-01-08 00:44:32 +02:00
Ruslan Kuprieiev 249f6c5634 Merge pull request #3027 from Suor/status-noop 
ui: warn about ignored options for `dvc status` and a grammar fix
 2020-01-07 20:30:05 +02:00