Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-02 07:18:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
5,391 Commits 7 Branches 579 Tags
6a406abde8bc7a2e8b9d200483463a9268fd3263
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Casper da Costa-Luis 2bb7257a06 lint: isort pre-commit & misc improvements (#3749) 
* test: clean flake8 config root clutter

* test: pre-commit: add isort

Compatible with black (see https://github.com/timothycrosley/isort/issues/694)

* lint: reorder imports

* lint: more complex imports

* lint: fix deepsource

* config: isort: add first party dvc

* tests: restyled: add isort

* temp commit to revert before merge

* Revert "temp commit to revert before merge"

This reverts commit 11db0fd8e95fe891597cbb9bf804480909b19e24.
 2020-05-06 23:56:07 +03:00
Casper da Costa-Luis 26e203242f gdrive: download: stream & add progress (#3722) 
* wip

* gdrive: add progress

Part of #2865
See https://github.com/iterative/dvc/issues/2865#issuecomment-622984785

* gdrive: move towards next pydrive2 release

- depends on https://github.com/iterative/PyDrive2/pull/30

* update to latest pydrive>=1.4.11

* avoid unneeded API call

* progress: gdrive: ensure proper bar_format
 2020-05-06 17:02:16 +03:00
Casper da Costa-Luis 795f001929 Snap version (#3741) 
* snap: potential build fix

* snap: fix travis
 2020-05-05 12:48:19 +03:00
Casper da Costa-Luis c873787d73 progress: add postfix info to avoid overwriting desc (#3721) 
* progress: persist primary description

Move subsequent updates to a postfix.
Clear postfix on exit.
TODO: align nicely.
Fixes #3681.

* progress: move to posfix[info] for full control

It was bound to happen.

* progress: git: persist description
 2020-05-02 18:07:05 +03:00
Casper da Costa-LuisRuslan KuprieievRuslan Kuprieiev
 		b312895e77 progress: add main bars (#3594) 
* progress: add main push/pull bar

Fixes #3452
Related #1840
Related #3565

* adjust desc

* fix merge

Co-authored-by: Ruslan Kuprieiev <[email protected]>
Co-authored-by: Ruslan Kuprieiev <[email protected]>
 2020-04-25 22:04:47 +03:00
Casper da Costa-Luis f0c81bcef5 scm: git: clone: add progress (#3595) 
* scm: git: clone: add progress

* git: add progress desc

* wip

* git: tidy message
 2020-04-17 23:07:22 +03:00
Casper da Costa-Luis e05157f8e0 completion: bash: fix files (#3613) 
Fixes lock, metrics and move autocompletion of files
 2020-04-10 10:02:40 +03:00
Casper da Costa-Luis b9d560c584 progress: better threading (#3583) 
Fixes #3565
Continues #3500 <- #2905
 2020-04-02 22:10:15 +01:00
Casper da Costa-Luis 617014ffbb snap: deploy: fix authentication (#3551) 
Fixes #3550
 2020-03-29 22:45:11 +03:00
Casper da Costa-Luis eeb6b60fe6 progress: limit maximum running bars (#3500) 
* progress: limit maximum running bars

Fixes #2905
Closes #3453

* progress: add hidden message for overflow bars

* progress: fix nested bars properly

Just use latest `tqdm` :)
 2020-03-29 20:54:32 +03:00
Casper da Costa-Luis 1ff4706f3a deploy: snap: timeout after 10 min (#3547) 
Because `snapcraft push` hangs on cloud CI.
Imagine if `git push` did the same!
 2020-03-29 16:33:51 +03:00
Casper da Costa-Luis af6c4291b9 progress: wrappers (#3522) 
* progress: add wrap_fn

Closes #3521
Related https://github.com/tqdm/tqdm/issues/583

* progress: use wrappers in more places
 2020-03-27 22:17:34 +02:00
Casper da Costa-Luis f69cb7a902 path_info: HTTPURLInfo minor inheritance tweak (#3502) 
* path_info: HTTPURLInfo minor inheritance tweak

* path_info: rename `fill_parts` => `_fill_parts`
 2020-03-26 17:35:47 +02:00
Casper da Costa-Luis f19d800f43 import-url: allow queries in URL (#3432) 
* import-url: allow queries in URL

Fixes #3424

* Revert "import-url: allow queries in URL"

This reverts commit 48495d027963073fe260f596d85c3c179fee037f.

* path_info: add HTTPURLInfo base

* path_info: HTTPURLInfo complete

* remote: http(s): support params, queries, fragments

Fixes #3424
Closes #3432

* tests: path_info: HTTPURLInfo

* lint

* tests: path_info: HTTPURLInfo

Slightly more thorough testing
 2020-03-17 19:23:56 +02:00
Casper da Costa-LuisandJorge Orpinel 137373c165 template: pr update (#3495) 
* template: pr update

* Update .github/PULL_REQUEST_TEMPLATE.md

* Update .github/PULL_REQUEST_TEMPLATE.md

* Update .github/PULL_REQUEST_TEMPLATE.md

Co-authored-by: Jorge Orpinel <[email protected]>
 2020-03-17 19:18:25 +02:00
Casper da Costa-Luis 7923446219 completion: bash: misc fixes and updates (#3467) 
* completion: bash: fix, update and sort

* completion: bash: fix missing `compgen`s

* completion: bash: remove deprecated/hidden options

* completion: bash: fix extra parenthesis

- fixes metrics show -t

* completion: bash: re-add `gc --all-commits`

Due to #3429 superceding #2681
 2020-03-11 15:56:20 +02:00
Casper da Costa-Luis 35a6e0fedd docs: update badges (#3380) 
* docs: add and update badges

Add |Choco|
Add |Brew|
Fix style for |Conda|
Add |PyPI|
Add |Packages|
Fixes #3233
Related https://github.com/iterative/dvc.org/issues/904

* docs: add badge logos

* docs: minor badge tidy

* docs: add choco install, add OS, update order
 2020-02-28 01:32:10 +02:00
Casper da Costa-Luis 68a2f34a46 pull: fetch: external: respect jobs (#3413) 
Fixes #3396
 2020-02-26 22:35:19 +02:00
Casper da Costa-Luis 411057d1b4 completion: bash: properly recurse targets (#3374) 
* completion: bash: properly recurse commands

TODO: subcommands

* completion: bash: add subcommand path completion

* completion: bash: comments
 2020-02-21 04:03:23 +02:00
Casper da Costa-Luis ae99e1b02b metadata: add Zenodo, tidy badges and keywords (#3373) 
* docs: add Zenodo badge

* docs: fix rst image syntax

* docs: collect and re-use badges

* metadata: add zenodo

Fixes #2978

* metadata: sync keywords

* docs: add citation in readme

* docs: one-line badges
 2020-02-21 04:01:59 +02:00
Casper da Costa-Luis 2820aedb87 completion: bash: allow multi-arg completion, minor tidy (#3367) 2020-02-19 23:41:48 +02:00
Casper da Costa-Luis a9161af593 Fix bash completion (#3360) 
* completion: safer function names

* completion: fix missing expansions

Fixes #1923

* complete: bash: all filenames

* complete: bash: DVC-files

* complete: bash: safer and quicker opts
 2020-02-19 04:16:09 +02:00
Casper da Costa-Luis 37de65fe48 ui: fix missing progress & tidy (#3335) 
* ui: show missing progress

Fixes #3332

* ui: more verbose progress

* remote: base: back to no_progres_bar=True
 2020-02-19 04:08:29 +02:00
Casper da Costa-Luis 276a2b02a3 ui: make progress bars respect --quiet (#3316) 
* ui: default no_progress_bar=None instead of False

Fixes #3314

* ui: catch remaining missing auto-quiet progress

* progress: treat disable=False as None

* test: progress.Tqdm(disable=False)

* revert no_progress_bar=None <= False

partially reverts e0342a8641f0101d
 2020-02-15 00:53:52 +02:00
Casper da Costa-Luis 6932cf6c8d snap: test: add build and deploy checks (#3330) 
* snap: deploy: include review-tools

Enables pre-deployment checks

* snap: build: include snapd

Enables enhanced build-time checks
 2020-02-14 19:05:23 +02:00
Casper da Costa-Luis 3d5b8ecdd5 add: auto convert absolute_path => relative (#2975) 
* add: auto convert absolute_path => relative

- fixes #2955

* use path_isin

* catch-all absolute paths in repo

* unneeded leftover

* revert realtive imports for later

* output: move abs2relpath from Base to Local

* output:local:fix parse_path

* remove path_info

* test:local versus base abs2relpath

* test:fix remaining abs2relpath test

* output: local path relative to wdir

* output: local: modify path before inheritance

* output: local: minor inheritance fix

* test: local: split output test

* test: local: positively explicit
 2020-02-10 18:35:24 +02:00
Casper da Costa-Luis b0b69ce819 lint/pre-commit/ci: replace shfmt => beautysh 2020-01-31 19:14:51 +00:00
Casper da Costa-Luis 4e87bf9e0e try beautysh 2020-01-31 19:07:53 +00:00
Casper da Costa-Luis 0f13f47269 ci:fix silly go check 2020-01-30 23:42:29 +00:00
Casper da Costa-Luis 605c4af9c6 ci:split checks into py & go jobs 2020-01-30 23:37:53 +00:00
Casper da Costa-Luis cf257f9617 ci:still try to use go 2020-01-30 23:25:57 +00:00
Casper da Costa-Luis 493a340531 ci:attempt python=>go for checks 2020-01-30 23:17:59 +00:00
Casper da Costa-Luis 7a9512d02e ci:fix go version 2020-01-30 22:55:19 +00:00
Casper da Costa-Luis 2734f49b9e ci:check:fix go install 2020-01-30 22:50:41 +00:00
Casper da Costa-Luis 22dd0d47eb lint:pre-commit shfmt defaults 2020-01-30 22:40:56 +00:00
Casper da Costa-Luis f8c01e7fb3 lint:pre-commit shfmt hook 2020-01-30 22:37:31 +00:00
Casper da Costa-Luis 98d2ca00c0 lint: shfmt with -ci 2020-01-30 22:35:48 +00:00
Casper da Costa-Luis 10c5103ed7 lint: run shfmt -i 2 2020-01-30 22:26:49 +00:00
Casper da Costa-Luis 2e79ce3318 lint: run shfmt 
Related to #2834 and #2969.
 2020-01-30 21:22:12 +00:00
Casper da Costa-Luis ab115dfe74 Recursing => Searching 2020-01-26 23:34:57 +00:00
Casper da Costa-Luis b49a61d247 minor message rename 
Responding to review request
 2020-01-26 23:34:56 +00:00
Casper da Costa-Luis 4ae9b7584b minor import tidy 2020-01-26 23:34:42 +00:00
Casper da Costa-Luis 61a1e7f774 backtrack pbars after failing when adding nonexistent files 2020-01-26 23:34:42 +00:00
Casper da Costa-Luis 7fa5e694b1 silly omission 2020-01-26 23:34:41 +00:00
Casper da Costa-Luis 6de48d30ed replace funcy.merge with py3 syntax 2020-01-26 23:34:41 +00:00
Casper da Costa-Luis 528dedda03 minor import tidy 2020-01-26 23:34:41 +00:00
Casper da Costa-Luis 660fcfd10b fix disable logic 2020-01-26 23:34:40 +00:00
Casper da Costa-Luis a66cc0e503 add saving progress for files in dirs 2020-01-26 23:34:40 +00:00
Casper da Costa-Luis 25557c5882 remove potential single-iteration bar 2020-01-26 23:34:40 +00:00
Casper da Costa-Luis aa3ff022f3 minor comment 2020-01-26 23:34:40 +00:00
Casper da Costa-Luis 2a4c30892e tidy close logic 2020-01-26 23:34:36 +00:00
Casper da Costa-Luis 866b3cd0ae add progress for save/commit/dump stages 2020-01-26 23:33:39 +00:00
Casper da Costa-Luis 21c1b266cf add progress for stages; also may need reverting 2020-01-26 23:33:39 +00:00
Casper da Costa-Luis 3b65181e01 remove unneeded <??:?? for unknown ETA 2020-01-26 23:33:39 +00:00
Casper da Costa-Luis 80e8270954 add recursive file find progress 
for profiling; may need to revert
 2020-01-26 23:33:39 +00:00
Casper da Costa-Luis 0293f7128c minor comment and force refresh 2020-01-26 23:33:38 +00:00
Casper da Costa-Luis dd34100310 replace super bar with intermediate "Adding..." for single files 2020-01-26 23:33:38 +00:00
Casper da Costa-Luis 426972e55f disable super progress bar for single-files 
TODO: actually disable sub-bars instead
 2020-01-26 23:33:38 +00:00
Casper da Costa-Luis dee51991c3 black 2020-01-26 23:33:34 +00:00
Casper da Costa-Luis eb05f8bd0c clean output cleaning (meta) 2020-01-26 23:13:02 +00:00
Casper da Costa-Luis c6c8b80219 no unit scaling for small totals 2020-01-26 23:13:02 +00:00
Casper da Costa-Luis 5d10606e09 remove ETA on completion, minor tidy 2020-01-26 23:13:02 +00:00
Casper da Costa-Luis 66ad722964 Revert "debugging (to revert)" 
This reverts commit 555258c75d.
 2020-01-22 16:28:43 +00:00
Casper da Costa-Luis 7526eb1a2f fix before_install checks 2020-01-22 16:08:24 +00:00
Casper da Costa-Luis f02c804cad tidy up 2020-01-22 16:04:42 +00:00
Casper da Costa-Luis a4a31b3113 fix missing env vars 2020-01-22 16:00:48 +00:00
Casper da Costa-Luis 555258c75d debugging (to revert) 2020-01-22 15:52:33 +00:00
Casper da Costa-Luis ba2c84bade attempt to fix travis snap dpl 2020-01-22 15:23:57 +00:00
Casper da Costa-Luis a6d55e3252 ensure correct snap version dirtyness 2020-01-21 22:38:09 +00:00
Casper da Costa-Luis 8a560ecaba pin snap version to base version 2020-01-21 22:31:40 +00:00
Casper da Costa-Luis c13b24fb40 fix master/edge release provider argument conflicts 2020-01-21 19:50:22 +00:00
Casper da Costa-Luis f80626b5d0 recompress conditional snap channel 2020-01-19 19:10:25 +00:00
Casper da Costa-Luis de358d661a explicitly spilt snap stable/edge deployments 
- (re) fix #3152
 2020-01-19 19:10:05 +00:00
Casper da Costa-Luis 22ed9cb5dc Remove travis-incompatible tests 
- reverts
  + 205077e3a0.
  + 46e0616614.
 2020-01-19 18:27:59 +00:00
Casper da Costa-Luis 205077e3a0 debugging 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis 2fe9b3a967 connectivity debugging 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis 5ac849377a minor comment update 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis 0a0b4e019e debugging 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis d020c3d8b0 test snaps even where tag is undefined 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis b756f77787 revert whitespace changes, but keep stderr errors 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis 46e0616614 promote snap tests for debugging 2020-01-19 18:19:01 +00:00
Casper da Costa-Luis 39ef3dba1a add snap tests 
- fixes #2954
 2020-01-19 18:17:16 +00:00
Casper da Costa-Luis d34aa4471b minor comments 
- explains review concerns in #3158
 2020-01-16 20:36:42 +00:00
Casper da Costa-Luis d8e6e34c34 minor use of new public API env var 2020-01-15 16:23:59 +00:00
Casper da Costa-Luis 4b16252c48 tidy deploy_condition 2020-01-15 15:41:02 +00:00
Casper da Costa-Luis 7b94181a0d deploy only on push 2020-01-15 15:26:29 +00:00
Casper da Costa-Luis d603048698 capitalisation 2020-01-15 15:20:09 +00:00
Casper da Costa-Luis 930b6cf45e fix pkg deploy condition 2020-01-15 15:16:29 +00:00
Casper da Costa-Luis 5bddfa7a92 major deploy tidy 
- fixes #3152
 2020-01-15 15:10:56 +00:00
Casper da Costa-Luis 5753ea5dae snap deploy master edge 
partially reverts f21931cca0
 2020-01-07 00:40:43 +05:30
Casper da Costa-Luis be762e70c2 remove unneeded stage 2020-01-06 14:56:16 +05:30
Casper da Costa-Luis 55f9a54bff integrate snap deploy 2020-01-06 14:32:39 +05:30
Casper da Costa-Luis 30354f4c8c Snap classic approval! 
- approval: https://forum.snapcraft.io/t/classic-confinement-request-for-dvc/14124
- partially reverts commit a0ac129d5f.
 2020-01-06 14:14:44 +05:30
Casper da Costa-Luis ed95000bb4 remove plugs (incompatible with classic) 
Details: <https://launchpad.net/bugs/1655369>
 2019-12-11 17:38:09 +00:00
Casper da Costa-Luis 5aa2127bfe such syntax much wow 2019-12-03 11:13:43 +00:00
Casper da Costa-Luis 27d2e71460 fix rst syntax 2019-12-03 01:36:04 +00:00
Casper da Costa-Luis 464bcad82e much grammar such fix 2019-12-03 00:55:26 +00:00
Casper da Costa-Luis c622287cd3 truncate long desc 2019-12-02 17:43:11 +00:00
Casper da Costa-Luis 7318a6d120 safer download notification 2019-12-02 17:35:29 +00:00
Casper da Costa-Luis 52c48b56a2 add snap approval request to readme 2019-12-02 16:44:12 +00:00