Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-02 07:18:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
3,789 Commits 7 Branches 579 Tags
0bfb3c0ab2ee229762d551bb622258b99e889ceb
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ruslan Kuprieiev 0bfb3c0ab2 get/import/url: handle existing output directory (#2610) 
* get/import/url: handle existing output directory

Currently if you run

```
dvc get https://github.com/iterative/example-get-started model.pkl --out .
```

it will nuke your cwd. To fix that we need to properly handle existing
directories, same as usual unix cli utilities do that.

* travis: specify python version when installing from chocolatey

Fixes #2609
 2019-10-15 22:42:52 +03:00
Ruslan Kuprieiev f4739b60ae Merge pull request #2607 from algomaster99/reduce-verbosity 
Reduce verbosity of `dvc add`
 2019-10-15 00:07:57 +03:00
Ruslan Kuprieiev 2491143d7a Merge pull request #2597 from efiop/2563 
remote: local: don't auto-create directory in `__init__`
 2019-10-14 23:34:21 +03:00
Ruslan Kuprieiev 2b6446a8d9 Merge pull request #2604 from Suor/reset-dvcignore 
dvc: reset dvcignore
 2019-10-13 18:07:43 +03:00
Ruslan Kuprieiev 5cabb6d115 Merge pull request #2595 from efiop/2563 
dvc: move `local/__init__.py` -> `local.py`
 2019-10-11 00:10:13 +03:00
Ruslan Kuprieiev 4535d626bb Merge pull request #2590 from efiop/state 
dvc: load state when taking repo lock in @locked
 2019-10-10 22:49:16 +03:00
Ruslan Kuprieiev 33bd3d63c5 dvc: bump to 0.62.1 2019-10-10 14:40:04 +03:00
Ruslan Kuprieiev f254004fae dvc: bump to 0.62.0 2019-10-09 11:47:52 +03:00
Ruslan Kuprieiev e34af30353 Merge pull request #2586 from efiop/2585 
scripts: don't include completion scripts into mac pkg
 2019-10-08 18:02:37 +03:00
Ruslan Kuprieiev 449f43f3cc requirements: require gitdb2 >= 2.0.6 
Fixes https://github.com/iterative/dvc/issues/1880
 2019-10-04 12:58:59 +03:00
Ruslan Kuprieiev 96eb7197c1 Merge pull request #2552 from mroutis/fix-2043 
git: escape filename before ignoring it
 2019-10-04 11:33:48 +03:00
Ruslan Kuprieiev f2cf5930aa Merge pull request #2571 from jimmy1134/master 
Update to Readme
 2019-10-04 11:31:23 +03:00
Ruslan Kuprieiev 092c498baa dvc: bump to 0.61.2 2019-10-03 22:53:33 +03:00
Ruslan Kuprieiev f7188f564e Merge pull request #2568 from efiop/2181 
deb/rpm/pkg: add zsh completion scripts
 2019-10-03 22:52:50 +03:00
Ruslan Kuprieiev 06f00b904a Merge pull request #2564 from nik123/master 
scripts: make completion scripts part of the debian package
 2019-10-03 21:50:51 +03:00
Ruslan Kuprieiev 8787ac0380 dvc: bump to 0.61.1 2019-10-02 10:17:22 +03:00
Ruslan Kuprieiev fdf0a8e99a Merge pull request #2562 from efiop/pyenv 
run: improve pyenv PATH modification criteria
 2019-10-02 10:16:52 +03:00
Ruslan Kuprieiev 8fb3eaaa08 dvc: bump to 0.61.0 2019-10-01 10:56:00 +03:00
Ruslan Kuprieiev 39104a1dee Merge pull request #2557 from efiop/2506 
run: make shell not load config files
 2019-10-01 07:59:07 +03:00
Ruslan Kuprieiev f0de362e0d Merge pull request #2548 from iterative/py27 
fix py27 compat
 2019-09-30 08:35:29 +03:00
Ruslan Kuprieiev beea7e56f2 Merge pull request #2543 from casperdcl/checksum 
remove unneeded TqdmThreadPoolExecutor
 2019-09-29 09:15:01 +03:00
Ruslan Kuprieiev e3450257c6 Merge pull request #2544 from yfarjoun/patch-1 
Added a space in error message
 2019-09-29 09:13:10 +03:00
Ruslan Kuprieiev 5c76b46b46 Merge pull request #2538 from mroutis/fix-2524 
py2: display friendly error when raising a UnicodeError
 2019-09-28 03:35:14 +03:00
Ruslan Kuprieiev 22afc48d9b Merge pull request #2540 from Suor/repo-imports 
perf: import dvc.repo dynamically
 2019-09-27 12:02:21 +03:00
Ruslan Kuprieiev 4061d4aff1 dvc: bump to 0.60.1 2019-09-26 18:34:06 +03:00
Ruslan Kuprieiev 3eb23870d2 build: posix: don't forget to install optional psutil 
Fixes https://github.com/iterative/dvc/issues/2537
 2019-09-26 18:33:36 +03:00
Ruslan Kuprieiev 381601f4ee dvc: cache graph/stages/pipelines (#2529) 
* dvc: cache graph/stages/pipelines

Signed-off-by: Ruslan Kuprieiev <[email protected]>

* repo: check_dag: don't reset the cache

https://github.com/iterative/dvc/pull/2529#discussion_r327711928

Signed-off-by: Ruslan Kuprieiev <[email protected]>

* repo: rename check_dag(stages) -> check_modified_graph(new_stages)

https://github.com/iterative/dvc/pull/2529#discussion_r327708439

Signed-off-by: Ruslan Kuprieiev <[email protected]>

* repo: refactor "active" logic and remove it from Repo class

* repo: use tree.setter to automate cache reset

As noted by @Suor's , this is much less prone to errors.

* repo: move graph-related staticmethods into graph.py

As per @Suor's request.

* dvc: remove unused from_directory

https://github.com/iterative/dvc/pull/2529#discussion_r328079258

* repo: use _tree instead of __tree

https://github.com/iterative/dvc/pull/2529#discussion_r328071115

* repo: add a note about cache invalidation on repo.lock release

https://github.com/iterative/dvc/pull/2529#discussion_r328071635

* repo: rename reset() -> _reset()

https://github.com/iterative/dvc/pull/2529#discussion_r328079899

* pipeline: use graph helpers

https://github.com/iterative/dvc/pull/2529#discussion_r327502293

* repo: use list comprehension for collect()

https://github.com/iterative/dvc/pull/2529#discussion_r328076651

* repo: graph: only use first cycle

https://github.com/iterative/dvc/pull/2529#discussion_r328081346

* dvc: don't use G.nodes()

https://github.com/iterative/dvc/pull/2529#discussion_r328089671
https://github.com/iterative/dvc/pull/2529#discussion_r328089878
 2019-09-26 07:42:29 +03:00
Ruslan Kuprieiev fea05b3924 Merge pull request #2536 from mroutis/contributing 
move .github/CONTRIBUTING.md -> CONTRIBUTING.md
 2019-09-26 06:27:30 +03:00
Ruslan Kuprieiev 987cf883c5 dvc: bump to 0.60.0 2019-09-25 11:12:20 +03:00
Ruslan Kuprieiev dcce70f4b9 output: base: checkout: make returns consistent 
As reported by deep source: Either all return statements in a function should return an expression, or none of them should.
 2019-09-24 16:33:15 +03:00
Ruslan Kuprieiev 7409fadb84 Merge pull request #2527 from Suor/delay-cache 
perf: delay cache creation
 2019-09-24 08:11:45 +03:00
Ruslan Kuprieiev 33f1cdfab8 Merge pull request #2525 from efiop/2506 
dvc: remove PATH prefixes appended by pyenv
 2019-09-23 19:35:46 +03:00
Ruslan Kuprieiev 313fdce5fa Merge pull request #2528 from Suor/datacloud-dead-code 
dvc: remove dead code in DataCloud
 2019-09-23 16:26:44 +03:00
Ruslan Kuprieiev bd2b5900a1 Merge pull request #2526 from efiop/2495 
dvc: remote: optimize imports
 2019-09-23 12:44:09 +03:00
Ruslan Kuprieiev 70efa6c52a Merge pull request #2523 from efiop/daemon 
daemon: use `sys.argv[0]` instead of `-m dvc`
 2019-09-22 05:42:56 +03:00
Ruslan Kuprieiev 0347cfb891 gitignore: don't forget to add /tmp 2019-09-22 05:22:55 +03:00
Ruslan Kuprieiev 23fc2662d0 Merge pull request #2519 from efiop/755 
dvc: move repo lock from CLI to API
 2019-09-21 19:12:34 +03:00
Ruslan Kuprieiev 64c3973522 Merge pull request #2517 from Suor/later-imports 
perf: import some things later
 2019-09-20 18:00:01 +03:00
Ruslan Kuprieiev f1d3f4344e Merge pull request #2494 from Suor/lazy 
perf: do not use pkg_resources
 2019-09-20 13:47:47 +03:00
Ruslan Kuprieiev 67e31eaa2f Merge pull request #2504 from Suor/http-compat 
perf: do not import http.server each run
 2019-09-18 22:27:52 +03:00
Ruslan Kuprieiev e36f242f66 Merge pull request #2493 from pared/2345 
output: prevent stage file from being used as output
 2019-09-14 21:42:06 +03:00
Ruslan Kuprieiev 6d16227bc1 Merge pull request #2496 from efiop/2483 
path_info: don't forget to override as_posix method
 2019-09-13 05:12:39 +03:00
Ruslan Kuprieiev da6a0ca933 lock: remove unused lifetime argument 2019-09-11 16:45:09 +03:00
Ruslan Kuprieiev 05adcf9a4f Merge pull request #2461 from Suor/nfs 
dvc: switch to flufl lock
 2019-09-11 16:43:40 +03:00
Ruslan Kuprieiev 8338d4507c Merge pull request #2488 from pared/2444 
remote: checkout: reuse _checkout_file functionality
 2019-09-11 15:22:18 +03:00
Ruslan Kuprieiev 09f6b1c7b9 Merge pull request #2485 from pared/2477 
move: use relpath to find target path
 2019-09-10 16:23:27 +03:00
Ruslan Kuprieiev 9fa6bee13a Merge pull request #2482 from efiop/master 
test: repro: fix link types
 2019-09-10 03:10:29 +03:00
Ruslan Kuprieiev 2c003fdc04 Merge pull request #2426 from mroutis/close-1652 
ssh: support linking
 2019-09-09 20:48:22 +03:00
Ruslan Kuprieiev af8a7aa25d dvc: bump to 0.59.2 2019-09-09 20:28:37 +03:00
Ruslan Kuprieiev b0b958e14b Merge pull request #2481 from efiop/2476 
scm: remove `pkg install` leftovers
 2019-09-09 20:16:01 +03:00
Ruslan Kuprieiev a529f7d8ad Merge pull request #2479 from efiop/always_reproduce 
run: introduce --always-changed
 2019-09-09 19:45:35 +03:00
Ruslan Kuprieiev 9638b454d7 Merge pull request #2478 from pared/2443 
stage: prevent writing default wdir into stage file
 2019-09-09 18:23:36 +03:00
Ruslan Kuprieiev b3e4ff7cba test: install: don't forget to adjust hook tests 2019-09-09 05:10:30 +03:00
Ruslan Kuprieiev 79cd3d670f dvc: bump to 0.59.1 2019-09-09 00:26:54 +03:00
Ruslan Kuprieiev 2d2ac67e50 hooks: make syntax compatible with bare sh 
`==` is not part of the posix and not all shells (e.g. dash) support it, making hooks break.
 2019-09-09 00:26:04 +03:00
Ruslan Kuprieiev 2ee9da61f0 dvc: bump to 0.59.0 2019-09-07 00:13:05 +03:00
Ruslan Kuprieiev b61c97aa68 Merge pull request #2475 from efiop/2471 
erepo: fix environment before running git
 2019-09-07 00:12:35 +03:00
Ruslan Kuprieiev 74bd7d59cf Merge pull request #2469 from pared/2465 
remote: base: check progress_callback when skipping on checkout
 2019-09-06 00:47:45 +03:00
Ruslan Kuprieiev 48d7ab6e22 dvc: bump to 0.58.1 2019-09-04 18:36:11 +03:00
Ruslan Kuprieiev 6d2f078a65 Merge pull request #2462 from pared/2125 
stage: don't unprotect outs on stage create
 2019-09-04 16:15:41 +03:00
Ruslan Kuprieiev 287be8fd2e dvc: bump to 0.58.0 2019-09-04 00:37:25 +03:00
Ruslan Kuprieiev 213f46e821 Merge pull request #2460 from pared/2430 
repo: get: intercept and convert NotDvcRepoErro to UrlNotDvcRepoError
 2019-09-03 15:34:23 +03:00
Ruslan Kuprieiev 3a52732747 Merge pull request #2457 from jorgeorpinel/master 
remove: fix help output
 2019-09-01 10:35:56 +03:00
Ruslan Kuprieiev 116684cb24 Merge pull request #2454 from pared/2441_workaround 
workaround for google-resumable-media==0.3.3 build problem
 2019-08-30 20:39:26 +03:00
Ruslan Kuprieiev 1ed36456fa Merge pull request #2436 from casperdcl/ui-tidy 
progressbar cleanup
 2019-08-29 13:24:27 +03:00
Ruslan Kuprieiev 5d05e9ab01 remote: quote pip install command 
Fixes https://github.com/iterative/dvc/issues/2446
 2019-08-28 21:13:30 +03:00
Ruslan Kuprieiev e3f6c71576 Merge pull request #2428 from pared/2356 
repo.active_stages should return active stages
 2019-08-27 15:33:38 +03:00
Ruslan Kuprieiev a2aaad17f6 Merge pull request #2440 from Suor/messages 
Messages
 2019-08-27 12:22:33 +03:00
Ruslan Kuprieiev 5747e37f41 Merge pull request #2433 from Suor/dirty-cache 
cache: skip non-checksum files around cache
 2019-08-24 17:21:45 +03:00
Ruslan Kuprieiev 902edb1bee Merge pull request #2429 from efiop/fixup-2424 
dvc: don't include gssapi
 2019-08-24 10:14:47 +03:00
Ruslan Kuprieiev c5bcf94e2e Merge pull request #2427 from Suor/add 
dvc: use wdir = "." on add
 2019-08-24 07:17:41 +03:00
Ruslan Kuprieiev 86c3cb785c readme: fix formatting 2019-08-22 04:30:44 +03:00
Ruslan Kuprieiev 208b181f9f readme: add conda-forge badge 2019-08-22 04:28:49 +03:00
Ruslan Kuprieiev 41351a2df2 dvc: bump to 0.57.0 2019-08-22 01:51:57 +03:00
Ruslan Kuprieiev e4f7c6124c Merge pull request #2424 from JoshuaPostel/ssh-gss-auth 
ssh: add gss_auth option
 2019-08-22 01:48:50 +03:00
Ruslan Kuprieiev 77c2dede1c Merge pull request #2422 from casperdcl/tqdm 
minor unreachable code move
 2019-08-21 22:05:42 +03:00
Ruslan Kuprieiev 2d9497c524 Merge pull request #2421 from pared/2328 
repo: move: save stage after moving
 2019-08-21 16:33:13 +03:00
Ruslan Kuprieiev 5aa9a2f501 Merge pull request #2333 from casperdcl/tqdm 
change progress bar backend to tqdm
 2019-08-21 15:38:51 +03:00
Ruslan Kuprieiev 4d267ef742 readme: fix incorrect installation instructions 2019-08-21 13:37:44 +03:00
Ruslan Kuprieiev fc98ba400c travis: remove unused cache entry 2019-08-20 20:12:31 +03:00
Ruslan Kuprieiev 2b2b591b11 Merge pull request #2419 from pared/2409 
.travis.yml: add python version to build PyPi build scripts
 2019-08-20 17:26:04 +03:00
Ruslan Kuprieiev 4fb4b84a5f dvc: bump to 0.56.0 2019-08-20 03:56:14 +03:00
Ruslan Kuprieiev fe38867743 dvc: bump to 0.51.2 2019-08-20 03:55:21 +03:00
Ruslan Kuprieiev 750932d2c0 Merge pull request #2415 from AlJohri/enable-acl 
add acl config
 2019-08-20 03:53:05 +03:00
Ruslan Kuprieiev 51d5a230da dvc: bump to 0.55.1 2019-08-19 16:01:16 +03:00
Ruslan Kuprieiev f0c12ea162 Merge pull request #2407 from efiop/master 
test: run: refactor signal handler tests
 2019-08-19 15:22:25 +03:00
Ruslan Kuprieiev 239739d6e1 Merge pull request #2403 from gthb/no-dvc-checkout-on-git-file-checkout 
fix: don't dvc checkout on git file checkout
 2019-08-19 13:24:26 +03:00
Ruslan Kuprieiev 30a7b77f0e stage: run: don't use unassigned old_handler 
Fix #2406
 2019-08-19 10:55:22 +03:00
Ruslan Kuprieiev 5a9dfbb6a4 config: use new remote url 2019-08-19 09:43:24 +03:00
Ruslan Kuprieiev 5b7cdd6bbf Merge pull request #2405 from efiop/master 
dvc: remove unused code
 2019-08-18 05:56:16 +03:00
Ruslan Kuprieiev 5915f17fcf output: base: remove unnecessary 'else' 
Reported by DeepSource.
 2019-08-18 05:15:08 +03:00
Ruslan Kuprieiev 875186d5a6 dvc: remove unused code 
A bunch of leftovers from a very old pkg implementation.
 2019-08-18 05:09:30 +03:00
Ruslan Kuprieiev d32515c969 Merge pull request #2393 from Suor/stream-more 
api: stream api.open() for local, SSH and HDFS
 2019-08-15 22:33:55 +03:00
Ruslan Kuprieiev e1f676a191 dvc: bump to 0.55.0 2019-08-15 14:06:58 +03:00
Ruslan Kuprieiev 5e4d26691a version: fix typo 2019-08-14 00:34:12 +03:00
Ruslan Kuprieiev 7c19e9e4bf Merge pull request #2389 from Suor/streaming-clouds 
api: stream data in api.open() for S3, GS and OSS
 2019-08-13 11:30:41 +03:00
Ruslan Kuprieiev 3095b24ed4 Merge pull request #2375 from pared/2373 
remote: gs/s3: remove batch_exists
 2019-08-13 02:56:04 +03:00
Ruslan Kuprieiev a063f408a2 Merge pull request #2385 from efiop/azurite 
travis: use azurite v3
 2019-08-11 05:36:57 +03:00
Ruslan Kuprieiev 2f30bddfab travis: use azurite v3 
Trying to fix azure error on our ci:

https://travis-ci.com/iterative/dvc/jobs/224085273

Workaround for #2387

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-08-11 05:04:25 +03:00
Ruslan Kuprieiev 71ab380d03 utils: remove: catch EPERM when chmoding a file 
Fix https://github.com/iterative/dvc/pull/2298#issuecomment-520184196
 2019-08-11 03:00:08 +03:00