Ruslan Kuprieiev
502f0eecc9
tests: temporarily skip dvclive tests ( #5513 )
2021-02-24 08:52:33 +02:00
Ruslan Kuprieiev
8f568ab197
state: use diskcache ( #5505 )
...
* state: only load when needed
* state: don't use separate load/dump
* checkout: group link removal logic together
* state: use diskcache.Cache
* staging: use pbar and save to state
* state: don't pass the whole repo to __init__
* staging: explicitly pass state object
* fs: get rid of odb property
* state: don't close the connection to cache
* repo: close: close state
2021-02-23 20:51:34 +02:00
Ruslan Kuprieiev
2e01ce1974
dvc: bump to 2.0.0a1
2021-02-23 20:48:42 +02:00
Batuhan Taskaya
d587d41d6c
utils: proper file interface for HashedStreamReader ( #5508 )
2021-02-23 02:47:36 +02:00
Batuhan Taskaya
27c2401f59
azure: transfer bigger chunks of data ( #5504 )
2021-02-22 14:08:26 +02:00
Batuhan Taskaya
174621696d
azure: migrate AzureFileSystem to fsspec ( #5463 )
...
* azure: migrate AzureFileSystem to fsspec
* client => fs
* principal auth
* better login error handling
2021-02-22 12:05:15 +02:00
Batuhan Taskaya
e1a193f00b
update: forbid updating repo-imports with --to-remote ( #5475 )
2021-02-22 11:55:00 +02:00
Saugat Pachhai and Dave Berenbaum
cccead3441
stage:list: update output and help text ( #5499 )
...
* stage:list: update output and help text
* Replaced 'Produces' with 'Outputs'
* Replaced 'Stage depends on' with just 'Depends on'
* Changes help text of --names-only and --fail
* Update dvc/command/stage.py
Co-authored-by: Dave Berenbaum <[email protected] [email protected]
2021-02-20 13:21:39 +05:45
Batuhan Taskaya
8102ede5cc
add, import-url: always resolve the output in the local path for --to-remote ( #5473 )
...
* add, import-url: always resolve the output in the local path for --to-remote
* windows
* use the proper fixture
2021-02-19 15:22:59 +02:00
Saugat Pachhai
14944dd9e0
Minor refactoring stage:list command ( #5498 )
...
Moving text truncation to utils and adding tests for it
2021-02-19 18:27:37 +05:45
Paweł Redzyński
63f32936b2
live integration: turn on tests ( #5487 )
2021-02-19 09:25:28 +01:00
Peter Rowlands (변기호)
7d13d24a1f
pygit/dulwich: implement create branch ( #5497 )
...
* pygit: implement create branch
* dulwich: implement create branch
2021-02-19 17:18:15 +09:00
Peter Rowlands (변기호)
9cb8187cb3
pygit: implement resolve_commit ( #5496 )
...
* git: return backend-agnostic object for resolve_commit
* use int timestamps instead of datetime
* make branch_revs Git method instead of backend
* pygit: implement resolve_commit
2021-02-19 17:00:22 +09:00
Peter Rowlands (변기호)
98590779eb
pygit: implement get_refs_containing ( #5495 )
...
* git: make is_sha a Git class method instead of backend function
* pygit: implement get_refs_containing
* use merge base instead of parents
2021-02-19 16:42:04 +09:00
Batuhan Taskaya
9ae8bcdf52
gdrive: support service auth with json ( #5485 )
...
* gdrive: support service auth with json
* retry logic
2021-02-18 17:10:35 +02:00
Paweł Redzyński
14958ff85f
plots: fix bug preventing usage from being displayed ( #5492 )
2021-02-18 14:24:47 +01:00
Peter Rowlands (변기호)
9909ee85a1
git: implement dulwich add --update ( #5491 )
...
* dulwich: implement add with --update
* add git backend test for add()
* fix list comprehension in dulwich status()
* allow adding single string path instead of list
* handle windows paths in add(update=...)
2021-02-18 17:56:56 +09:00
Saugat Pachhai
45477a2a81
dvc.lock: raise error if the file is gitignored ( #5484 )
2021-02-18 03:08:00 +02:00
Ruslan Kuprieiev
282e83c481
tests: temporarily exclude gdrivefs from extras ( #5483 )
...
When trying to publish to pypi, we get:
```
Invalid value for requires_dist. Error: Can't have direct dependency:
"gdrivefs @ git+https://github.com/intake/gdrivefs.git ; extra ==
'tests'"
```
2021-02-17 05:49:34 +02:00
Ruslan Kuprieiev
51988475a4
gha: packages: update for 2.0
2021-02-17 04:38:45 +02:00
Corentin Hembise
52ee995f5e
Update requirements of dulwich to 0.20.19 ( #5480 )
...
This should fix #5438
2021-02-17 10:12:04 +09:00
Ruslan Kuprieiev
e0842ce01e
dvc: rename cache -> odb ( #5481 )
2021-02-16 22:49:25 +02:00
Ruslan Kuprieiev
a814a49181
fs: detach state from fs ( #5479 )
...
We used to think this way, but state is not really an fs concept
(fsspec's dircache is though), as it is a cache of hashes of objects
that we are staging, and the hash doesn't depend on fs, as it is usually
computed by us by reading from fs.
Pre-requisite for diskcache-based state.
2021-02-16 17:42:50 +02:00
Saugat Pachhai
d28f5675b4
remove support for double braces ( #5476 )
2021-02-16 17:21:47 +02:00
Sami Jawhar
66f24b8708
exp run: Separate exp param parsing from other commands ( #5310 )
...
* Separate exp param parsing from other commands
* Update exp run params metavar
* Updated experiments run param argument name
2021-02-16 23:19:56 +09:00
Ruslan Kuprieiev
ae8efdeb0f
state: remove unused files ( #5474 )
...
They've been used before we've moved state to .dvc/tmp
2021-02-16 14:48:48 +02:00
Ruslan Kuprieiev
53ba51b5fe
objects: separate staging ( #5470 )
2021-02-16 02:21:54 +02:00
Ruslan Kuprieiev
e90c5fdd19
fs: remove unused use_state decorator ( #5469 )
...
* fs: remove unused use_state decorator
* pylint: limit astroid version
2021-02-16 02:00:55 +02:00
Ruslan Kuprieiev
a72cea67f1
build: require git >= 1.7.0 ( #5467 )
2021-02-15 20:54:07 +02:00
Ruslan Kuprieiev
242d346f15
gs: ls: add etag ( #5465 )
2021-02-15 17:06:16 +02:00
Ruslan Kuprieiev
bb24131530
fs/outs/deps: remove supported() logic ( #5462 )
2021-02-13 22:59:20 +02:00
Ruslan Kuprieiev
b0fd40f12c
dvc: rename tree -> fs ( #5461 )
2021-02-13 15:40:44 +02:00
Ruslan Kuprieiev
9ce6bce9b6
tree: move get_hash to object id logic ( #5460 )
2021-02-13 04:22:29 +02:00
Batuhan Taskaya and Ruslan Kuprieiev
f4b14c2d4a
gdrive: Implement .ls() protocol / proper tree walking with .walk_files() ( #5433 )
...
* gdrive: .ls()/.walk()/.walk_dir()
* better walking
* proper tests
* ._ls_recursive()
* use posxipath for tests
* store ids instead of raw names
* add gdrive fixture
* add dependency
* tests: temporarily disable gdrive tests
Co-authored-by: Ruslan Kuprieiev <[email protected]
2021-02-13 03:10:38 +02:00
Peter Rowlands (변기호)
273b02fc54
metrics/params: fix bug preventing usage from being displayed ( #5453 )
2021-02-12 10:46:13 +09:00
Ruslan Kuprieiev
7c5e0f2949
tree: get_hash: accept explicit hash name ( #5452 )
2021-02-11 22:44:28 +02:00
Saugat Pachhai
ac9819eb02
introduce dvc.io module to consolidate io utilities ( #5348 )
...
* add dvc.ui module
The name of class has been changed to `Console` as the short form
name is too bad.
* add demo
2021-02-11 20:42:08 +02:00
Ruslan Kuprieiev
02cfe33cf9
output: handle missing hash_info.nfiles ( #5448 )
2021-02-11 14:53:40 +02:00
Ruslan Kuprieiev
c635493104
tests: don't limit the number of pytest workers ( #5441 )
...
We used to do this because of gitpython leaks.
2021-02-11 12:27:00 +02:00
Ruslan Kuprieiev
039c2421d9
cache: misc cleanups ( #5447 )
...
* cache: remove duplicated use_state
* tree: move hash_to* helper to cache
2021-02-11 11:28:24 +02:00
Peter Rowlands (변기호)
e3ee960e8e
exp run: remove exp reset in favor of exp run --reset ( #5442 )
...
* exp run: remove `exp reset` in favor of `exp run --reset`
* update command unit test
2021-02-11 11:53:20 +09:00
Peter Rowlands (변기호)
9d82739b3a
exp: add exp remove command ( #5443 )
...
* exp: add remove function for removing specific experiment(s)
* add `dvc exp remove` command
* update tests
2021-02-11 11:45:25 +09:00
Ruslan Kuprieiev
fa550f91c3
cache: move unrelated helpers out of CloudCache class ( #5439 )
...
* cache: move transfer to objects
Moving it as is for now.
* cache: move link() to checkout
2021-02-10 07:49:27 +02:00
Batuhan Taskaya
384a4113ca
update: support --jobs even without --to-remote ( #5434 )
2021-02-09 17:58:59 +02:00
Peter Rowlands (변기호)
b370465209
exp show: customize rich table rendering behavior ( #5381 )
...
* exp show: use rich native pager support
* exp show: re-enable column header styles
* utils: add custom classes to override rich table collapse behavior
* set final collapsed column width to 1 to allow ellipsis
2021-02-09 23:34:04 +09:00
Peter Rowlands (변기호)
748bda8950
exp run: clean untracked lockfiles before running ( #5426 )
...
* exp run/reset: clean untracked lockfiles
* update log level for run -f/--force message
2021-02-09 21:38:46 +09:00
Ruslan Kuprieiev
47bdf523d7
cache: add: accept object id and it's path ( #5431 )
...
Unnatural leftover from previous PRs
2021-02-09 08:15:50 +02:00
Ruslan Kuprieiev
0fdb119ed5
cache: move save() to objects ( #5430 )
2021-02-09 04:56:45 +02:00
Ruslan Kuprieiev
226c68f8ff
dvc: introduce File/Tree cache objects ( #5424 )
2021-02-09 04:00:06 +02:00
Saugat Pachhai
02a0d1af52
stage: implement add/create methods in stage loader ( #5397 )
...
* stage: add/create methods in stage loader
* minor fixups
2021-02-08 18:30:10 +05:45
Ruslan Kuprieiev
Batuhan Taskaya
Saugat PachhaiandDave Berenbaum
Paweł Redzyński
Peter Rowlands (변기호)
Corentin Hembise
Sami Jawhar
