Ruslan Kuprieiev
af1fb722c8
dvc: drop cached external outputs
...
Fixes #9531
Docs https://github.com/iterative/dvc.org/pull/4574 Kudos @dberenbaum
2023-06-09 18:34:36 +03:00
skshetry
a86470ccbc
update black and change line-length to 88 ( #8953 )
2023-02-04 05:28:07 +02:00
Ruslan Kuprieiev
24023c6977
index: introduce data_keys ( #8938 )
...
`data_keys` are similar to `outs`, but they provide more granularity, so we
can use them in `build_data_index` to rebuild index views with filtered
outputs. E.g. when running `dvc diff dir/file`, workspace index should only
have `dir/file` in it.
This also could be used for standalone (non-output) data in the future.
Pre-requisite for #8930
2023-02-02 05:50:16 +02:00
Ruslan Kuprieiev
f661cee8f6
stage: use repo.fs directly without copying ( #8929 )
...
Otherwise when using brancher we end up in a strange situation where even
though we are collecting targets from `gitfs`, we are still using `localfs`
as `self.fs`, which make operations like `self.fs.abspath` in
`collect_granular` return invalid paths.
2023-02-01 05:21:53 +02:00
Ruslan Kuprieiev
e07c85a993
index: collect_targets: introduce onerror ( #8925 )
2023-02-01 03:49:27 +02:00
Saugat Pachhai (सौगात)
30ec1cf5e9
index/stage: move repo collection logic to index
2023-01-11 19:38:43 +02:00
Saugat Pachhai (सौगात)
23e4d376c9
index: remove unused APIs
...
These are being used by some users, but removing it for easier refactoring.
We are not using it ourselves.
2022-12-20 13:17:28 +05:45
Peter Rowlands
628b992442
index: fix granular dir output view filtering
2022-11-08 19:28:10 +09:00
Peter Rowlands
99e7f52bbd
index: support filtering by output in views
2022-11-08 19:28:10 +09:00
Saugat Pachhai (सौगात)
15f35e827e
fix windows
2022-11-03 23:07:28 +05:45
Saugat Pachhai (सौगात)
c02bd7f318
migrate some files to pytest
2022-11-03 23:07:28 +05:45
Saugat Pachhai (सौगात)
af649af462
deps: bump dvc-data to 0.0.6; fix imports
2022-06-14 17:50:57 +05:45
Daniele Trifirò
793f97bdd5
fix dvc-objects/data imports
2022-06-13 18:03:53 +05:45
Ruslan Kuprieiev
9ac2f49b57
Revert "fix dvc-objects/data imports"
...
This reverts commit 677da2b22c .
2022-06-10 12:01:07 +03:00
Daniele Trifirò
677da2b22c
fix dvc-objects/data imports
2022-06-10 14:07:33 +05:45
Saugat Pachhai (सौगात)
37921d618d
dvc: remove dvc.objects, fix imports
2022-05-20 14:02:08 +05:45
Saugat Pachhai (सौगात)
14c9348f93
dvc.objects: move hash_info, state and meta into dvc.objects
2022-05-11 17:35:48 +03:00
Fabian
44af5b3b7e
index: add getitem
...
* allow access to a stage via `getitem` in addition to iterating over the Index.
2022-04-07 21:05:47 +05:45
Alexander Schepanovski
9ee428ef17
Fix memory leak in Index.build_graph()
...
`@memoize()` memory lives as long as decorated function lives, which is
permanent in this case. Since `self` is referenced as a memory key no
`Index` will ever be freed.
Changed to use `@cached_property` whose cache lives as long as the
parent instance.
2022-01-03 13:41:10 +02:00
Saugat Pachhai (सौगात)
b84227db89
scm: remove ignore list
2021-11-22 07:16:54 +02:00
Ruslan Kuprieiev
32467ada32
objects: extract size/nfiles to Meta ( #6784 )
...
* stage: capture metadata
* tree: capture metadata
* objects: extract size/nfiles from HashInfo/HashFile/Tree to Meta
2021-10-12 03:06:18 +03:00
Saugat Pachhai
fbcc3f389c
TmpDir: add serialize utilities ( #6620 )
2021-09-15 16:13:06 +05:45
Saugat Pachhai
fd76e0991f
cleanup index, and add test for used_objs ( #6390 )
2021-08-06 15:35:01 +05:45
Saugat Pachhai
6c33fbb617
introduce index ( #6300 )
...
* introduce index
* migrate tests to use index
* migrate checkout/diff to use index.outs
* test for index
* fix typings
* add few more tests
2021-08-05 14:23:40 +03:00