This avoids recollecting the cache files over and over again.
For example, `dvc fetch` noop in `dvc-bench` went from ~30sec down to ~10sec
for me.
Next step is to also cache remote index, so we don't have to waste those
~10sec checking files in the remote.
Related https://github.com/iterative/dvc-data/pull/376
PKG has to be specified in dvc/_build.py now, and can be
imported using:
from dvc import PKG
This is done to avoid importing from dvc/utils pkg which can
be expensive.
Also it's not an utility, so it is better that it remains at
the top-level namespace.
Note that we may have to fix the path for a few packages that we build,
like conda/snap/chocolatey.
* exp: live metrics config token and offline
* refactor live metrics config
* use get_studio_config
* revert to using env vars for studio config
* update dvc-studio-client to support live metrics config changes
* upgrade dvc-studio-client
* don't change environ when posting live metrics events
* tests: isolate dvc config and directories
by introducing envvars to change default values. This lets pytest
handle the deletion of tmpdirs, instead of filling /var/tmp with
hundreds of thousands of directories. Also isolates test run from
faulty global/system config files.
* move to dvc/env and sort
* api call to add/write artifact
* return dvcyaml path on add
* create dir for dvc.yaml if needed
* create dir for dvc.yaml if needed - fix
* allow nested artifact names
* make dvc get download artifacts
* Apply suggestions from code review
Co-authored-by: Oded Messer <[email protected]>
* use feedback
* remove 'dvc get' from this PR, keep only adding artifacts
* allow first char of artifact name to be a number
* add note about constants
* fix parsing artifact name
* remove 'parse_name' and write tests for 'add'
* Apply suggestions from code review
Co-authored-by: Oded Messer <[email protected]>
* updates from comments
* fix for studio
* fix again
* making check_name_format to raise an exception
* Update dvc/repo/artifacts.py
---------
Co-authored-by: Oded Messer <[email protected]>
Ruslan Kuprieiev
Peter Rowlands
Dave Berenbaum
Saugat Pachhai (सौगात)
skshetry
daavoo
Alexander GuschinandOded Messer