Peter Rowlands
ec090c5680
exp: use new collection in show/cli commands
...
- Updates 'dvc exp show --json' to use new data format
2023-04-20 16:58:32 +09:00
dberenbaum
1c394986db
fix tests
2023-04-15 23:46:47 +03:00
David de la Iglesia Castro
3312a90949
exp run: Add --copy-paths arg.
...
List of paths to copy inside the temp directory. Only used if `--temp` or `--queue` is specified.
Closes #5800
2023-04-05 23:17:07 +02:00
skshetry
8be71be540
utils.studio: disallow redirects, misc API refactoring ( #9301 )
2023-04-04 13:15:08 +05:45
skshetry
7c3c47b4a2
bump ruff to 0.0.260 and enable bandit ( #9300 )
...
* bump ruff to 0.0.260 and enable bandit
* install toml extra for bandit
* suppress insecure use of hash md5
2023-04-04 10:01:43 +05:45
David de la Iglesia Castro
d2812fa48f
studio: Don't fail on empty params.
2023-03-31 19:23:40 +02:00
skshetry
086d51d9de
plots json: return definition errors unrelated to renderers ( #9293 )
2023-03-31 16:34:26 +05:45
skshetry
593f1064cf
utils.studio: refactor to return json response ( #9277 )
2023-03-29 20:02:40 +05:45
Ruslan Kuprieiev
35bb261b89
config: don't look for .dvc dir implicitly
...
Currently if dvc_dir doesn't exists (e.g. we are creating an uninitialized
repo), config will try looking for `.dvc` dir in the current directory,
which might be inside of another dvc repository resulting in mixed configs.
Use explicit `from_cwd` method to make `Config` try to find repo configs
if available to avoid the usage mixup.
2023-03-29 16:27:54 +03:00
skshetry
cc4816f652
utils.studio: require token ( #9255 )
...
This is a simple refactoring which makes the caller to choose appropriate token instead of
the studio.notify_refs making a decision for them.
2023-03-28 13:32:05 +05:45
skshetry
faa1bdfbce
use git remote to find out remote repo url when pinging Studio ( #9254 )
2023-03-28 12:17:48 +05:45
skshetry
1bc4c1dceb
exp share refactor - ping on exp:remove, do not fail on error ( #9248 )
...
studio experiments share refactor
1) Pings Studio on exp remove
2) Does not fail on any error during request.post
3) UI improvement on exp remove
2023-03-27 22:51:50 +05:45
skshetry
531b2110cf
Revert "exp push: add trailing slash to the endpoint url" ( #9243 )
...
Revert "exp push: add trailing slash to the endpoint url (#9240 )"
This reverts commit 5485275b92 .
2023-03-27 14:19:12 +05:45
skshetry
43195a806d
plots: return errors in json format ( #9146 )
...
* plots: return errors in json format
* plots --json: move plots data into data key
* rename revision key to rev
* move imports to top-level
* add tests
2023-03-27 12:53:43 +05:45
David de la Iglesia Castro and Dave Berenbaum
e9fb0b92aa
exp branch: Make branch arg optional.
...
Default to `f"{ref_info.name}-branch"` where ref_info is inferred from the `exp_rev` argument.
Co-authored-by: Dave Berenbaum <[email protected] >
2023-03-24 19:11:06 +01:00
skshetry
5485275b92
exp push: add trailing slash to the endpoint url ( #9240 )
2023-03-24 22:35:20 +05:45
pre-commit-ci[bot] and David de la Iglesia Castro
48b56c83dc
[pre-commit.ci] pre-commit autoupdate ( #9168 )
...
* [pre-commit.ci] pre-commit autoupdate
updates:
- [github.com/charliermarsh/ruff-pre-commit: v0.0.254 → v0.0.257](https://github.com/charliermarsh/ruff-pre-commit/compare/v0.0.254...v0.0.257 )
- [github.com/codespell-project/codespell: v2.2.2 → v2.2.4](https://github.com/codespell-project/codespell/compare/v2.2.2...v2.2.4 )
* pre-commit: fix ruff errors
* pre-commit: fix flake8
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: David de la Iglesia Castro <[email protected] >
2023-03-23 13:05:31 +00:00
Peter Rowlands
f8bbf20b77
exp: use individual q for timeout dependent tests
2023-03-23 19:18:52 +09:00
Ruslan Kuprieiev
dfe76c54d7
erepo: set subrepos/uninitialized explicitly
2023-03-22 02:26:44 +02:00
skshetry
8399bf612a
sconfig: add support for studio token ( #9213 )
...
config: add support for studio token
2023-03-20 20:59:52 +05:45
David de la Iglesia Castro
2d820cccad
deps: bump dvc-render>=0.3.1<0.4.0.
...
For https://github.com/iterative/dvc-render/pull/124
2023-03-16 21:36:02 +01:00
skshetry
58029e9719
exp push: push experiments revs to studio ( #9160 )
...
* exp push: push experiments revs to studio
* log json data that is sent
2023-03-16 11:24:50 +05:45
Ruslan Kuprieiev
b56f6b69dd
exp: push/pull: don't include baseline commit
...
Fixes #6592
2023-03-14 14:00:14 +02:00
Ruslan Kuprieiev
612f3039e0
repo: move state/index/data_index to site_cache_dir
...
We use all of these for optimization and should not depend on a potentially slow or broken
filesystem on which repository resides (could be HDD or CIFS/NFS/overlayfs/etc).
This PR means a few things:
* all odd filesystems that dvc repo might be on will work quickly out of the box
* when we start caching cloned repositories for `dvc get/import`, we will be
able to cache indexes for them as well (note that bare clones don't have a
worktree so there is no place for .dvc/tmp with the old approach).
* `index.dir` and `state.dir` are now obsolete.
* `dvc init` will cleanup site_cache_dir.
Related #5562
2023-03-13 02:58:23 +02:00
skshetry
aaa825a9a8
config: ignore unspecified keys from feature section ( #9153 )
...
A warning is shown to the user for the unsupported/ignored keys, and then ignored.
The warning is raised only once per interpreter session.
2023-03-10 21:52:05 +05:45
Ruslan Kuprieiev
3aa9f51e36
output: suppress cloud.pull errors on cache collection
...
Fixes https://github.com/iterative/studio/issues/5261
2023-03-09 22:44:32 +02:00
Peter Rowlands
8cbc4c43f1
tests: use session-scoped exp celery fixtures when possible
2023-03-09 16:25:09 +09:00
Peter Rowlands
417c327143
exp: add session-scoped celery test fixtures
2023-03-09 16:25:09 +09:00
Peter Rowlands
204eebaf15
tests: use brancher.switch
2023-03-09 15:02:26 +09:00
dberenbaum
fe7db32311
studio: handle revision errors when posting
2023-03-08 22:19:32 +01:00
Gao
4459d6ac57
Add back an dvc ignore test
...
Original from
https://github.com/iterative/dvc/pull/8767#discussion_r1070778749
2023-03-08 12:03:07 +02:00
Peter Rowlands
9101fce761
proc: remove dvc.proc
2023-03-07 18:17:01 +09:00
David de la Iglesia Castro
cb9d3529af
plots: Remove --from-config
2023-03-06 19:16:29 +01:00
skshetry
ddfa607437
tests: don't leak files/descriptors when tests finish ( #9119 )
...
close open files/descriptors when tests finish
2023-03-06 18:06:37 +05:45
David de la Iglesia Castro
e4d514c990
scm: Remove unused GitMergeError.
...
Not used after https://github.com/iterative/dvc/pull/9096
2023-03-03 18:09:57 +01:00
Peter Rowlands
78fb5275e5
exp: add dvc exp clean command
2023-03-02 12:35:54 +09:00
Dave Berenbaum
35b648bbcf
plots: shorten names in the legend ( #8900 )
...
* plots: shorten field names
* plots: handle missing field names
* plots: make compatible with py3.8
* plots: fix for missing data
* plots: add test for field shortening
* plots: strip separators regardless of os
* plots: don't shorten field name
* plots: drop test for shortening field name
2023-02-24 17:26:16 +01:00
Peter Rowlands
96ac321dd5
repo: use local root when determining state/index db dirname
2023-02-24 16:33:42 +09:00
David de la Iglesia Castro
184cc35cf0
pull: Add allow_missing flag.
...
Allows `pull` to succeed even if some files or directories are missing.
Closes #4746
2023-02-24 09:11:50 +02:00
Peter Rowlands
ad5b91e51a
exp show: cache collected git revs
2023-02-24 14:18:58 +09:00
Ruslan Kuprieiev
37761a2627
data: status: get rid of --not-in-remote
2023-02-21 12:32:40 +02:00
Ruslan Kuprieiev
968a8fde99
data: status: introduce --remote-refresh
2023-02-21 12:32:40 +02:00
Ruslan Kuprieiev
c34cbf63af
data: status: introduce --not-in-remote
...
Also supports cloud versioning.
Fixes #8761
2023-02-20 12:25:17 +02:00
Peter Rowlands
e218431f64
apply: add --no-force deprecation message
2023-02-20 14:36:38 +09:00
skshetry
1de37556d5
bump ruff to v0.0.247 ( #9050 )
...
* bump ruff to v0.0.247
* ruff: enable pep8-naming check
rename some camelCased APIs, especially in logger
rename G variables to graph
ignore some variable namings and help messages in dvc.commands
2023-02-18 16:50:35 +05:45
David de la Iglesia Castro
17a71d6011
plots: Rename template_path to html_template.
2023-02-10 10:59:32 +01:00
skshetry
5490fc00d1
logger: check isatty stream to print colored logs or not instead of depending on colorama ( #8993
...
logger: check isatty stream to print colored logs or not
2023-02-09 13:50:38 +05:45
Ruslan Kuprieiev
58295ca0ab
repo: rename odb -> cache
...
We used to have it named `cache` before, but these days it is clear that
you can have three odbs: just odb (e.g. in-memory), cache (typically local)
or remote (typically cloud). Fixing naming here before proceeding with
introducing `out.odb` and `out.cache`.
In preparation for migration to https://github.com/iterative/dvc-data/pull/304
2023-02-08 23:05:45 +02:00
skshetry
a86470ccbc
update black and change line-length to 88 ( #8953 )
2023-02-04 05:28:07 +02:00
frederik-sandfort
18fa1a0272
Custom header for dvc webdav ( #8933 )Fix https://github.com/iterative/dvc/issues/8931
...
* include custom auth header for webdav
* Revert "include custom auth header for webdav"
This reverts commit d2f2b2889b6bcf0429e4a28076f709a04642ae3a.
* include custom auth header for dvc webdav, ran unit tests
* update dvc-webdav version
2023-02-02 16:36:11 +05:45