skshetry
2342099bd8
add: support virtual operation ( #9389 )
2023-05-11 08:31:25 +05:45
David de la Iglesia Castro
195e67c0c1
repro: pull all missing files ( #9395 )
...
* reproduce: Update `pull` to also pull `run cache`.
* reproduce: Update `pull` to also pull changed stages.
2023-05-10 00:29:44 +03:00
David de la Iglesia Castro
aa517bc90e
exp save: Support --message.
...
Custom commit message to use when committing the experiment.
Part of #8870
2023-05-08 20:08:47 +02:00
David de la Iglesia Castro
c74dc20b97
exp run: Support --message.
...
Custom commit message to use when committing the experiment.
Part of #8870
2023-05-08 20:08:47 +02:00
David de la Iglesia Castro
1ba3944944
api: exp_show: Postprocess empty strings as None.
...
Makes it easier to manipulate when converting to pandas DataFrame.
2023-05-08 17:10:27 +02:00
Ruslan Kuprieiev
6b6084a848
tests: import: check that dvcfs is using main repo's cache ( #9417 )
...
Followup for https://github.com/iterative/dvc/pull/9415
2023-05-08 00:34:00 +03:00
Ruslan Kuprieiev
ad39bf14ed
repo: external_repo -> _external_repo
2023-05-07 04:14:25 +03:00
Ruslan Kuprieiev
eb592e7e33
repo: consolidate Repo.open logic
2023-05-07 04:14:25 +03:00
dberenbaum
2db07b047e
data status: exclude remote status by default
2023-05-06 18:21:11 +03:00
paulourbano
75952c4e36
tests: changing tests to reverted diff functionality
2023-05-05 22:25:38 +02:00
paulourbano
31b0b8de73
tests: adapting tests to new diff output
...
Issue #7960
2023-05-05 22:25:38 +02:00
paulourbano
fae47e6122
metrics: adds support for strings in metrics
...
Fixes #7960
2023-05-05 22:25:38 +02:00
Ruslan Kuprieiev
b044bcce5e
tests: lockfile: use different way of changing a cmd
2023-05-05 04:16:58 +03:00
dberenbaum
1f03c40dbe
add: msg for overlapping parent
2023-05-02 19:03:19 +03:00
David de la Iglesia Castro
2a04263f02
api: Add scm module with all_{X} methods for listing revs.
2023-04-28 12:33:03 +02:00
David de la Iglesia Castro
348446050e
api: Add exp_show.
...
Closes #8775
Closes #7167
2023-04-28 12:33:03 +02:00
David de la Iglesia Castro
64e787fa02
gc: Handle remote field in --cloud and --not-in-remote.
2023-04-27 10:30:39 +02:00
David de la Iglesia Castro
c7e2ec9707
gc: Add --not-in-remote arg.
...
Closes #2036
2023-04-27 10:30:39 +02:00
Oded Messer
d203bf9024
Fix: Prettifying unexpected error on FileExists for get/get-url/imp-url/add and introducing --force ( #9365 )
2023-04-27 00:41:09 +00:00
skshetry
e1bf418e72
tests: lazy tpi imports, ignore deprecation warning from setuptools ( #9362 )
2023-04-24 21:34:07 +05:45
David de la Iglesia Castro
b6d8c07d4d
studio: Ensure studio_repo_url works with exp run --queue.
...
Closes #9349
2023-04-21 21:04:48 +02:00
Peter Rowlands
b814531c84
exp: use mocked queue in test_apply_failed
2023-04-21 16:17:01 +09:00
Peter Rowlands
3b3cd0a0b2
exp: drop test_queue_remove_done func test in favor of mocked unit test
2023-04-21 16:17:01 +09:00
Peter Rowlands
ec090c5680
exp: use new collection in show/cli commands
...
- Updates 'dvc exp show --json' to use new data format
2023-04-20 16:58:32 +09:00
Saugat Pachhai (सौगात)
1be82fa56d
tests: remove unnecessary variable interpolation
...
dvc.run does not expand variables. It is only done when it's actually read from dvc.yaml file.
So during dvc run, the shell will try to expand the variable, which does not exist.
I don't think that the intention was to use shell variables. But I don't think we should ever
use them, as they will fail on some shells (eg: fish) and keep the scripts as simple as possible.
2023-04-14 13:01:53 +02:00
Peter Rowlands
c71a4082e6
testing: expose force=... in scm_add
2023-04-10 13:17:47 +03:00
Peter Rowlands
ce269ffa58
exp: use explicit scm.add(force=True) when necessary
...
- add test for dir dep containing gitignored files
2023-04-10 13:17:47 +03:00
skshetry
3c570a2177
exp push: improve ui ( #9308 )
...
* exp push: improve ui
* fix misc suggestions
- show url even when the refs are up-to-date.
- show url at the end
- add Git remote information in up-to-date UI message.
* fix diverged exps message
2023-04-06 09:54:39 +05:45
David de la Iglesia Castro
3312a90949
exp run: Add --copy-paths arg.
...
List of paths to copy inside the temp directory. Only used if `--temp` or `--queue` is specified.
Closes #5800
2023-04-05 23:17:07 +02:00
Alexander Guschin
32bebc0246
Add top-level artifacts: section ( #9220 )
...
* add artifacts section
* adding and removing artifacts
* delete code for add/remove; add tests
* fix pre-commit
* remove extra piece of writing to dvc.yaml
* remove extra piece
* simplify kwargs
* allow same names for artifacts in different dvc.yaml files
* set ID as path; don't return dvc.yaml(s) with no artifacts
* fix PR feedback
* issue warning at incorrect artifact name
* issue warning at incorrect artifact name
* reference right schema
* add r to regexp
* add tests for regexp
* set artifacts for SingleStageFile
* fix windows test
* make path required; simplify regexp and remove slash from it
* allow to use gto's artifacts.yaml
* remove extra piece of code for migration from gto
2023-04-05 13:31:35 +00:00
David de la Iglesia Castro
35648134f7
exp run: git add param files that will be modified.
...
Only if they are currently untracked and `--temp` or `--queue` is passed.
Closes #7842
2023-04-05 10:28:18 +02:00
Ruslan Kuprieiev
40f7f34889
api: data: set default remote instead of using it directly
...
Fixes #9139
Fixes #7341 (see https://github.com/iterative/dvc/pull/7363#issuecomment-1032959843 )
2023-04-05 02:47:35 +03:00
David de la Iglesia Castro
3a2259821b
exp save: Include LOCK_FILE
2023-04-03 10:33:52 +02:00
Ruslan Kuprieiev
ecdc44e010
dep: repo: use dvcfs
...
Makes dvc get/import/etc use dvcfs, which already supports cloud versioning,
circular imports and other stuff.
Also makes dvc import behave more like dvc import-url, so that we can use
the same existing logic for fetching those using index instead of objects.
Fixes #8789
Related iterative/studio#4782
2023-04-02 03:55:02 +03:00
David de la Iglesia Castro
24e10e0278
exp save: Track top level files
2023-03-31 19:23:40 +02:00
David de la Iglesia Castro
7c8e6e3156
exp run: Track top level files.
2023-03-31 19:23:40 +02:00
David de la Iglesia Castro
1d8b2e5fa6
exp run: Propagate .dvc/config.local in TempDirExecutor.
...
Closes #7254
2023-03-31 09:02:22 +02:00
skshetry
696fabc745
exp-push: show url to the Studio project ( #9283 )
2023-03-30 12:52:09 +05:45
skshetry
780dc72301
Revert "exp-push: show url to the Studio project" ( #9282 )
...
Revert "exp-push: show url to the Studio project (#9278 )"
This reverts commit 1ca3ef14a3 .
2023-03-30 08:28:44 +05:45
skshetry
1ca3ef14a3
exp-push: show url to the Studio project ( #9278 )
2023-03-30 08:27:47 +05:45
Ruslan Kuprieiev
35bb261b89
config: don't look for .dvc dir implicitly
...
Currently if dvc_dir doesn't exists (e.g. we are creating an uninitialized
repo), config will try looking for `.dvc` dir in the current directory,
which might be inside of another dvc repository resulting in mixed configs.
Use explicit `from_cwd` method to make `Config` try to find repo configs
if available to avoid the usage mixup.
2023-03-29 16:27:54 +03:00
David de la Iglesia Castro
fe6d543c1f
tests: Add UnresolvedExpNamesError check in test_remove_remote
2023-03-29 12:56:59 +02:00
skshetry
43195a806d
plots: return errors in json format ( #9146 )
...
* plots: return errors in json format
* plots --json: move plots data into data key
* rename revision key to rev
* move imports to top-level
* add tests
2023-03-27 12:53:43 +05:45
David de la Iglesia Castro and Dave Berenbaum
e9fb0b92aa
exp branch: Make branch arg optional.
...
Default to `f"{ref_info.name}-branch"` where ref_info is inferred from the `exp_rev` argument.
Co-authored-by: Dave Berenbaum <[email protected] >
2023-03-24 19:11:06 +01:00
David de la Iglesia Castro
6b6dc01ac4
exp save: Reintroduce implementation based on executor/queue.
...
Closes #9058 .
Ensures behavior of `_stash_exp` in `exp run` is matched in `exp save` without duplicating logic.
The simpler implementation ended up being worse for maintenance when wanting to make `exp run` and `exp save` behavior in sync.
2023-03-24 10:43:24 +01:00
Peter Rowlands
91d3ff0f69
exp: mark q remove test as flaky
2023-03-24 17:53:40 +09:00
Dave Berenbaum
da3bbccf66
Update duplicate output error msg ( #9138 )
...
* update dup output error msg
* update dup output error msg
* stage add: add test for duplicated output error msg
* cleanup OutputDuplicationError code
2023-03-23 15:54:44 +00:00
pre-commit-ci[bot] and David de la Iglesia Castro
48b56c83dc
[pre-commit.ci] pre-commit autoupdate ( #9168 )
...
* [pre-commit.ci] pre-commit autoupdate
updates:
- [github.com/charliermarsh/ruff-pre-commit: v0.0.254 → v0.0.257](https://github.com/charliermarsh/ruff-pre-commit/compare/v0.0.254...v0.0.257 )
- [github.com/codespell-project/codespell: v2.2.2 → v2.2.4](https://github.com/codespell-project/codespell/compare/v2.2.2...v2.2.4 )
* pre-commit: fix ruff errors
* pre-commit: fix flake8
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: David de la Iglesia Castro <[email protected] >
2023-03-23 13:05:31 +00:00
Peter Rowlands
cd2c4d0caf
tests: remark flaky queue tests as xfail on windows
2023-03-23 19:18:52 +09:00
David de la Iglesia Castro
9b329d01bf
api: Add exp_save.
2023-03-23 10:33:55 +01:00