Peter Rowlands
f26664a569
exp: re-enable run --run-all with celery queue
2022-07-12 21:39:49 +09:00
Peter Rowlands
4b0c65093a
tests: use pytest-celery for exp tests
2022-07-12 21:39:49 +09:00
karajan1001
12fc8c4e7d
exp queue: Add two command queue start and stop ( #7589 )
...
fix : #7589
1. Add two sub-command `dvc queue start` and `dvc queue stop`
2. Add a unit test to test them
2022-07-12 21:39:49 +09:00
karajan1001 and Peter Rowlands
a6cb4eb72e
exp queue: remove queued experiments( #7591 )
...
fix : #7591
1. Add a new command `dvc queue`
2. Add two sub-command `dvc queue remove` and `dvc queue kill`
3. Add a unit test to test them
Co-authored-by: Peter Rowlands (변기호) <[email protected]
2022-07-12 21:39:49 +09:00
karajan1001
4df5a1321d
exp: implement internal queue.kill support( #7587 )
...
fix : #7587
1. Add implement kill method for local queue class
2. Add a test to make sure the following job will be success after the
original job was killed.
3. Some refactoring work on `exp remove`
2022-07-12 21:39:49 +09:00
Peter Rowlands
22deca3a6a
exp: use celery threadpool worker instead of prefork
2022-07-12 21:39:49 +09:00
Peter Rowlands
dc4292c602
exp: implement queue shutdown
2022-07-12 21:39:49 +09:00
Peter Rowlands
56f90eb3c9
exp: add test_queue unit test helper for celery queue
2022-07-12 21:39:49 +09:00
Peter Rowlands
1c474e8f30
exp: re-enable most tmpdir/queue tests
2022-07-12 21:39:49 +09:00
Peter Rowlands
24654fe16c
exp: use dvc.daemon to run worker on windows
2022-07-12 21:39:49 +09:00
Peter Rowlands
44820e74a3
exp: wait for task collection when getting exp result
2022-07-12 21:39:49 +09:00
Peter Rowlands
c16908e9fc
exp: use queue remove in gc
2022-07-12 21:39:49 +09:00
Peter Rowlands
33dbdd20af
exp: exclude celery stash ref from util iterators
2022-07-12 21:39:49 +09:00
Peter Rowlands
69d7bdd0c0
exp: generate unique worker node names per DVC repo
2022-07-12 21:39:49 +09:00
Peter Rowlands
b9f4398826
exp: start migrating info logging to ui
2022-07-12 21:39:49 +09:00
Peter Rowlands
a6e7d43668
exp: return exp results for celery runs
2022-07-12 21:39:49 +09:00
Peter Rowlands
e2ee69ddb2
dvc-task: update to 0.0.6
2022-07-12 21:39:49 +09:00
Peter Rowlands
e8448345f1
exp: follow output on run-all
2022-07-12 21:39:49 +09:00
Peter Rowlands
acab008c65
dvc-task: update to 0.0.3
2022-07-12 21:39:49 +09:00
Peter Rowlands
8c74775a4e
exp: autostart celery worker
2022-07-12 21:39:49 +09:00
Peter Rowlands
9b31a4b463
exp: support remove from celery queue
2022-07-12 21:39:49 +09:00
Peter Rowlands
9f022c576c
dvc-task: update to 0.0.2
2022-07-12 21:39:49 +09:00
Peter Rowlands
316029a9d2
exp: use queue status in exp show
2022-07-12 21:39:49 +09:00
Peter Rowlands
34fe643cee
exp: add queue.iter_active for iterating over active exps
2022-07-12 21:39:49 +09:00
Peter Rowlands
6a01cc530e
exp: use queue.iter_queued to get queued status in exp show
2022-07-12 21:39:49 +09:00
Peter Rowlands
81475bee09
dvc-task: update to 0.0.1
2022-07-12 21:39:49 +09:00
Peter Rowlands
a167dff019
exp: implement celery exp task collection
2022-07-12 21:39:49 +09:00
Peter Rowlands
cffd587952
exp: add queue-worker plumbing command
2022-07-12 21:39:49 +09:00
Peter Rowlands
a0ae9d3f45
exp: migrate workspace repro to queues
2022-07-12 21:39:49 +09:00
Peter Rowlands
e74f8f9e11
exp: add naive workspace queue
2022-07-12 21:39:49 +09:00
Peter Rowlands
e45ca1e830
exp: start moving queueing/execution from __init__
2022-07-12 21:39:49 +09:00
Peter Rowlands
46c734eb7e
exp: temporarily mark tmpdir/queue tests as xfail
2022-07-12 21:39:49 +09:00
Peter Rowlands
c17f7f03bd
exp: initial celery app/task setup
2022-07-12 21:39:49 +09:00
Peter Rowlands
7113568c60
exp: refactor base.py into refs.py and exceptions.py
2022-07-12 21:39:49 +09:00
Peter Rowlands
6143146974
exp: refactor stash handling into separate module
2022-07-12 21:39:49 +09:00
15ada9a1c3
Implement --date to exp gc
...
1. Implement `--time` to `exp gc`
2. add a unit test for it.
3. Rename `--time` to `--date` and change the warning msg.
4. To get a better msg for `gc` and `exp gc`
Co-authored-by: Peter Rowlands (변기호) <[email protected] [email protected]
2022-07-12 13:53:46 +02:00
karajan1001 and Peter Rowlands
217eb13495
Add argument commit_time to gc/brancher and iter_revs
...
1. Add argument `commit_time` to `gc`/`brancher` and `iter_revs`
2. Add unit test for iter_revs.
Co-authored-by: Peter Rowlands (변기호) <[email protected]
2022-07-12 13:53:46 +02:00
karajan1001 and Dave Berenbaum
20d1f7a87d
gc: add a new flag --time ( #678 )
...
fix #678
1. Add a new flag `--time` to `dvc gc`.
2. Modify the unit test of `dvc gc`
3. Fix an argument checking error and update the error msg.
Co-authored-by: Dave Berenbaum <[email protected]
2022-07-12 13:53:46 +02:00
karajan1001
9c59689aa7
Gc: Move old unittest gc tests to pytest
2022-07-12 13:53:46 +02:00
David de la Iglesia Castro
d47e3c40b8
tests: limit printed durations to 50
2022-07-11 12:36:37 +03:00
Ruslan Kuprieiev
d8be68436f
deps: bump dvc-data to 0.0.23
2022-07-10 18:10:45 +03:00
Ruslan Kuprieiev
f6adc49089
deps: bump dvc-data to 0.0.22
2022-07-10 17:05:26 +03:00
Saugat Pachhai (सौगात)
a4c0ae9c73
deps: bump dvc-data, install dvc-data cli deps in dev mode
2022-07-10 18:37:38 +05:45
Ruslan Kuprieiev
8b3020aaf3
deps: bump dvc-data to 0.0.20
2022-07-08 21:37:38 +03:00
Alex Hall
182a22b8f6
checkout: use dvcignore
...
Fixes #7374
2022-07-07 17:20:30 +08:00
Alex Hall
892b235d0b
metrics: support TOML files
...
Fixes #6402
2022-07-06 14:46:46 +02:00
dependabot[bot]
da93e9a76c
build(deps-dev): Bump pytest-mock from 3.8.1 to 3.8.2
...
Bumps [pytest-mock](https://github.com/pytest-dev/pytest-mock ) from 3.8.1 to 3.8.2.
- [Release notes](https://github.com/pytest-dev/pytest-mock/releases )
- [Changelog](https://github.com/pytest-dev/pytest-mock/blob/main/CHANGELOG.rst )
- [Commits](https://github.com/pytest-dev/pytest-mock/compare/v3.8.1...v3.8.2 )
---
updated-dependencies:
- dependency-name: pytest-mock
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2022-07-06 11:38:18 +02:00
Ruslan Kuprieiev
bd93d85d47
deps: bump dvc-data
2022-07-05 21:29:34 +03:00
Ruslan Kuprieiev
eed6a8483c
data_cloud: remove logger check
...
Per https://github.com/iterative/dvc/pull/7961/files#r913635687
2022-07-05 13:22:23 +03:00
David de la Iglesia Castro
954de0cae4
api: params_show: Raise exception if no params found.
...
Fixes #7926
2022-07-05 09:18:22 +02:00
Peter Rowlands
karajan1001
David de la Iglesia Castro
Ruslan Kuprieiev
Saugat Pachhai (सौगात)
Alex Hall
dependabot[bot]