Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-05 15:28:27 +01:00
Code Issues Packages Projects Releases Wiki Activity
8,866 Commits 7 Branches 579 Tags
f69b3533e4488d1b04b02894de288f2e7d16b175
Commit Graph
1255 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 4de4f0fd65 fetch: introduce --type metrics/plots 
Needed for https://github.com/iterative/studio/pull/6541 but is also generally useful.
 2023-07-10 15:24:30 +03:00
skshetry c8d180d2b0 repro: move code around (#9701) 
emphasizing on building the graph correctly,
and preparing for being able to work with graph directly.
 2023-07-04 21:02:53 +05:45
Ruslan Kuprieiev 8661abf224 fetch: introduce --max-size (#9696) 
Needed for iterative/studio#4782
 2023-07-04 02:17:53 +03:00
skshetry 2becfd9344 refactor repro: split logic for planning stages to run for repro (#9690) 
The planning logic has now been moved to `plan_repro` api, that allows us
to test without creating stages.
 2023-07-03 17:53:48 +05:45
skshetry b7b6642428 repro: do not autostage stage files (#9689) 
The logic is now moved to experiments, where it tracks all the stage related files
itself. The `_get_stage_files()` has been modified to also return lockfile path,
so that it can be staged, and has been moved to `stage/utils.py`, and out of `reproduce.py`.

Fixes #9688.
 2023-07-03 14:42:22 +05:45
skshetry bfa5b1a0c3 repro: make stages run in order of the graph (#9675) 
* repro: make stages run in order of the graph.

In case of --single-item, this means it'll run in the order of arguments passed.
For --downstream, this fixes running of stage out of order when multiple arguments are passed.
For normal case, this enforces the same logic, so that they are never run out-of-order.

* add tests

* tests: repro: add test for --single-item with multiple targets

* graph: support when no nodes are provided
 2023-07-03 11:44:51 +05:45
Oded Messer a750a75016 Stable experiment range sorting (#9660) 
* secondary sorting by rev alphanumerically. to introduce determinism

* add UT
 2023-06-26 10:53:39 +09:00
Ruslan Kuprieiev cf976f17ae data: status: use ui.progress instead of ui.status (#9662) 
With all fetch and checkout related things that we've done in the recent past,
we now have all the mechanisms necessary to provide actual progress (no total,
but still better than spinner) during `dvc data status` operations.
 2023-06-26 00:10:44 +03:00
dberenbaum 04b50c5cd0 exp push/pull: default to head rev 2023-06-20 15:53:46 +09:00
dberenbaum bf2f08da09 exp list: fix ui for tags/branches 2023-06-20 15:52:18 +09:00
Ruslan Kuprieiev 1835c8c6e9 tests: unit: explicitly ask for dvc repo 
Currently these rely on the root of the repo being in the dvc repo.
 2023-06-19 03:44:10 +03:00
Ruslan Kuprieiev c827654fe7 tests: use mocker instead of unittest.mock where possible 
Had the "pleasure" of finding a mocker.patch leak into other tests and one
of the suspicions is that mixing unittest.mock and mocker might be somehow
related.

In any case, we should use mocker where possible anyway.
 2023-06-18 17:10:45 +03:00
Ruslan Kuprieiev af1fb722c8 dvc: drop cached external outputs 
Fixes #9531

Docs https://github.com/iterative/dvc.org/pull/4574 Kudos @dberenbaum
 2023-06-09 18:34:36 +03:00
Peter Rowlands 2cd33e10ac output: serialize 3.x hash name in 'hash' field 2023-06-09 15:49:44 +03:00
Peter Rowlands 603f5fdba1 cache: move 3.x data objects into files/md5/ prefix 2023-06-09 15:49:44 +03:00
Dave Berenbaum 528eab0418 import: drop --file (#9562) 2023-06-09 10:03:32 +05:45
Saugat Pachhai (सौगात) 21a2504bcb dvc.utils.pkg: move PKG to top-level dvc 
PKG has to be specified in dvc/_build.py now, and can be
imported using:

    from dvc import PKG

This is done to avoid importing from dvc/utils pkg which can
be expensive.
Also it's not an utility, so it is better that it remains at
the top-level namespace.
Note that we may have to fix the path for a few packages that we build,
like conda/snap/chocolatey.
 2023-06-08 00:31:00 +03:00
skshetry 6c58d438b3 tests: remove single_stage tests from repro/run tests (#9553) 2023-06-07 09:25:08 +05:45
skshetry 46f3157f43 add: rename jobs to remote_jobs to mirror CLI; move validation to CLI (#9550) 
- Follow up on https://github.com/iterative/dvc/pull/9522, renames jobs kwarg to remote_jobs
  to mirror CLI.
- Also moves validation logic to CLI.
 2023-06-06 19:30:39 +05:45
skshetry 3759535d43 tests: remove single_stage stage runs (#9549) 2023-06-06 18:38:07 +05:45
dberenbaum 2c4365513e add: deprecate --file 2023-06-06 14:57:07 +03:00
skshetry 26152292aa remove support for reading and generating Dvcfile (#9546) 2023-06-06 15:29:10 +05:45
Ruslan Kuprieiev 6543580100 dvcfs: don't use datafs isout/isdvc 2023-05-31 23:14:28 +03:00
Dave Berenbaum 3a85326df3 add: rename jobs to remote-jobs (#9522) 2023-05-31 01:14:30 +03:00
skshetry 355ebc72eb add: remove --recursive, rename fname to file (#9513) 
add: remove --recursive
 2023-05-26 12:07:13 +05:45
skshetry 0e38525d8d cli: remove dvc run (#9508) 
Note that `Repo.run()` API still exists, which will be removed in
successive PRs. A lot of tests depend on it that it'll take time
before removing it.
 2023-05-25 16:27:14 +05:45
Dave Berenbaum 8acd943d52 exp list: show experiment shas (#9501) 
* exp list: include sha; still needs remote support

* exp list: ignore rev for remotes

* exp list: update output format

* refactor
 2023-05-25 15:05:12 +09:00
David de la Iglesia Castro 25313f5d82 exp: Drop checkpoints (#9271) 
exp: Drop `checkpoints`.

Closes #9221
 2023-05-23 11:32:18 +05:45
David de la Iglesia Castro f245567613 exp: Drop gc. (#9273) 
Closes #7991
 2023-05-22 16:08:25 +05:45
skshetry 1989c0fe98 stage add: introduce --run option (#9480) 
* stage add: introduce --run option

Part of #5846.

* fix ui message
 2023-05-22 12:27:20 +05:45
skshetry e089ee0365 remove data ls and support for --meta/--desc/--label/--type cli flags (#9481) 2023-05-19 20:10:34 +05:45
David de la Iglesia Castro 02f7fcae73 exp show: Drop --pcp. (#9270) 
Closes #9268
 2023-05-19 15:36:33 +05:45
David de la Iglesia Castro cdba65f27e exp: Drop init. (#9269) 
Drop `exp init`.

Closes #9267
 2023-05-19 14:39:16 +05:45
skshetry 3959c51373 lockfile: drop 1.0 lockfile support (#9476) 2023-05-18 17:36:05 +05:45
skshetry 90aaf5a296 commands: remove --show-json/--show-md/--show-csv flags (#9475) 2023-05-18 16:36:14 +05:45
Dave Berenbaum 7f6890ff25 Live metrics config (#9433) 
* exp: live metrics config token and offline

* refactor live metrics config

* use get_studio_config

* revert to using env vars for studio config

* update dvc-studio-client to support live metrics config changes

* upgrade dvc-studio-client

* don't change environ when posting live metrics events
 2023-05-17 09:21:01 +00:00
daavoo 64beb1578a repro: Add --allow-missing. 
Point 2 in https://github.com/iterative/dvc/pull/9375#issuecomment-1531683194
 2023-05-16 22:43:24 +02:00
dberenbaum f888544554 gc: disallow --remote without other flags 2023-05-16 17:18:57 +02:00
skshetry 2342099bd8 add: support virtual operation (#9389) 2023-05-11 08:31:25 +05:45
David de la Iglesia Castro aa517bc90e exp save: Support --message. 
Custom commit message to use when committing the experiment.

Part of #8870
 2023-05-08 20:08:47 +02:00
David de la Iglesia Castro c74dc20b97 exp run: Support --message. 
Custom commit message to use when committing the experiment.

Part of #8870
 2023-05-08 20:08:47 +02:00
David de la Iglesia Castro 8620b6e5af exp: Update --rev to support append action. 
Closes #9390
 2023-05-08 14:15:07 +02:00
Ruslan Kuprieiev 967dd5ea2b import: don't forget to set cache.dir (#9415) 
* import: don't forget to set cache.dir

* repo: open: try setting remote for local repos
 2023-05-07 05:28:58 +03:00
Ruslan Kuprieiev ad39bf14ed repo: external_repo -> _external_repo 2023-05-07 04:14:25 +03:00
Ruslan Kuprieiev 01416df5a4 get: use Repo.open instead of external_repo 
This should use `Repo.open` just like `dvc import`, to benefit from
handling local repos without cloning and redundant downloaads.
 2023-05-07 04:14:25 +03:00
Ruslan Kuprieiev eb592e7e33 repo: consolidate Repo.open logic 2023-05-07 04:14:25 +03:00
dberenbaum 2db07b047e data status: exclude remote status by default 2023-05-06 18:21:11 +03:00
David de la Iglesia Castro c7e2ec9707 gc: Add --not-in-remote arg. 
Closes #2036
 2023-04-27 10:30:39 +02:00
Oded Messer d203bf9024 Fix: Prettifying unexpected error on FileExists for get/get-url/imp-url/add and introducing --force (#9365) 2023-04-27 00:41:09 +00:00
Peter Rowlands ec090c5680 exp: use new collection in show/cli commands 
- Updates 'dvc exp show --json' to use new data format
 2023-04-20 16:58:32 +09:00