Saugat Pachhai
4244e5a475
fix #6835 ( #6837 )
2021-10-19 21:59:09 +03:00
Saugat Pachhai
0c41a25bbe
move some configs to pyproject.toml ( #6834 )
2021-10-19 19:47:51 +03:00
Matthew Beckers
26f435a433
exp run: throw error if new parameters are added by --set-param ( #6521 )
...
* throw error if new parameters are added by dvc run exp -S
Throws an error if dvc run exp --set-param references a parameter key path
that is not in the target config file. This is done to prevent silent errors
in experimentation when new params are accidentally added instead of modifying
current ones due to typos.
This implementation is based on initial suggestions in issue #5477 .
* fix mypy confusion from overwriting a var
* tests: remove modify param test that was adding params
One of the test in test_modify_params was still adding a parameter
* tests: remove param modification during exp run in test_untracked
Spurious usage of modifying a parameter when the params.yaml is not yet existing in test_untracked.
* remove benedict dependency for verifying params
Instead, the keypath util module from benedict is adapted into the dvc codebased and used
natively to verify that a keypath exists within a dict.
* exp: list all invalid param modifications in error message
* exp-run: more specific exception for new params via --set-param
Uses established MissingPramsError instead of DvcException. Modified message to be more similar to other uses of this exception.
* Revert "remove benedict dependency for verifying params"
This reverts commit 6170f16dcc4033667fbacb0d0bc13c60898f58c4.
* exp: use internal benedict import for validating params
* exp: combine new param validation into merge_params
Moves new param validation into existing merge_params function as an optional check
* exp: minor ammendments to error message
* Revert "tests: remove param modification during exp run in test_untracked"
This reverts commit c9eb1a62af58586509ded362cc79e75ddc4b119c.
* exp: fix test_untracked to not fail due to new params
Fixed by creating the params file with the new parameter already present.
2021-10-19 17:46:36 +09:00
966dc8a1ca
machine: Add a new command dvc machine status ( #6649 )
...
* machine: Add a new command `dvc machine status`
fix#6482
1. add a new command `dvc machien status`
2. add a unit test for the cli call.
3. add a unit test for the shown result.
* Update dvc/command/machine.py
Co-authored-by: Saugat Pachhai <[email protected] [email protected] [email protected] [email protected] https://pre-commit.ci
* Use white list to limit shown fields
Co-authored-by: Saugat Pachhai <[email protected] [email protected]
2021-10-19 17:38:11 +09:00
eggqq007 and Zhenyu Gao
6d96ecb376
dvcfs: handle new workspace subdirectories in walk ( #6811 )
...
1. add try-catch to catch KeyError exception while walking dvc folder
2. Fix #6695
Co-authored-by: Zhenyu Gao <[email protected]
2021-10-19 17:33:02 +09:00
Batuhan Taskaya
9e57d1c32d
gdrive: remove redundant _gdrive_retry function ( #6831 )
2021-10-18 21:52:39 +00:00
Batuhan Taskaya
c08655ac38
plots: fix the dictionary to return PathInfos ( #6830 )
2021-10-18 22:04:21 +02:00
David de la Iglesia Castro
4f16852005
exp/metrics/params diff: Replaced Old/New with a_rev/b_rev ( #6814 )
...
* Replaced Old/New with a_rev/b_rev
* Fixed tests
2021-10-18 21:09:02 +03:00
Ruslan Kuprieiev
7bef6fd64f
setup: bump fsspec deps ( #6828 )
2021-10-18 21:01:03 +03:00
pre-commit-ci[bot]
422d883e18
[pre-commit.ci] pre-commit autoupdate ( #6829 )
...
updates:
- [github.com/lovesegfault/beautysh: v6.1.0 → v6.2.1](https://github.com/lovesegfault/beautysh/compare/v6.1.0...v6.2.1 )
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-10-18 20:47:48 +03:00
Saugat Pachhai
48004b1340
Revert "webdav: limit httpx to fix the CI" ( #6827 )
...
* Revert "webdav: limit httpx to fix the CI (#6800 )"
This reverts commit af34f5a0f1
2021-10-18 20:32:46 +03:00
dependabot[bot]
2ae421cea2
build(deps-dev): Bump filelock from 3.3.0 to 3.3.1 ( #6825 )
...
Bumps [filelock](https://github.com/tox-dev/py-filelock ) from 3.3.0 to 3.3.1.
- [Release notes](https://github.com/tox-dev/py-filelock/releases )
- [Changelog](https://github.com/tox-dev/py-filelock/blob/main/docs/changelog.rst )
- [Commits](https://github.com/tox-dev/py-filelock/compare/3.3.0...3.3.1 )
---
updated-dependencies:
- dependency-name: filelock
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-18 19:53:37 +05:45
dependabot[bot]
812fde9891
build(deps-dev): Bump types-requests from 2.25.9 to 2.25.11 ( #6820 )
...
Bumps [types-requests](https://github.com/python/typeshed ) from 2.25.9 to 2.25.11.
- [Release notes](https://github.com/python/typeshed/releases )
- [Commits](https://github.com/python/typeshed/commits )
---
updated-dependencies:
- dependency-name: types-requests
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-18 19:51:13 +05:45
dependabot[bot]
4ed4766692
build(deps): Bump actions/checkout from 2.3.4 to 2.3.5 ( #6817 )
...
Bumps [actions/checkout](https://github.com/actions/checkout ) from 2.3.4 to 2.3.5.
- [Release notes](https://github.com/actions/checkout/releases )
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md )
- [Commits](https://github.com/actions/checkout/compare/v2.3.4...v2.3.5 )
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-18 19:43:41 +05:45
dependabot[bot]
9943cd43b1
build(deps-dev): Bump types-tabulate from 0.8.2 to 0.8.3 ( #6790 )
...
Bumps [types-tabulate](https://github.com/python/typeshed ) from 0.8.2 to 0.8.3.
- [Release notes](https://github.com/python/typeshed/releases )
- [Commits](https://github.com/python/typeshed/commits )
---
updated-dependencies:
- dependency-name: types-tabulate
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-18 19:42:50 +05:45
dependabot[bot]
7d3f35e6ab
build(deps-dev): Bump types-toml from 0.10.0 to 0.10.1 ( #6821 )
...
Bumps [types-toml](https://github.com/python/typeshed ) from 0.10.0 to 0.10.1.
- [Release notes](https://github.com/python/typeshed/releases )
- [Commits](https://github.com/python/typeshed/commits )
---
updated-dependencies:
- dependency-name: types-toml
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-18 20:57:43 +09:00
dependabot[bot]
4de261f717
build(deps-dev): Bump dvclive from 0.4.0 to 0.4.1 ( #6786 )
...
Bumps [dvclive](https://github.com/iterative/dvclive ) from 0.4.0 to 0.4.1.
- [Release notes](https://github.com/iterative/dvclive/releases )
- [Commits](https://github.com/iterative/dvclive/compare/0.4.0...0.4.1 )
---
updated-dependencies:
- dependency-name: dvclive
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-18 13:33:26 +03:00
Paweł Redzyński
db75878bef
plots: make generator out of collect ( #6793 )
2021-10-15 17:24:02 +03:00
Ruslan Kuprieiev
7f5c53c10e
ui: write_json: don't forget json kwargs ( #6810 )
...
Regression from #6743
Fixes #6803
2021-10-15 01:30:22 +03:00
Ruslan Kuprieiev
259d590527
setup.cfg: remove types-paramiko ( #6807 )
...
We are no longer using them since migration to sshfs.
Closes #6806
2021-10-14 16:00:10 +03:00
dependabot[bot] and Ruslan Kuprieiev
709bfe598f
build(deps): Update flufl-lock requirement from <4,>=3.2 to >=5 ( #6576 )
...
* build(deps): Update flufl-lock requirement from <4,>=3.2 to >=3.2,<7
Updates the requirements on [flufl-lock](https://gitlab.com/warsaw/flufl.lock ) to permit the latest version.
- [Release notes](https://gitlab.com/warsaw/flufl.lock/tags )
- [Commits](https://gitlab.com/warsaw/flufl.lock/compare/3.2...6.0 )
---
updated-dependencies:
- dependency-name: flufl-lock
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <[email protected] [email protected]
2021-10-14 15:26:40 +03:00
David de la Iglesia Castro
7e4f443002
Added test_show_experiments_sort_by ( #6798 )
...
* Added test_show_experiments_sort_by
* Added comment
* help formatting
2021-10-14 14:49:00 +03:00
2a3a93314b
pathspec 0.9.0 quickfix ( #6689 )
...
* pathspec 0.9.0 quickfix
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* restrict requirement properly
Co-authored-by: Gao <[email protected] [email protected] [email protected]
2021-10-14 14:25:03 +03:00
Paweł Redzyński
a1b146669c
plots: load templates from package ( #6550 )
...
* plots: vega: make interactive linear default plot
* plots: stop dumping default templates
* plots: move templates to package initial
* plots: update default plots schema
* plots: write defaults on init
* templates: migrate to importlib.resources
* fixup
* fixup
2021-10-14 08:40:31 +02:00
Peter Rowlands (변기호)
b8478a8b04
machine: re-add instance dir management from TPI ( #6748 )
...
* machine: re-add instance dir management from TPI
* update default constructor
* machine: lazy load Repo.machine
2021-10-14 12:40:30 +09:00
Michael Lingelbach
0ae9130052
dvc: add 'repos' list to pre-commit config if it does not exist ( #6795 )
2021-10-13 22:50:25 +03:00
Batuhan Taskaya
af34f5a0f1
webdav: limit httpx to fix the CI ( #6800 )
2021-10-13 16:49:54 +03:00
Ruslan Kuprieiev
e9a7e0657d
dvc: drop 3.6 support ( #6792 )
...
* dvc: drop 3.6 support
Considering that 3.6 has ~2 months until EOL, and our deps are
dropping support for it already (e.g. pygit2), we are droppipping
it as well. This will reduce the load on our test CI as well, since
we've started supporting 3.10 recently.
* setup.cfg: adjust requirements
* daemon: remove 3.6 logic
* tests: utils: remove pre 3.7 logic
2021-10-12 18:53:28 +03:00
Saugat Pachhai and Ruslan Kuprieiev
8abda93e3e
use setuptools_scm and build_requires ( #6775 )
...
* use setuptools_scm and build_requires
* remove kwargs from setup.py
* fix tests; fetch in depth in github actions
* use build to build sdist/wheel
* try updating pip and setuptools
* update pip
* remove or unpin wheel
* bring back the version in pyinstaller
* Update scripts/build.py
Co-authored-by: Ruslan Kuprieiev <[email protected]
2021-10-12 17:58:14 +03:00
Ruslan Kuprieiev
53255c22b3
gha: tests: temporarily disable some remote tests ( #6789 )
...
* gha: tests: temporarily disable some remote tests
See #6788
* machine: upgrade tpi version
```
dvc/machine/backend/terraform.py:28:19: E1101: Instance of 'TerraformBackend' has no '_default_resource' member; maybe 'default_resource'? (no-member)
```
* tests: remotes: require --s3 for s3 tests
2021-10-12 17:26:47 +03:00
Paweł Redzyński and Jorge Orpinel
6da15629c4
plots: modify: add note on modyfying image type plots ( #6742 )
...
* plots: modify: add note on modyfying image type plots
* Update dvc/command/plots.py
Co-authored-by: Jorge Orpinel <[email protected] [email protected]
2021-10-12 16:08:49 +03:00
Ruslan Kuprieiev
5cfe61928e
tree: use oids instead of objects ( #6785 )
2021-10-12 05:39:10 +03:00
Ruslan Kuprieiev
32467ada32
objects: extract size/nfiles to Meta ( #6784 )
...
* stage: capture metadata
* tree: capture metadata
* objects: extract size/nfiles from HashInfo/HashFile/Tree to Meta
2021-10-12 03:06:18 +03:00
pre-commit-ci[bot]
5cbaa8d98e
[pre-commit.ci] pre-commit autoupdate ( #6782 )
...
updates:
- [github.com/pre-commit/mirrors-mypy: v0.910 → v0.910-1](https://github.com/pre-commit/mirrors-mypy/compare/v0.910...v0.910-1 )
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-10-12 02:27:56 +03:00
Ruslan Kuprieiev
4762c38ff7
dvc: bump to 2.8.1
2021-10-11 16:09:51 +03:00
Ruslan Kuprieiev
66acbc892a
setup.cfg: use text/x-rst instead of text/rst
...
Per https://packaging.python.org/specifications/core-metadata/#description-content-type
2021-10-11 16:09:29 +03:00
Ruslan Kuprieiev
d2edbae7e3
dvc: bump to 2.8.0
2021-10-11 15:47:58 +03:00
Batuhan Taskaya
be0c827b95
fs: add basic type annotations to FsspecWrapper ( #6779 )
2021-10-11 15:15:56 +03:00
Paweł Redzyński
d6ecef7169
plots: fix wrong link ( #6693 )
2021-10-11 12:22:20 +02:00
eggqq007 and Zhenyu Gao
e8b649a75f
Fix exp show --sort-by issue #6675 ( #6764 )
...
Co-authored-by: Zhenyu Gao <[email protected]
2021-10-11 16:46:38 +09:00
Batuhan Taskaya
8767f42f39
gs: use 3-char prefixes ( #6759 )
...
Resolves #6691 . Normally it should have inherited this from the `ObjectFSWrapper`, but this seems like a leftover.
2021-10-11 16:16:17 +09:00
Paweł Redzyński
8580e66d60
gha: move cancelaltion into other workflows ( #6771 )
2021-10-08 18:03:07 +03:00
Saugat Pachhai
c24ae2b0c3
exp init: show defaults in help message ( #6763 )
2021-10-08 20:14:12 +05:45
Saugat Pachhai
4e17279440
exp init: add config support ( #6761 )
2021-10-08 20:14:01 +05:45
Batuhan Taskaya
50cdf4f213
fsspec: normalize checksum() to return string ( #6767 )
2021-10-08 16:57:37 +03:00
Saugat Pachhai
f628f670c9
advertise Python 3.10 support ( #6772 )
...
* advertise Python 3.10 support
Pygit2 does not have windows wheels yet and no pyarrow
for 3.10. But these platform-dependent things and
remote-dependent things should not stop us from
advertising support as we are pure-python based
package and we cannot claim support for all of our
dependencies.
* set pygit2 for Python 3.6 to <1.7
2021-10-08 15:50:05 +03:00
Batuhan Taskaya
d7489bb65f
hdfs: enable mocked hdfs tests by default ( #6766 )
2021-10-08 12:42:41 +02:00
dependabot[bot] and Paweł Redzyński
5a4f4d3a8e
build(deps): Bump filelock from 3.2.0 to 3.3.0 ( #6737 )
...
* build(deps): Bump filelock from 3.2.0 to 3.3.0
Bumps [filelock](https://github.com/tox-dev/py-filelock ) from 3.2.0 to 3.3.0.
- [Release notes](https://github.com/tox-dev/py-filelock/releases )
- [Commits](https://github.com/tox-dev/py-filelock/compare/3.2.0...3.3.0 )
---
updated-dependencies:
- dependency-name: filelock
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <[email protected] [email protected]
2021-10-08 15:36:33 +05:45
dependabot[bot]
2c24b24562
build(deps-dev): Bump types-requests from 2.25.6 to 2.25.9 ( #6770 )
...
Bumps [types-requests](https://github.com/python/typeshed ) from 2.25.6 to 2.25.9.
- [Release notes](https://github.com/python/typeshed/releases )
- [Commits](https://github.com/python/typeshed/commits )
---
updated-dependencies:
- dependency-name: types-requests
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-08 14:59:09 +05:45
dependabot[bot]
df9f76c2c0
build(deps-dev): Bump types-paramiko from 0.1.9 to 2.7.1 ( #6769 )
...
Bumps [types-paramiko](https://github.com/python/typeshed ) from 0.1.9 to 2.7.1.
- [Release notes](https://github.com/python/typeshed/releases )
- [Commits](https://github.com/python/typeshed/commits )
---
updated-dependencies:
- dependency-name: types-paramiko
dependency-type: direct:development
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-08 14:58:19 +05:45
Saugat Pachhai
Matthew Beckers
eggqq007andZhenyu Gao
Batuhan Taskaya
David de la Iglesia Castro
Ruslan Kuprieiev
dependabot[bot]
Paweł Redzyński
Peter Rowlands (변기호)
Michael Lingelbach
