Saugat Pachhai
52a9cddc14
exp init: remove default in cli, add default in help instead ( #6862 )
...
The default made it harder to detect between the default and explicitly provided values, which we need for interactive mode.
2021-10-25 16:32:17 +05:45
Ruslan Kuprieiev
38cbebfb28
fs: transfer: try reflink ( #6853 )
...
If supported, reflink, will provide the fastest transfer possible.
That being said, right now we use `move` in most of the places,
which still takes presidence.
Pre-requisite for #6387
2021-10-24 22:46:02 +03:00
dependabot[bot] and Saugat Pachhai
5017c2f282
build(deps): update pyparsing requirement from ==2.4.7 to >=2.4.7
...
build(deps): update pyparsing requirement from ==2.4.7 to >=2.4.7
Updates the requirements on [pyparsing](https://github.com/pyparsing/pyparsing ) to permit the latest version.
- [Release notes](https://github.com/pyparsing/pyparsing/releases )
- [Changelog](https://github.com/pyparsing/pyparsing/blob/master/CHANGES )
- [Commits](https://github.com/pyparsing/pyparsing/compare/pyparsing_2.4.7...pyparsing_3.0.0 )
Signed-off-by: dependabot[bot] <[email protected] [email protected]
2021-10-24 15:22:46 +00:00
dependabot[bot]
1bf6cc7c2f
build(deps): bump pylint-pytest from 1.0.3 to 1.1.2 ( #5894 )
...
Bumps [pylint-pytest](https://github.com/reverbc/pylint-pytest ) from 1.0.3 to 1.1.2.
- [Release notes](https://github.com/reverbc/pylint-pytest/releases )
- [Changelog](https://github.com/reverbc/pylint-pytest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/reverbc/pylint-pytest/compare/pylint-pytest-1.0.3...pylint-pytest-1.1.2 )
Signed-off-by: dependabot[bot] <[email protected]
2021-10-24 20:08:58 +05:45
dependabot[bot]
27666ffba7
build(deps-dev): Bump dvclive from 0.4.1 to 0.4.2 ( #6846 )
...
Bumps [dvclive](https://github.com/iterative/dvclive ) from 0.4.1 to 0.4.2.
- [Release notes](https://github.com/iterative/dvclive/releases )
- [Commits](https://github.com/iterative/dvclive/compare/0.4.1...0.4.2 )
---
updated-dependencies:
- dependency-name: dvclive
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-24 19:03:24 +05:45
Ruslan Kuprieiev
e2d705fd76
link: use proper exceptions ( #6852 )
...
* link: use proper exceptions
* system: use ENOTSUP instead of NotImplementedErrorwq
2021-10-23 02:38:17 +03:00
Saugat Pachhai
719e93192f
move scm.install to dvc.install ( #6849 )
...
scm.install does 3 different things, and all of those are
very much tied to DVC. So, as we are splitting scm out,
it should now belong to `dvc.install`.
2021-10-22 14:53:33 +03:00
Saugat Pachhai
501256708d
use system hook for mypy; fix raised issues ( #6851 )
2021-10-22 15:40:54 +05:45
Saugat Pachhai
800fbc7ad0
Use -n=auto in tests
...
Linux/Windows machines have only 2 cores, whereas macOS machines have 3 cores. Maybe we are stretching available resources by 2x, let's see if `-n=auto` improves test freezes.
2021-10-22 08:46:55 +05:45
Peter Rowlands (변기호)
73f2fa8c93
git: use asyncssh as dulwich SSH vendor ( #6797 )
...
* git: support client kwargs for auth in remote methods
* tests: use docker for git/ssh server
* move dulwich backend into subdir
* add base sync<->async support
* dulwich: add initial asyncssh SSH vendor
* dulwich: use asyncssh as the default SSH vendor
* add test for git over ssh
* test read (fetch) over ssh
* ci: re-enable ssh tests
temporary workaround for #6788 , #6789
* move async stubs into dvc.scm.asyn
* tests: use sshfs and not dvc.fs.ssh
* allow explicit 0-length read in asyncssh vendor
2021-10-21 14:36:45 +09:00
b652670cbf
Dependabot/pip/pylint 2.11.1 ( #6843 )
...
* build(deps): Bump pylint from 2.9.6 to 2.11.1
Bumps [pylint](https://github.com/PyCQA/pylint ) from 2.9.6 to 2.11.1.
- [Release notes](https://github.com/PyCQA/pylint/releases )
- [Changelog](https://github.com/PyCQA/pylint/blob/main/ChangeLog )
- [Commits](https://github.com/PyCQA/pylint/compare/v2.9.6...v2.11.1 )
---
updated-dependencies:
- dependency-name: pylint
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <[email protected] [email protected] [email protected] [email protected]
2021-10-20 14:34:10 +03:00
Gao
6de3e734ed
Revert "build(deps): Bump pylint from 2.9.6 to 2.11.1 ( #6636 )" ( #6842 )
...
This reverts commit 464620806c
2021-10-20 12:41:00 +03:00
Gao
4b2bec89ec
dvc machine: add a new command rename to it (#6633 )
...
* `dvc machine`: add a new command `rename` to it
fix #6481
1. add new command `dvc machine rename`
2. add a unit test for the call.
3. add several functional tests for it.t push myself fix6481
* Move rename logic to tpi
* use tpi.state_mv instead of rename
* Rebase to a newer version
* Update tpi version
* Remove unused assert and try catch
2021-10-20 15:57:44 +09:00
Saugat Pachhai
6c0bc9563c
enable pywin32 for Python3.10, make it an optional dependency ( #6841 )
2021-10-20 11:25:00 +05:45
f964a44e7c
Exp show md ( #6799 )
...
* Added `--md`/`--show-md` option to `exp show`.
* Added test_show_experiments_md
* Fixed re-defining all_experiments
* Fixed all_experiments
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Added dest markdown
* Added textwrap.dedent
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update experiments.py
* Apply suggestions from code review
Co-authored-by: Saugat Pachhai <[email protected] [email protected]
2021-10-20 11:04:57 +05:45
464620806c
build(deps): Bump pylint from 2.9.6 to 2.11.1 ( #6636 )
...
* build(deps): Bump pylint from 2.9.6 to 2.11.1
Bumps [pylint](https://github.com/PyCQA/pylint ) from 2.9.6 to 2.11.1.
- [Release notes](https://github.com/PyCQA/pylint/releases )
- [Changelog](https://github.com/PyCQA/pylint/blob/main/ChangeLog )
- [Commits](https://github.com/PyCQA/pylint/compare/v2.9.6...v2.11.1 )
---
updated-dependencies:
- dependency-name: pylint
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <[email protected] [email protected] [email protected]
2021-10-20 10:32:44 +08:00
Saugat Pachhai
4244e5a475
fix #6835 ( #6837 )
2021-10-19 21:59:09 +03:00
Saugat Pachhai
0c41a25bbe
move some configs to pyproject.toml ( #6834 )
2021-10-19 19:47:51 +03:00
Matthew Beckers
26f435a433
exp run: throw error if new parameters are added by --set-param ( #6521 )
...
* throw error if new parameters are added by dvc run exp -S
Throws an error if dvc run exp --set-param references a parameter key path
that is not in the target config file. This is done to prevent silent errors
in experimentation when new params are accidentally added instead of modifying
current ones due to typos.
This implementation is based on initial suggestions in issue #5477 .
* fix mypy confusion from overwriting a var
* tests: remove modify param test that was adding params
One of the test in test_modify_params was still adding a parameter
* tests: remove param modification during exp run in test_untracked
Spurious usage of modifying a parameter when the params.yaml is not yet existing in test_untracked.
* remove benedict dependency for verifying params
Instead, the keypath util module from benedict is adapted into the dvc codebased and used
natively to verify that a keypath exists within a dict.
* exp: list all invalid param modifications in error message
* exp-run: more specific exception for new params via --set-param
Uses established MissingPramsError instead of DvcException. Modified message to be more similar to other uses of this exception.
* Revert "remove benedict dependency for verifying params"
This reverts commit 6170f16dcc4033667fbacb0d0bc13c60898f58c4.
* exp: use internal benedict import for validating params
* exp: combine new param validation into merge_params
Moves new param validation into existing merge_params function as an optional check
* exp: minor ammendments to error message
* Revert "tests: remove param modification during exp run in test_untracked"
This reverts commit c9eb1a62af58586509ded362cc79e75ddc4b119c.
* exp: fix test_untracked to not fail due to new params
Fixed by creating the params file with the new parameter already present.
2021-10-19 17:46:36 +09:00
966dc8a1ca
machine: Add a new command dvc machine status ( #6649 )
...
* machine: Add a new command `dvc machine status`
fix#6482
1. add a new command `dvc machien status`
2. add a unit test for the cli call.
3. add a unit test for the shown result.
* Update dvc/command/machine.py
Co-authored-by: Saugat Pachhai <[email protected] [email protected] [email protected] [email protected] https://pre-commit.ci
* Use white list to limit shown fields
Co-authored-by: Saugat Pachhai <[email protected] [email protected]
2021-10-19 17:38:11 +09:00
eggqq007 and Zhenyu Gao
6d96ecb376
dvcfs: handle new workspace subdirectories in walk ( #6811 )
...
1. add try-catch to catch KeyError exception while walking dvc folder
2. Fix #6695
Co-authored-by: Zhenyu Gao <[email protected]
2021-10-19 17:33:02 +09:00
Batuhan Taskaya
9e57d1c32d
gdrive: remove redundant _gdrive_retry function ( #6831 )
2021-10-18 21:52:39 +00:00
Batuhan Taskaya
c08655ac38
plots: fix the dictionary to return PathInfos ( #6830 )
2021-10-18 22:04:21 +02:00
David de la Iglesia Castro
4f16852005
exp/metrics/params diff: Replaced Old/New with a_rev/b_rev ( #6814 )
...
* Replaced Old/New with a_rev/b_rev
* Fixed tests
2021-10-18 21:09:02 +03:00
Ruslan Kuprieiev
7bef6fd64f
setup: bump fsspec deps ( #6828 )
2021-10-18 21:01:03 +03:00
pre-commit-ci[bot]
422d883e18
[pre-commit.ci] pre-commit autoupdate ( #6829 )
...
updates:
- [github.com/lovesegfault/beautysh: v6.1.0 → v6.2.1](https://github.com/lovesegfault/beautysh/compare/v6.1.0...v6.2.1 )
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-10-18 20:47:48 +03:00
Saugat Pachhai
48004b1340
Revert "webdav: limit httpx to fix the CI" ( #6827 )
...
* Revert "webdav: limit httpx to fix the CI (#6800 )"
This reverts commit af34f5a0f1
2021-10-18 20:32:46 +03:00
dependabot[bot]
2ae421cea2
build(deps-dev): Bump filelock from 3.3.0 to 3.3.1 ( #6825 )
...
Bumps [filelock](https://github.com/tox-dev/py-filelock ) from 3.3.0 to 3.3.1.
- [Release notes](https://github.com/tox-dev/py-filelock/releases )
- [Changelog](https://github.com/tox-dev/py-filelock/blob/main/docs/changelog.rst )
- [Commits](https://github.com/tox-dev/py-filelock/compare/3.3.0...3.3.1 )
---
updated-dependencies:
- dependency-name: filelock
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-18 19:53:37 +05:45
dependabot[bot]
812fde9891
build(deps-dev): Bump types-requests from 2.25.9 to 2.25.11 ( #6820 )
...
Bumps [types-requests](https://github.com/python/typeshed ) from 2.25.9 to 2.25.11.
- [Release notes](https://github.com/python/typeshed/releases )
- [Commits](https://github.com/python/typeshed/commits )
---
updated-dependencies:
- dependency-name: types-requests
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-18 19:51:13 +05:45
dependabot[bot]
4ed4766692
build(deps): Bump actions/checkout from 2.3.4 to 2.3.5 ( #6817 )
...
Bumps [actions/checkout](https://github.com/actions/checkout ) from 2.3.4 to 2.3.5.
- [Release notes](https://github.com/actions/checkout/releases )
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md )
- [Commits](https://github.com/actions/checkout/compare/v2.3.4...v2.3.5 )
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-18 19:43:41 +05:45
dependabot[bot]
9943cd43b1
build(deps-dev): Bump types-tabulate from 0.8.2 to 0.8.3 ( #6790 )
...
Bumps [types-tabulate](https://github.com/python/typeshed ) from 0.8.2 to 0.8.3.
- [Release notes](https://github.com/python/typeshed/releases )
- [Commits](https://github.com/python/typeshed/commits )
---
updated-dependencies:
- dependency-name: types-tabulate
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-18 19:42:50 +05:45
dependabot[bot]
7d3f35e6ab
build(deps-dev): Bump types-toml from 0.10.0 to 0.10.1 ( #6821 )
...
Bumps [types-toml](https://github.com/python/typeshed ) from 0.10.0 to 0.10.1.
- [Release notes](https://github.com/python/typeshed/releases )
- [Commits](https://github.com/python/typeshed/commits )
---
updated-dependencies:
- dependency-name: types-toml
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-18 20:57:43 +09:00
dependabot[bot]
4de261f717
build(deps-dev): Bump dvclive from 0.4.0 to 0.4.1 ( #6786 )
...
Bumps [dvclive](https://github.com/iterative/dvclive ) from 0.4.0 to 0.4.1.
- [Release notes](https://github.com/iterative/dvclive/releases )
- [Commits](https://github.com/iterative/dvclive/compare/0.4.0...0.4.1 )
---
updated-dependencies:
- dependency-name: dvclive
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <[email protected]
2021-10-18 13:33:26 +03:00
Paweł Redzyński
db75878bef
plots: make generator out of collect ( #6793 )
2021-10-15 17:24:02 +03:00
Ruslan Kuprieiev
7f5c53c10e
ui: write_json: don't forget json kwargs ( #6810 )
...
Regression from #6743
Fixes #6803
2021-10-15 01:30:22 +03:00
Ruslan Kuprieiev
259d590527
setup.cfg: remove types-paramiko ( #6807 )
...
We are no longer using them since migration to sshfs.
Closes #6806
2021-10-14 16:00:10 +03:00
dependabot[bot] and Ruslan Kuprieiev
709bfe598f
build(deps): Update flufl-lock requirement from <4,>=3.2 to >=5 ( #6576 )
...
* build(deps): Update flufl-lock requirement from <4,>=3.2 to >=3.2,<7
Updates the requirements on [flufl-lock](https://gitlab.com/warsaw/flufl.lock ) to permit the latest version.
- [Release notes](https://gitlab.com/warsaw/flufl.lock/tags )
- [Commits](https://gitlab.com/warsaw/flufl.lock/compare/3.2...6.0 )
---
updated-dependencies:
- dependency-name: flufl-lock
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <[email protected] [email protected]
2021-10-14 15:26:40 +03:00
David de la Iglesia Castro
7e4f443002
Added test_show_experiments_sort_by ( #6798 )
...
* Added test_show_experiments_sort_by
* Added comment
* help formatting
2021-10-14 14:49:00 +03:00
2a3a93314b
pathspec 0.9.0 quickfix ( #6689 )
...
* pathspec 0.9.0 quickfix
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* restrict requirement properly
Co-authored-by: Gao <[email protected] [email protected] [email protected]
2021-10-14 14:25:03 +03:00
Paweł Redzyński
a1b146669c
plots: load templates from package ( #6550 )
...
* plots: vega: make interactive linear default plot
* plots: stop dumping default templates
* plots: move templates to package initial
* plots: update default plots schema
* plots: write defaults on init
* templates: migrate to importlib.resources
* fixup
* fixup
2021-10-14 08:40:31 +02:00
Peter Rowlands (변기호)
b8478a8b04
machine: re-add instance dir management from TPI ( #6748 )
...
* machine: re-add instance dir management from TPI
* update default constructor
* machine: lazy load Repo.machine
2021-10-14 12:40:30 +09:00
Michael Lingelbach
0ae9130052
dvc: add 'repos' list to pre-commit config if it does not exist ( #6795 )
2021-10-13 22:50:25 +03:00
Batuhan Taskaya
af34f5a0f1
webdav: limit httpx to fix the CI ( #6800 )
2021-10-13 16:49:54 +03:00
Ruslan Kuprieiev
e9a7e0657d
dvc: drop 3.6 support ( #6792 )
...
* dvc: drop 3.6 support
Considering that 3.6 has ~2 months until EOL, and our deps are
dropping support for it already (e.g. pygit2), we are droppipping
it as well. This will reduce the load on our test CI as well, since
we've started supporting 3.10 recently.
* setup.cfg: adjust requirements
* daemon: remove 3.6 logic
* tests: utils: remove pre 3.7 logic
2021-10-12 18:53:28 +03:00
Saugat Pachhai and Ruslan Kuprieiev
8abda93e3e
use setuptools_scm and build_requires ( #6775 )
...
* use setuptools_scm and build_requires
* remove kwargs from setup.py
* fix tests; fetch in depth in github actions
* use build to build sdist/wheel
* try updating pip and setuptools
* update pip
* remove or unpin wheel
* bring back the version in pyinstaller
* Update scripts/build.py
Co-authored-by: Ruslan Kuprieiev <[email protected]
2021-10-12 17:58:14 +03:00
Ruslan Kuprieiev
53255c22b3
gha: tests: temporarily disable some remote tests ( #6789 )
...
* gha: tests: temporarily disable some remote tests
See #6788
* machine: upgrade tpi version
```
dvc/machine/backend/terraform.py:28:19: E1101: Instance of 'TerraformBackend' has no '_default_resource' member; maybe 'default_resource'? (no-member)
```
* tests: remotes: require --s3 for s3 tests
2021-10-12 17:26:47 +03:00
Paweł Redzyński and Jorge Orpinel
6da15629c4
plots: modify: add note on modyfying image type plots ( #6742 )
...
* plots: modify: add note on modyfying image type plots
* Update dvc/command/plots.py
Co-authored-by: Jorge Orpinel <[email protected] [email protected]
2021-10-12 16:08:49 +03:00
Ruslan Kuprieiev
5cfe61928e
tree: use oids instead of objects ( #6785 )
2021-10-12 05:39:10 +03:00
Ruslan Kuprieiev
32467ada32
objects: extract size/nfiles to Meta ( #6784 )
...
* stage: capture metadata
* tree: capture metadata
* objects: extract size/nfiles from HashInfo/HashFile/Tree to Meta
2021-10-12 03:06:18 +03:00
pre-commit-ci[bot]
5cbaa8d98e
[pre-commit.ci] pre-commit autoupdate ( #6782 )
...
updates:
- [github.com/pre-commit/mirrors-mypy: v0.910 → v0.910-1](https://github.com/pre-commit/mirrors-mypy/compare/v0.910...v0.910-1 )
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-10-12 02:27:56 +03:00
Saugat Pachhai
Ruslan Kuprieiev
dependabot[bot]andSaugat Pachhai
Peter Rowlands (변기호)
Matthew Beckers
eggqq007andZhenyu Gao
Batuhan Taskaya
Paweł Redzyński
Michael Lingelbach
