Mr. Outis
5611ccb43a
exceptions: remove cause
2020-01-02 20:43:24 -06:00
Aman Sharma
f08c90fc6e
Ensure relpath accepts str and Path-like objects
2020-01-02 02:17:02 +05:30
Mr. Outis
086acf6404
py3: dvc/utils/compat.py -> dvc/compat.py
2019-12-31 23:42:07 -06:00
Mr. Outis
27f581cf4e
py3: remove imports from utils.compat
2019-12-31 23:16:11 -06:00
Mr. Outis
b844aea42c
py3: remove cast_bytes method
2019-12-31 20:14:25 -06:00
Mr. Outis
6d36b85736
py3: remove string compat related code
2019-12-30 23:49:19 -06:00
Mr. Outis
94a0914bba
py3: get rid of future imports
2019-12-30 19:35:48 -06:00
pawel
cf2d349bd7
tree: move CleanTree to ignore
2019-12-30 14:19:43 +01:00
pawel
d8c0ae6909
remove most occurences of dvc_walk
2019-12-30 14:19:43 +01:00
pawel
f4ee01cffe
no need for dvcignore in walk args
2019-12-30 14:19:43 +01:00
Ruslan Kuprieiev
ef6018fc2f
Merge pull request #3002 from efiop/2458
...
dvc: support granularity for fetch/pull/push/status/checkout
2019-12-30 07:26:57 +02:00
Ruslan Kuprieiev
c81795c047
dvc: support granularity for fetch/pull/push/status/checkout
...
Using output path or a subdir/subfile path within an output now works
with `dvc push/pull/fetch/status -c` commands. Other commands don't
support the same logic for now, as there are some questions about what
should commands like `dvc remove` do when given a specific output path.
Example:
dvc add data
dvc pull data/subdir # will only pull files within data/subdir
Related to #2458
2019-12-29 01:31:08 +02:00
Max Risuhin
4727cb7893
Improve Google Drive auth failure error reporting
2019-12-28 05:22:37 -08:00
Ruslan Kuprieiev
477488ea0a
Merge pull request #2950 from mroutis/tests-repo
...
tests: use dir_helpers on repo
2019-12-17 22:20:31 +02:00
Ruslan Kuprieiev
825e9fc74c
Merge pull request #2952 from mroutis/tests-updater
...
tests: use dir helpers on updater
2019-12-17 22:18:18 +02:00
Mr. Outis
e519464aca
💅 black
2019-12-17 12:21:50 -06:00
Mr. Outis
8a14700c12
tests/updater: fix problems with .check
2019-12-17 12:18:43 -06:00
Mr. Outis
1bd66fa859
tests/repo: old params in is_dvc_internal
2019-12-17 12:03:35 -06:00
Mr. Outis
08b335d2b5
tests/repo: move unit tests to func tests
2019-12-16 08:04:28 -06:00
Mr. Outis
4b833f58e5
tests/updater: use skipif for .check
2019-12-15 13:09:23 -06:00
Max Risuhin
4d4a3fc716
Standardize gdrive tests with others remotes
2019-12-15 05:31:52 -08:00
Mr. Outis
df9f3de231
tests/repo: stringify stage.relpath
2019-12-13 19:15:25 -06:00
Mr. Outis
299fb9022f
💅 black
2019-12-13 18:04:15 -06:00
Mr. Outis
37a2844a74
tests/repo: move .stages to unit
2019-12-13 18:01:11 -06:00
Mr. Outis
b3a52515a3
tests/repo: move .collect to unit
2019-12-13 17:54:05 -06:00
Mr. Outis
655b79bf0c
tests/repo: move .destroy to unit test
2019-12-13 17:51:54 -06:00
Mr. Outis
c178e77ab7
tests/repo: use pytest
2019-12-13 17:51:54 -06:00
Ruslan Kuprieiev
da49badbfe
Merge branch 'master' into relink
2019-12-13 20:35:02 +02:00
Ruslan Kuprieiev
3c835909f6
Merge pull request #2931 from rbvesb/dvc-s3-acl
...
remote: Extend S3 remote support for custom ACL
2019-12-13 19:31:44 +02:00
Veselin Borisov
cd461aec4f
fixup! remote: Extend S3 remote support for custom ACL
2019-12-13 10:43:38 +02:00
Ruslan Kuprieiev
e384685715
dvc: release locks when running a command
...
Currently only one instance of dvc could run in a particular repo
because of the `.dvc/lock`. That gets furstrating when you are running
some long-running command and blocked from doing anything else.
This PR solved that issue for `dvc run` by releasing the repo lock
while running the command. To protect against conflicts, we now use
rwlock, which keeps the list of readers and writers for particular
paths. The process looks like this:
1) aquire read locks for deps;
2) aquire write locks for outs;
3) release repo lock;
4) run cmd;
5) aquire repo lock;
6) release write locks for outs;
7) release read locks for outs;
We also take rwlocks for operations such as `import`, `add` and `checkout`
to ensure that we won't hit the same files that are being used by
another `dvc run` in the background.
We don't aquire rwlocks for the stage file itself, as we don't really
care about anyone overwriting a stage file, as there is a very little
difference here between parallel runs and sequential runs that overwrite
the same stage file.
Next steps might be to release repo lock on `import`(when dowloading
stuff) and when computing checksums or copying files.
Fixes #755
2019-12-13 10:38:10 +02:00
Mr. Outis
d0f3559d96
tests: updater, use dir helpers
2019-12-12 18:59:52 -06:00
Alexander Schepanovski
1143a8c57f
test: add checkout parse-cli-api test
2019-12-12 20:16:17 +07:00
Veselin Borisov
4c2bc6bf48
fixup! remote: Extend S3 remote support for custom ACL
2019-12-12 12:41:38 +02:00
Ruslan Kuprieiev
8890daf703
Merge pull request #2826 from mroutis/refactor-analytics
...
analytics: refactor into a module
2019-12-09 17:59:51 +02:00
Mr. Outis
5dd6300878
💅 black
2019-12-07 21:19:54 -06:00
Mr. Outis
6e4c3d6acd
tests: require keys on analytics report schema
2019-12-07 21:18:28 -06:00
Mr. Outis
c50bd17bb4
analytics: collect execution info only when available
2019-12-07 21:14:31 -06:00
Ruslan Kuprieiev
82dd1ac7c1
Merge pull request #2815 from xliiv/2807-use-pager
...
dvc/dagascii: Use pager instead of AsciiCanvas._do_draw
2019-12-07 01:16:16 +02:00
Tymoteusz Jankowski
44df59f96c
Fix test_dagascii tests
2019-12-06 23:36:21 +01:00
Mr. Outis
2145daa130
analytics: define private methods
2019-12-06 16:26:10 -06:00
Tymoteusz Jankowski
ffefab152e
Remove make_pager.cmd attribute
2019-12-06 22:17:44 +01:00
Tymoteusz Jankowski
ed4e951f22
Use monkeypatch in test_dagascii.py
2019-12-06 21:58:56 +01:00
Tymoteusz Jankowski
6cfc831879
Use mocker fixture in test_dagascii.py
2019-12-06 21:54:40 +01:00
Mr. Outis
5a8033415d
tests: use str, builtin_str in schema
2019-12-06 13:54:17 -06:00
Tymoteusz Jankowski
8fb754a4f4
Simplify if in find_pager
2019-12-06 20:42:10 +01:00
Mr. Outis
f704e5468b
tests: stringify tmp_global_config since it doesnt return a pathlike object
2019-12-06 10:20:30 -06:00
Ruslan Kuprieiev
8fa26825ee
Merge pull request #2894 from odd-industries/master
...
import-url: support directories
2019-12-06 16:12:04 +02:00
Vera Sativa
896b08c11d
fix: test requirements
2019-12-06 10:55:18 -03:00
Vera Sativa
b2e3fd2dbd
fix: test imports
2019-12-06 10:20:53 -03:00
Mr. Outis
Aman Sharma
pawel
Ruslan Kuprieiev
Max Risuhin
Veselin Borisov
Alexander Schepanovski
Tymoteusz Jankowski
Vera Sativa