Ilya PekelnyandRuslan Kuprieiev 2f620e9226 4504: configuration-based job limit. (#4872) ...

* Job count expected in a core config

Besides defaulted 4 * core_count number of workers sourced in the
"tree", the configuration file based value expected and prioritised.

* Multiply the configured value by cpu cores count.

* Don't multiply by the core count twice.

* A couple more usages and a question note.

* Don't multiply a number of jobs to a cpu count

Number of jobs set in a config file directly used to spawn workers.

* Remove the obsolete note.

* Disallow 0 jobs set in a config

* `jobs` config-based value is optional

* Apply suggestions from code review

Co-authored-by: Ruslan Kuprieiev <[email protected]>

* CPU count based default

* Update dvc/tree/base.py

* Happy path unit test

* Update tests/unit/remote/test_remote.py

* Fix the accidentally removed blank line

* Update dvc/tree/base.py

Co-authored-by: Ruslan Kuprieiev <[email protected]>

2020-11-13 21:30:02 +02:00

..

cache

dvc: refactor cache/remote relations (#4867)

2020-11-10 18:38:28 +02:00

command

dag: add --outs option (#4739)

2020-11-12 18:23:31 +09:00

dependency

remote: add WebDAV dependency (#4690)

2020-10-10 00:07:34 +03:00

output

dvc: use DirInfo instead of dicts/lists (#4851)

2020-11-07 02:55:05 +02:00

remote

4504: configuration-based job limit. (#4872)

2020-11-13 21:30:02 +02:00

repo

state: use granularly (#4676)

2020-10-08 08:36:14 +03:00

scm

git: move branch iteration functionality from experiments into scm.git (#4810)

2020-10-30 19:06:35 +09:00

stage

run-cache: don't save always_changed stages (#4719)

2020-10-14 17:43:16 +03:00

tree

dvc: use DirInfo instead of dicts/lists (#4851)

2020-11-07 02:55:05 +02:00

utils

yaml: wrap ruamel's DuplicateKeyError (#4668)

2020-10-05 23:02:59 +03:00

__init__.py

azure: fix backward compatibility

2018-12-28 19:58:25 +02:00

test_analytics.py

Enable most of the pylint checks (#4111)

2020-06-25 18:10:14 +03:00

test_config.py

config: use wtree for non-repo configs (#4341)

2020-08-06 17:37:21 +03:00

test_context.py

parametrization: Support keys of the dictionary to be interpolated (#4869)

2020-11-10 17:32:58 +05:45

test_daemon.py

Enable most of the pylint checks (#4111)

2020-06-25 18:10:14 +03:00

test_dagascii.py

Fix test_dagascii tests

2019-12-06 23:36:21 +01:00

test_dir_info.py

dvc: use DirInfo instead of dicts/lists (#4851)

2020-11-07 02:55:05 +02:00

test_dvcfile.py

dvc: change dvcfile.dump to do synchronized dump by default (#4544)

2020-09-10 13:12:00 +05:45

test_external_repo.py

--jobs now takes effect on imported data (#4765)

2020-10-27 01:21:51 +02:00

test_ignore.py

Optimize dvcignore (#4242)

2020-07-23 00:01:09 +03:00

test_imports.py

Enable most of the pylint checks (#4111)

2020-06-25 18:10:14 +03:00

test_info.py

Run CI for Python3.9 (#4647)

2020-10-01 10:41:39 +03:00

test_interpolate.py

Fix merge_update not converting data to Node object (#4846)

2020-11-07 03:02:24 +02:00

test_lockfile.py

Move to yaml1.2 (#4415)

2020-08-19 17:56:38 +03:00

test_logger.py

Enable most of the pylint checks (#4111)

2020-06-25 18:10:14 +03:00

test_path_info.py

make pull --run-cache work with local remote having relative path (#4670)

2020-10-19 17:53:01 +09:00

test_pathspec_math.py

dvc check-ignore command (#4282)

2020-08-03 08:27:50 +03:00

test_progress.py

ui: make progress bars respect --quiet (#3316)

2020-02-15 00:53:52 +02:00

test_prompt.py

dvc: automatically reorder imports

2019-11-05 02:34:40 +02:00

test_run.py

refactor/test multistage load for params and outputs (#3949)

2020-06-04 23:35:07 +03:00

test_rwlock.py

Drop Python 3.5 support (#3792)

2020-05-14 01:46:42 +03:00

test_stage_resolver.py

dvc.yaml: implement set keyword (#4757)

2020-11-02 20:32:07 +05:45

test_state.py

lint: isort pre-commit & misc improvements (#3749)

2020-05-06 23:56:07 +03:00

test_updater.py

Config to enable/disable updater (#4334)

2020-08-10 11:59:25 +03:00

test_version.py

version: decode correctly commands output

2020-01-13 12:36:47 -06:00