Tomás Farías SantanaandRuslan Kuprieiev ca2e6a004c Support for WebHDFS (#4747) ...

* Add support for WebHDFS

* Style and linting fixes

* Implement abstract methods and disable no-member pylint errors

* Add init unit test

* Yield client and fix redefinition of hdfs

* Get dynamic hdfs Docker port

* Add support for open in WebHDFSTree

* Remove hdfscli_config fallbacks in WebHDFSTree

* Use port 50070 for webhdfs

* WebHDFSTree supports http URL and proper walking

* Fix failing unit test after refactoring

* Add overwrite argument to upload

* Add remaining func tests for webhdfs

* Remove print statements

* Allow dynamic attributes in pylint for hdfs library

* Comment error on instantiating HDFS client from config

* Remove depth argument from call to walk

* Update dvc/tree/webhdfs.py

* Remove unnecessary deque

* Check exception messages hdfs client failure from config

* Return client directly

Co-authored-by: Ruslan Kuprieiev <[email protected]>

* Split long line

* Add size to HashInfo

* Implement move via hdfs.rename

* Add missing line

* Make parent directories before moving file in WebHDFS

* Add total to progress bar

Co-authored-by: Ruslan Kuprieiev <[email protected]>

2020-11-17 20:02:02 +02:00

..

experiments

experiments: preserve file permissions across tmpdir execution (#4890)

2020-11-18 00:47:57 +09:00

metrics

plots/metrics: fix some communication disrepancies (#4837)

2020-11-07 02:56:14 +02:00

params

add py support for ParamsDependency (#4456)

2020-09-24 17:25:44 +03:00

remote

[#4136] fixed recalculating relative paths in config (#4802)

2020-11-10 14:56:44 +02:00

__init__.py

test: move func tests to tests/func

2019-04-16 20:19:22 +03:00

conftest.py

plots: modify: handle --unset for nonexistent options (#4044)

2020-06-15 20:31:08 +03:00

test_add.py

Support for WebHDFS (#4747)

2020-11-17 20:02:02 +02:00

test_analytics.py

Drop Python 3.5 support (#3792)

2020-05-14 01:46:42 +03:00

test_api.py

Support for WebHDFS (#4747)

2020-11-17 20:02:02 +02:00

test_cache.py

dvc: refactor cache/remote relations (#4867)

2020-11-10 18:38:28 +02:00

test_check_ignore.py

check-ignore show sub-repo patterns (#4564)

2020-09-15 06:59:41 +03:00

test_checkout.py

dvc: use DirInfo instead of dicts/lists (#4851)

2020-11-07 02:55:05 +02:00

test_cli.py

cli: add --cd flag to change directories before executing commands (#4566)

2020-09-25 04:20:22 +03:00

test_commit.py

state: use granularly (#4676)

2020-10-08 08:36:14 +03:00

test_config.py

[#4136] fixed recalculating relative paths in config (#4802)

2020-11-10 14:56:44 +02:00

test_data_cloud.py

Support for WebHDFS (#4747)

2020-11-17 20:02:02 +02:00

test_dependency.py

Enable most of the pylint checks (#4111)

2020-06-25 18:10:14 +03:00

test_diff.py

diff: add state for files missing from both workspace and cache (#4530)

2020-09-07 04:44:04 +03:00

test_dvcfile.py

dvc: change dvcfile.dump to do synchronized dump by default (#4544)

2020-09-10 13:12:00 +05:45

test_external_repo.py

support subrepos for get/list/api/import/ls (#4465)

2020-09-03 13:47:14 +03:00

test_feature_flags.py

Parametrization support on dvc.yaml (#4679)

2020-10-14 05:32:05 -07:00

test_fs.py

lint: isort pre-commit & misc improvements (#3749)

2020-05-06 23:56:07 +03:00

test_gc.py

Support for WebHDFS (#4747)

2020-11-17 20:02:02 +02:00

test_get_url.py

get-url/import-url: save dependency before downloading (#4049)

2020-06-16 13:05:21 +03:00

test_get.py

tests: testing when overwriting files (#4738)

2020-10-27 15:52:16 +02:00

test_ignore.py

RepoTree: add support for subrepo traversal (#4381)

2020-08-15 17:27:00 +03:00

test_import_url.py

Support for WebHDFS (#4747)

2020-11-17 20:02:02 +02:00

test_import.py

import: add --no-exec param (#4817)

2020-10-31 20:03:33 +02:00

test_init.py

Special dir warning #3436 (#4229)

2020-08-13 01:03:34 +03:00

test_install.py

dvc: add size/nfiles for deps/outs (#4836)

2020-11-04 19:22:57 +02:00

test_lock.py

lock: added troubleshooting doc link in error message (#4325) (#4721)

2020-10-19 20:47:08 +03:00

test_lockfile.py

dvc: add size/nfiles for deps/outs (#4836)

2020-11-04 19:22:57 +02:00

test_ls.py

support subrepos for get/list/api/import/ls (#4465)

2020-09-03 13:47:14 +03:00

test_merge_driver.py

dvc: introduce merge-driver (#4298)

2020-08-19 17:55:12 +03:00

test_move.py

Move toml/yaml serialization to dvc.utils.serialize (#4411)

2020-08-18 13:01:16 +05:45

test_output.py

Run CI for Python3.9 (#4647)

2020-10-01 10:41:39 +03:00

test_remote.py

dvc: use DirInfo instead of dicts/lists (#4851)

2020-11-07 02:55:05 +02:00

test_remove.py

remove: clean gitignore content (#4074)

2020-06-19 19:38:18 +03:00

test_repo.py

Enable most of the pylint checks (#4111)

2020-06-25 18:10:14 +03:00

test_repro_multistage.py

experiments: support exp run --checkpoint for baseline commits (#4701)

2020-10-13 23:10:08 +03:00

test_repro.py

dvc: add size/nfiles for deps/outs (#4836)

2020-11-04 19:22:57 +02:00

test_run_cache.py

state: use granularly (#4676)

2020-10-08 08:36:14 +03:00

test_run_multistage.py

dvc: add size/nfiles for deps/outs (#4836)

2020-11-04 19:22:57 +02:00

test_run_single_stage.py

dvc: use HashInfo to interact with cache (#4506)

2020-09-01 03:32:51 +03:00

test_s3.py

s3: provide more helpful messages on common errors (#4480)

2020-08-27 23:09:12 +03:00

test_scm.py

Drop Python 3.5 support (#3792)

2020-05-14 01:46:42 +03:00

test_stage_resolver.py

Skip loading globally used params section again locally for stages (#4859)

2020-11-07 09:30:12 +05:45

test_stage.py

experiments: support exp run --checkpoint for baseline commits (#4701)

2020-10-13 23:10:08 +03:00

test_state.py

dvc: add size/nfiles for deps/outs (#4836)

2020-11-04 19:22:57 +02:00

test_status.py

Keep status output format consistents (#4490)

2020-08-31 00:03:21 +03:00

test_system.py

Fix typos

2019-11-26 20:07:20 +05:45

test_tree.py

dvc: use DirInfo instead of dicts/lists (#4851)

2020-11-07 02:55:05 +02:00

test_unprotect.py

remove: try deleting before trying to chmod (#3620)

2020-04-10 23:21:16 +03:00

test_update.py

Support for WebHDFS (#4747)

2020-11-17 20:02:02 +02:00

test_utils.py

pyupgrade: 3.6+ (#3805)

2020-05-15 16:48:02 +03:00

test_version.py

Run CI for Python3.9 (#4647)

2020-10-01 10:41:39 +03:00