Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-12 15:28:21 +01:00
Code Issues Packages Projects Releases Wiki Activity
5,831 Commits 7 Branches 579 Tags
ff3b686058f0796cbb6e533cb2e932eecbe5375e
Commit Graph
62 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 76228a2118 dvc: split remotes from trees (#4212) 
* dvc: remove tree-specific wrappers from remote

This helps combat the remote/tree/cache confusion.

* dvc: split remotes from trees

Related to #4050
 2020-07-15 23:44:09 +03:00
Mr. Outis 5e7a152b53 ssh: use sftp when possible 
Related #830 [1/2]
 2019-02-18 19:03:06 -06:00
Ruslan Kuprieiev bbd27527ff remote: RFC: remote.save() 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-02-16 21:18:26 +02:00
Ruslan Kuprieiev 70c21f7f3e ssh: handle url without path 
https://discordapp.com/channels/485586884165107732/485596304961962003/545702950350356502

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-02-15 04:38:45 +02:00
Ruslan Kuprieiev ba8d83e9b1 dvc: refactor dvc project class 
1) split Project's methods into separate files;
2) rename Project into Repo(similar to gitpython's Repo)

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-02-13 03:31:23 +02:00
Mr. Outis ec77bfa1af remote: define command error on the base 
fix: #1484
 2019-02-09 12:03:17 -06:00
Paweł Redzyński 3d07c0a039 import: add resume flag (#1540) 
Resume import
 2019-02-04 21:40:08 +02:00
Ruslan Kuprieiev 4896f08ddf dvc: comply with both flake8 and black 
flake8 provides some additional features like unused vars check, etc, so
it makes total sense to use it as well.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-02-04 00:10:36 +02:00
Ruslan Kuprieiev 4069e34130 dvc: use black instead of flake8 
Fixes #1546

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-01-30 03:48:36 +02:00
Mr. Outis 0d46921ec7 py2: add unicode literals 
Fix #1512
 2019-01-27 20:40:21 -06:00
Ruslan Kuprieiev 313541d047 RFC: remote: unify changed() method 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-01-09 17:46:36 +02:00
Ruslan Kuprieiev 3053cf2b1f ssh: support specifying port in the url 
Fixes #1473

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-01-08 10:12:43 +02:00
Ruslan Kuprieiev 5d381da5d9 ssh: change order of user configuration 
Unfortunately this breaks backward compatibility, but we have to do it,
because current order is totally wrong. Configuring user with `dvc
remote modify myssh user` is an explicit action and should have higher
priority than implicit url. This is also important, since in the next
patch in this PR we will introduce support for `port` configuration,
that should also follow the same logic.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-01-08 10:12:43 +02:00
Ruslan Kuprieiev 484f318c27 remote: local: support relative paths 
Fixes #1421

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-01-04 21:14:03 +02:00
Mr. Outis 4c420d5f4d logger [rfc]: Use a module instead of a class 
- Remove deprecation warnings
- Format error output and remove duplicated info

Close #1086
 2018-12-23 21:06:39 -06:00
Ruslan Kuprieiev ef766fb4d3 remote: RFC: unify checkout() 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-12-20 22:09:26 +02:00
Ruslan Kuprieiev ecb80d98dd remote: RFC: unify cache_exists() 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-12-20 22:09:26 +02:00
Ruslan Kuprieiev 7758e53b35 remote: RFC: unify changed_cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-12-20 22:09:26 +02:00
Ruslan Kuprieiev 141de1443c remote: RFC: unify gc code 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-12-20 22:09:26 +02:00
Ruslan Kuprieiev 2a46247cb2 remote: RFC: unify checksum <-> path convertions 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-12-20 22:09:26 +02:00
Ruslan Kuprieiev 7600ccf8be remote: introduce cache_exists() method 
Making this method separate from exists() makes it easier to optimize
requests for large amounts of cache, since we can re-use the same prefix
for retrieving all the necessary information in a one single request.

Related #1430

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-12-20 22:09:26 +02:00
Mr. Outis 948021f5b0 rfc: Prompt as functions instead of a class 2018-12-14 10:47:18 -06:00
Ruslan Kuprieiev 22724f0500 ssh: mention private key passphrase in the prompt 
Fixes #1425
 2018-12-11 14:11:21 +02:00
Ruslan Kuprieiev e02a33f934 logger: shortcut logger in quiet and normal modes 
In scenarios with millions of files, late shorcutting of
debug msgs results in massive overhead. In order to avoid
that, just shortcut logger messages ASAP if verbose mode
is not enabled.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-12-11 12:07:28 +02:00
Ruslan Kuprieiev 8ad317e906 remote: properly check status for remote outputs 
Fix #1402

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-12-04 04:33:22 +02:00
Ruslan Kuprieiev 1c36ef3f43 remote: use warning if upload/download failed 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-10-19 03:48:29 +03:00
Ruslan Kuprieiev 8aa53a5e71 dvc: introduce per-remote --jobs default 
Fixes #1167

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-10-01 15:28:38 +03:00
Ruslan Kuprieiev 8d5675a92c ssh: properly join chunks on python3 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-09-19 18:58:36 +03:00
Ruslan Kuprieiev 9dab3f2e49 ssh: fix order 2018-09-19 07:19:02 +03:00
Ruslan Kuprieiev 682737e4a2 ssh: add 'password' and 'ask_password' options 
Fixes #1124

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-09-19 05:50:06 +03:00
Ruslan Kuprieiev 8d13ba164e ssh: don't recv() before checking with recv_ready() 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-09-09 18:48:57 +03:00
Ruslan Kuprieiev abf395da99 ssh: properly poll output 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-09-08 21:14:50 +03:00
Ruslan Kuprieiev 0687c4e199 ssh: add timeout 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-09-08 16:17:08 +03:00
Ruslan Kuprieiev c46bba6889 ssh: configure private key file 
Fixes #1059

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-08-27 12:54:47 +03:00
Ruslan Kuprieiev 1283689ed4 ssh: add ability to configure port 
Fixes #1060

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-08-27 09:31:35 +03:00
Ruslan Kuprieiev 3ec0a5c4ae remote: add additional checks and msgs for checkout 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-08-11 21:27:07 +03:00
Ruslan Kuprieiev 3814e0da4e remote: add changed() method 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-08-11 05:37:08 +03:00
Ruslan Kuprieiev b15f5ffa3b dvc: print a msg when there is no cache to remove 
Fix #990

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-08-10 18:52:35 +03:00
Ruslan Kuprieiev 0e9774a3f8 RFC: follow flake8 rules 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-25 17:28:58 +03:00
Ruslan Kuprieiev 805eb908d0 import: support external urls 
Fixes #891

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-17 12:00:12 +03:00
Ruslan Kuprieiev dd06f53bc7 remote: use path_infos instead of regular paths in upload/download 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-16 20:00:53 +03:00
Ruslan Kuprieiev d71df35f63 gc: take into account local cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-11 22:27:13 +03:00
Ruslan Kuprieiev d24457c14f gc: choose which cache to process inside the drivers 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-11 22:27:13 +03:00
Clemens Wolff afd46e1a8a Fix CodeClimate inspections 2018-07-09 16:06:10 -04:00
Ruslan Kuprieiev 3405a1ec47 remote: ssh: remove unused code 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-01 21:19:24 +03:00
Ruslan Kuprieiev 5a3543b36f RFC/perf: optimise push/pull/status 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-30 22:10:03 +03:00
Ruslan Kuprieiev f71c907a0e ssh: choose md5 command depending on the os 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-30 18:35:59 +03:00
Ruslan Kuprieiev 4d22842ccf Don't forget to import DvcException 2018-06-30 17:49:42 +03:00
Ruslan Kuprieiev 555e802ed2 RFC/perf: data cloud logic 
Properly splitting jobs between thread workers and removing unnecessary logic.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-30 07:44:11 +03:00
Ruslan Kuprieiev 50578a5923 gc: support s3/gs/ssh/hdfs 
Fixes #738

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-28 21:32:57 +03:00