Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-02 07:18:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
4,153 Commits 7 Branches 579 Tags
c27988a04291ddfa200e8c0b96049c4659706ca7
Commit Graph
170 Commits
Author SHA1 Message Date
Max Risuhin e7227898e4 Support GDrive as remote 2019-11-29 01:21:10 -08:00
Ruslan Kuprieiev 510ff8a9da Merge pull request #2863 from Suor/locks 
remote: protect all remote client/session creation code with locks
 2019-11-29 11:18:56 +02:00
Ruslan Kuprieiev 593ab17d25 setup: don't forget contextlib2 2019-11-29 02:14:25 +02:00
Alexander Schepanovski 73eac3b6cc remote: protect all remote client/session creation code with locks 
With @cached_property last write wins, so all threads will use the same
session. However, several might be created concurrently wasting
resources and even potentially asking something from the user.

This change guarantees only one client instance will be created for a
remote.
 2019-11-28 21:05:20 +01:00
Saugat Pachhai 461a79e1e8 Fix typos 2019-11-26 20:07:20 +05:45
Ruslan Kuprieiev a1433ba356 Merge branch 'master' into opt-validate 2019-11-20 11:00:28 +02:00
Ruslan Kuprieiev 7fae34ee5d test: freeze pytest-mock version 
To address failing tests.
 2019-11-19 18:52:10 +02:00
Alexander Schepanovski 3bffe9dbff dvc: drop schema from requirements 2019-11-18 17:24:40 +01:00
Alexander Schepanovski 78fad73f2b perf: switch schema validation library 
voluptuous is compiling schema to python function, which makes it
faster.
 2019-11-14 22:33:28 +01:00
Alexander Schepanovski 58c9e5557c perf: optimize yaml parsing for stages 2019-11-11 13:41:50 +01:00
Casper da Costa-Luis 2e1360a34f non-blocking intermediate progress IO 
- fixes #2766
 2019-11-09 01:43:47 +00:00
Ruslan Kuprieiev ee70822bd4 Merge pull request #2736 from efiop/master 
dvc: automatically reorder imports
 2019-11-05 03:02:32 +02:00
Ruslan Kuprieiev 95fe1578bb dvc: automatically reorder imports 2019-11-05 02:34:40 +02:00
Ruslan Kuprieiev b718b839bf system: win: use win32file for _getdirinfo 
Current implementation is triggering some non-obvious gc bug, that
causes memory leaks. Using win32file simplifies the code and gets rid of
this bug.

To reproduce it, run:

```
from dvc.system import System

while True:
    System.inode(__file__)
```

and see your Windows machine run out of memory pretty quickly.
 2019-11-05 01:46:21 +02:00
Ruslan Kuprieiev e75c52a170 setup: freeze awscli version 2019-11-03 15:09:29 +02:00
Ruslan Kuprieiev 3514cc5b5a test: freeze moto version 2019-11-03 14:49:36 +02:00
Alexander Schepanovski 77fcd49695 dvc: fix tqdm dep (#2694) 
tqdm==4.35.0 was throwing KeyError: 'percentage'.
 2019-10-30 16:43:18 +02:00
Ruslan Kuprieiev 24ed639901 setup: add upper limit for tqdm version 
https://github.com/iterative/dvc/issues/2659#issuecomment-545940739
 2019-10-24 17:29:53 +03:00
Ruslan Kuprieiev 8d067c8805 setup: update project url 2019-10-24 15:19:04 +03:00
Ruslan Kuprieiev e7c5ea6bb4 setup: use more flexible networkx reqs 
https://github.com/iterative/dvc/commit/50fc721811a015142b476e90f8d198a99e88892f
 2019-10-17 15:13:12 +03:00
Ruslan Kuprieiev 50fc721811 setup: fix networkx reqs 2019-10-17 14:22:28 +03:00
Ruslan Kuprieiev 2df6555ef0 setup: update pyinstaller to 3.5 (#2615) 
As a part of the research for https://github.com/iterative/dvc/issues/2600
 2019-10-16 17:22:25 +03:00
Irchan Bani 711dc2ea9a setup: change define __version__ (#2592) 
* setup: change define __version__

* setup: run pre-commit install, black, adn flake8
 2019-10-10 14:21:16 +03:00
Ruslan Kuprieiev 449f43f3cc requirements: require gitdb2 >= 2.0.6 
Fixes https://github.com/iterative/dvc/issues/1880
 2019-10-04 12:58:59 +03:00
Mr. Outis cfecb75c4c setup: pathspec@1d321d -> pathspec>=0.6.0 2019-10-03 21:55:21 -05:00
Mr. Outis 1f6d8964b5 setup: pathspec@master -> pathspec@1d321d 2019-10-03 12:25:12 -05:00
Mr. Outis a47ea23561 git: use escape method from GitWildMatchPattern 2019-10-03 12:10:52 -05:00
Alexander Schepanovski eac0aa13b2 perf: use packaging.version instead of pkg_resources 
This is the same functionality without a cost of loading a huge package.
 2019-09-17 14:32:31 +07:00
Alexander Schepanovski 293a50d75c perf: use fast entry points on non-wheel install 
This avoids importing `pkg_resources` on startup, which saves around 200
ms.

NOTE: wheel installer uses its own entry points template, which is the same
fastentrypoints.py script provides, so no gain there.
 2019-09-12 22:33:59 +07:00
Paweł RedzyńskiandRuslan Kuprieiev 69f0de0090 google-resumable-media build problems (#2449) 
* google-resumable-media hook for pyinstaller

* working wtih g-r-m build with -e

* update google-cloud-storage

* google-cloud-storage hook: remove hiddenimports

* Update setup.py

Co-Authored-By: Ruslan Kuprieiev <[email protected]>
 2019-09-12 12:12:37 +03:00
Ruslan Kuprieiev 05adcf9a4f Merge pull request #2461 from Suor/nfs 
dvc: switch to flufl lock
 2019-09-11 16:43:40 +03:00
Alexander Schepanovski d9d85f3cb0 dvc: fix locks in Python2.7/Windows 
Return to zc.lockfile lock in Python 2, NFS is not supported there
anyway since sqlite3 doesn't support URIs.
 2019-09-11 14:17:21 +07:00
Mr. Outis e0fd808ab0 setup: iterative/mock-ssh-server -> pypi mock-ssh-server 2019-09-09 11:15:49 -05:00
Mr. Outis b4507444d5 version: adjust get_fs_type to discover all partitions 2019-09-06 19:27:23 -05:00
Alexander Schepanovski 1bdaca0d6c dvc: switch to flufl lock 
This locks employs hardlink trick, which works on NFS and alike unlike
fcntl/open locks.

Closes #1918.
 2019-09-06 16:29:09 +07:00
Mr. Outis d7da4fcd37 fix formatting 2019-09-05 10:52:15 -05:00
Mr. Outis cdee18a7a6 fix formatting 2019-09-03 00:27:10 -05:00
Mr. Outis 69638527cb setup: mroutis/mock-ssh-server -> iterative/mock-ssh-server 2019-09-03 00:01:14 -05:00
Mr. Outis bbfaf3a22b setup: use mock-ssh-server version supporting lstat 2019-09-02 23:21:20 -05:00
pawel 331ab8c983 refactor note 2019-08-30 18:29:35 +02:00
Paweł RedzyńskiandRuslan Kuprieiev bd04972e9e Update setup.py 
Co-Authored-By: Ruslan Kuprieiev <[email protected]>
 2019-08-30 18:13:49 +02:00
Paweł RedzyńskiandRuslan Kuprieiev 48ac0b7c27 Update setup.py 
Co-Authored-By: Ruslan Kuprieiev <[email protected]>
 2019-08-30 18:13:40 +02:00
pawel 3c01f07ffd setup: add note why we restrict google-resumable-media version 2019-08-30 14:04:12 +02:00
pawel e766595687 workaround for google-resumable-media==0.3.3 build problem 2019-08-30 12:03:19 +02:00
Casper da Costa-Luis c9342754ed fixed with progress 
- fixes #2434
 2019-08-25 01:18:57 +01:00
Ruslan Kuprieiev 096a043e21 dvc: don't include gssapi 
If user needs it, he can install it by himself through pip.

https://github.com/iterative/dvc/pull/2424#issuecomment-523990535

https://github.com/iterative/dvc.org/pull/582
 2019-08-24 07:20:06 +03:00
joshua postel cbc5e1b52d setup.py: add gssapi requirement 
Fixes #2327
 2019-08-21 14:10:53 -04:00
Casper da Costa-Luis f90fd179b1 update tqdm version 2019-08-18 23:43:35 +01:00
Casper da Costa-Luis 7328ff4866 update tqdm requirement 2019-08-11 01:41:01 +01:00
Casper da Costa-Luis 1511fd6dcc add preliminary tqdm work 2019-08-10 14:11:02 +01:00