mirror of
https://github.com/Stone-Red-Code/dvc.git
synced 2026-11-11 07:18:28 +01:00
nanaya-tachibana
7ceaf88c54
* remote: add support for aliyun oss Usage: $ dvc remote add myremote oss://my-bucket.endpoint/path Set key id and key secret using modify command $ dvc remote modify myremote oss_key_id my-key-id $ dvc remote modify myremote oss_key_secret my-key-secret or environment variables $ export OSS_ACCESS_KEY_ID="my-key-id" $ export OSS_ACCESS_KEY_SECRET="my-key-secret" Ref: oss python SDK: https://www.alibabacloud.com/help/doc-detail/32026.htm * Not needed, since we don't support external dependencies/outputs on OSS. See https://github.com/iterative/dvc/pull/1961. * Add a way to test oss storage using docker. Start a container running an oss emulator. $ git clone https://github.com/nanaya-tachibana/oss-emulator.git $ docker image build -t oss:1.0 oss-emulator $ docker run --detach -p 8880:8880 --name oss-emulator oss:1.0 Setup environment variables. $ export OSS_BUCKET='my-bucket' $ export OSS_ENDPOINT='localhost:8880' $ export OSS_ACCESS_KEY_ID='AccessKeyID' $ export OSS_ACCESS_KEY_SECRET='AccessKeySecret' * Use default key id and key secret when they are not given, which gives read access to public read bucket and public bucket. * test: add oss tests to appveyor. * remove unneeded tests. * remote: use s3 style url for oss storage and make endpoint a configurable value. Usage: $ dvc remote add myremote oss://my-bucket/path Set key id, key secret and endpoint using modify command $ dvc remote modify myremote oss_key_id my-key-id $ dvc remote modify myremote oss_key_secret my-key-secret $ dvc remote modify myremote oss_endpoint endpoint or environment variables $ export OSS_ACCESS_KEY_ID="my-key-id" $ export OSS_ACCESS_KEY_SECRET="my-key-secret" $ export OSS_ENDPOINT="endpoint" * remote: fallback to [] if there are no cinfos Signed-off-by: Ruslan Kuprieiev <[email protected]> * test: remote: add oss CLI test Signed-off-by: Ruslan Kuprieiev <[email protected]> * travis: use iterative's fork of oss-emulator Just to keep things in-house. Signed-off-by: Ruslan Kuprieiev <[email protected]>
34 lines
659 B
Plaintext
34 lines
659 B
Plaintext
azure-storage-blob==1.3.0
|
|
boto3==1.9.115
|
|
ply>=3.9 # See https://github.com/pyinstaller/pyinstaller/issues/1945
|
|
configparser>=3.5.0
|
|
zc.lockfile>=1.2.1
|
|
future>=0.16.0
|
|
google-cloud-storage==1.13.0
|
|
PyInstaller==3.3.1
|
|
colorama>=0.3.9
|
|
configobj>=5.0.6
|
|
networkx>=2.1
|
|
gitpython>=2.1.8
|
|
setuptools>=34.0.0
|
|
nanotime>=0.5.2
|
|
pyasn1>=0.4.1
|
|
schema>=0.6.7
|
|
paramiko>=2.4.1
|
|
jsonpath-ng>=1.4.3
|
|
requests>=2.18.4
|
|
wheel>=0.31.1
|
|
futures>=3.2.0; python_version == "2.7"
|
|
grandalf==0.6
|
|
pydot>=1.2.4
|
|
asciimatics>=1.10.0
|
|
distro>=1.3.0
|
|
appdirs>=1.4.3
|
|
treelib>=1.5.5
|
|
inflect>=2.1.0
|
|
humanize>=0.5.1
|
|
dulwich>=0.19.11
|
|
ruamel.yaml>=0.15.91
|
|
pathlib2==2.3.3; python_version == "2.7"
|
|
oss2==2.6.1
|