Commit Graph
1293 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 346ef139dd out: properly remove outputs when reproducing
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 331e3b2bf9 cache: fix cache_dir resolving
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 7a7c9e7713 dvc: fix import conflicts
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 1ef21039c4 remote: use Remote() func to determine remote type 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 42265339a8 remote: rename Remote -> RemoteBase
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev fc53971f2b dvc: temporarily only count local cache as used cache
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 484b04cb68 outs: raise exception if no cache location setup for s3/gs
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 88397ef430 dvc: use Remote concept in existing code
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 6f4d0cd74a cache: use atomic move to avoid using Lock()
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev f03ea7a915 dvc: move link_state from Cache to Project
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 08dcd8490e outs/deps: remove loadd
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 5c1748c15c outs/deps: remove loads method
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev fbfdecd1de outs/deps: remove type-specific SCHEMAs
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev f3b2497fb9 deps/outs: remove load{s,d}_from methods
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev e0a42f1265 outs: support gs/s3 as an output without cache
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 2e78bb2a69 deps: s3/gs: check if key exists
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 456ba271b3 dvc: rename dataversioncontrol/dvc into iterative/dvc
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-30 04:14:16 +03:00
Ruslan Kuprieiev 95870ce769 README: fix typo in format 2018-05-24 20:08:22 +03:00
Ruslan Kuprieiev 92cbda749f README: use remotes instead of an obsoleted model 2018-05-24 20:07:57 +03:00
Ruslan Kuprieiev 33b26278fe Merge pull request #731 from efiop/master
test: temporarily disable gs dependency test on CI
2018-05-24 19:05:03 +03:00
Ruslan Kuprieiev ac3d37e58c test: temporarily disable gs dependency test on CI
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-24 18:58:20 +03:00
Ruslan Kuprieiev a35b3aa67a travis: specify BOTO_CONFIG=/dev/null
See https://github.com/travis-ci/travis-ci/issues/7940
2018-05-24 18:50:52 +03:00
Ruslan Kuprieiev 7a3aa54293 Merge pull request #730 from efiop/master
gs/s3 as dependency
2018-05-24 18:31:09 +03:00
Ruslan Kuprieiev b85c41c734 updater: use response.json()
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-24 18:24:18 +03:00
Ruslan Kuprieiev 2bbefc91ef deps: introduce s3/gs dependencies
E.g.:
dvc run -d gs://bucket/file -o file gsutil cp gs://bucket/file file
dvc run -d s3://bucket/file -o file aws s3 cp s3://bucket/file file

Etags are used to track deps in both cases.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-24 18:24:18 +03:00
Ruslan Kuprieiev 69f9c5d837 Merge pull request #724 from efiop/master
dvc: split output and dependency classes
2018-05-23 01:51:09 +03:00
Ruslan Kuprieiev 56e76d0d8b outs/deps: use 'stage' instead of 'project'
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-23 00:51:08 +03:00
Ruslan Kuprieiev 21bf52ee9d dvc: split output and dependency classes
Preparation for the 'external deps' patches.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-23 00:01:04 +03:00
Ruslan Kuprieiev 4ab9b68fbd setup: lock google-cloud==0.32.0 2018-05-22 23:55:28 +03:00
Ruslan Kuprieiev 82890ec2a4 reqs: lock google-cloud==0.32.0
0.33.0 is broken.
2018-05-22 23:54:59 +03:00
Ruslan Kuprieiev 962ee4ab77 Merge pull request #723 from efiop/master
dvc: add cache dir to gitignore only if it is not external
2018-05-21 17:08:31 +03:00
Ruslan Kuprieiev c819ac9292 dvc: add cache dir to gitignore only if it is not external
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-21 17:00:37 +03:00
Ruslan Kuprieiev 1cc2d103f4 Merge pull request #721 from efiop/master
run: properly generate automatic name when output is a directory and …
2018-05-21 12:58:07 +03:00
Ruslan Kuprieiev d15143bb6f run: properly generate automatic name when output is a directory and no -f specified
Fixed #720

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-21 12:38:21 +03:00
Ruslan Kuprieiev 91c16e2112 Merge pull request #719 from efiop/master
Misc build fixes
0.9.7
2018-05-17 18:32:01 +03:00
Ruslan Kuprieiev 7709f57f0b reqs: add pytest(required by setuptools on some systems)
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-17 18:30:15 +03:00
Ruslan Kuprieiev 62c43f6c4f aws: remove unneeded botocore dependency
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-17 18:23:43 +03:00
Ruslan Kuprieiev 03d477499b Merge pull request #718 from efiop/master
build: remove unneeded deps of boto
2018-05-17 16:46:32 +03:00
Ruslan Kuprieiev 0f8f682a6b build: remove uneeded deps of boto
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-17 16:40:27 +03:00
Ruslan Kuprieiev cb57446c52 pyinstaller: specify hidden imports for google_cloud_engine hook 2018-05-17 16:00:15 +03:00
Ruslan Kuprieiev 8b75d2ddb7 Merge pull request #717 from efiop/master
pyinstaller: add google_compute_engine hook
2018-05-17 15:48:39 +03:00
Ruslan Kuprieiev b77ff668f6 pyinstaller: add google_compute_engine hook
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-17 15:38:12 +03:00
Ruslan Kuprieiev 56cb5134b9 Merge pull request #716 from efiop/master
reqs: freeze google-compute-engine at 2.4.1
2018-05-17 15:24:36 +03:00
Ruslan Kuprieiev 91882bf8c4 reqs: freeze google-compute-engine at 2.4.1 2018-05-17 15:15:38 +03:00
Ruslan Kuprieiev e49952f8aa scripts: posix: fix order 2018-05-17 14:54:15 +03:00
Ruslan Kuprieiev 2cb43e29dc Merge pull request #715 from efiop/master
Misc build fixes
2018-05-17 14:24:41 +03:00
Ruslan Kuprieiev adaf3f749f scripts: merge build_linux and build_macos
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-17 14:18:40 +03:00
Ruslan Kuprieiev d9a2cbb3ce reqs: add wheel to requirements.txt
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-17 14:04:11 +03:00
Ruslan Kuprieiev b116e885eb Merge pull request #714 from efiop/master
reqs: require PyInstaller 3.3.1
2018-05-17 13:15:33 +03:00
Ruslan Kuprieiev 76ed66e1af reqs: require PyInstaller 3.3.1
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-05-17 13:09:48 +03:00