Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-11 15:28:27 +01:00
Code Issues Packages Projects Releases Wiki Activity
8,866 Commits 7 Branches 579 Tags
f69b3533e4488d1b04b02894de288f2e7d16b175
Commit Graph
8866 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ruslan Kuprieiev 5902e6066c remove: add -o|--outs and -p|--purge options 
Fixes #761

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-13 13:15:40 +03:00
Ruslan Kuprieiev 582cb9e064 Merge pull request #759 from franekp/master 
Fix bottlenecks related to large number of files.
 2018-06-10 21:04:22 +03:00
Franciszek Piszcz e380a4a858 Fix bottlenecks related to large number of files. 2018-06-10 16:35:49 +02:00
Ruslan Kuprieiev 35f5945720 Merge pull request #757 from efiop/master 
dvc: initial hdfs support
 2018-06-10 05:36:46 +03:00
Ruslan Kuprieiev ff0d91737b dvc: initial hdfs support 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-10 05:32:16 +03:00
Ruslan Kuprieiev 77b814f039 Merge pull request #756 from efiop/master 
Support deps/outputs that are relative to specific remote
 2018-06-09 02:08:41 +03:00
Ruslan Kuprieiev a734e07776 dvc: support deps/outputs that are relative to specific remote 
Fixes #748

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-09 02:03:02 +03:00
Ruslan Kuprieiev fecc38e602 remote: use default urls 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-09 01:09:44 +03:00
Ivan Shcheklein 6fe26a0bdc minor: fix links in README to target dvc.org instead of dataversioncontrol.com 2018-06-08 12:20:12 -07:00
Ruslan Kuprieiev 2cd4312423 Merge pull request #753 from efiop/master 
status: report callback stages as changed
 2018-06-08 17:16:24 +03:00
Ruslan Kuprieiev e68137181e status: report callback stages as changed 
Fixes #751

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-08 16:43:50 +03:00
Ruslan Kuprieiev 2e347847ec Merge pull request #752 from efiop/master 
stage: try to specify user's shell when running commands
 2018-06-07 23:49:32 +03:00
Ruslan Kuprieiev c136297b82 stage: try to specify user's shell when running commands 
Fixes #749

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-07 23:19:29 +03:00
Ruslan Kuprieiev 6218124764 travis: run hadoop only on linux 2018-06-06 17:09:38 +03:00
Ruslan Kuprieiev 22718faf9c Merge pull request #747 from efiop/master 
travis: run docker image with hadoop
 2018-06-06 14:58:47 +03:00
Ruslan Kuprieiev a2bc64e85f travis: run hadoop docker image 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-06 14:34:54 +03:00
Ruslan Kuprieiev f2a5058a74 Merge pull request #746 from efiop/master 
checkout: create dir even if it is empty
 2018-06-06 02:57:49 +03:00
Ruslan Kuprieiev 38c585a5f9 checkout: create dir even if it is empty 
Fixes #737

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-06 02:37:51 +03:00
Ruslan Kuprieiev 408f96b31c Merge pull request #745 from efiop/master 
dvc: add --cwd for dvc repro
 2018-06-06 02:21:14 +03:00
Ruslan Kuprieiev 9389422f0b dvc: add --cwd for dvc repro 
Fixes #401

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-06 01:42:06 +03:00
Ruslan Kuprieiev 5d169916de Merge pull request #740 from efiop/master 
Add initial support for s3/gs outputs/deps/cache_dirs
 2018-06-04 22:38:24 +03:00
Ruslan Kuprieiev dd610c04fb test: add test for s3/gs out/dep/cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 585c27f354 cloud: use project.cache.local instead of project.cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 346ef139dd out: properly remove outputs when reproducing 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 331e3b2bf9 cache: fix cache_dir resolving 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:15 +03:00
Ruslan Kuprieiev 7a7c9e7713 dvc: fix import conflicts 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 1ef21039c4 remote: use Remote() func to determine remote type 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 42265339a8 remote: rename Remote -> RemoteBase 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev fc53971f2b dvc: temporarily only count local cache as used cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 484b04cb68 outs: raise exception if no cache location setup for s3/gs 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 88397ef430 dvc: use Remote concept in existing code 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 6f4d0cd74a cache: use atomic move to avoid using Lock() 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev f03ea7a915 dvc: move link_state from Cache to Project 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 08dcd8490e outs/deps: remove loadd 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 5c1748c15c outs/deps: remove loads method 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev fbfdecd1de outs/deps: remove type-specific SCHEMAs 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev f3b2497fb9 deps/outs: remove load{s,d}_from methods 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev e0a42f1265 outs: support gs/s3 as an output without cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 2e78bb2a69 deps: s3/gs: check if key exists 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-06-04 22:28:14 +03:00
Ruslan Kuprieiev 456ba271b3 dvc: rename dataversioncontrol/dvc into iterative/dvc 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-05-30 04:14:16 +03:00
Ruslan Kuprieiev 95870ce769 README: fix typo in format 2018-05-24 20:08:22 +03:00
Ruslan Kuprieiev 92cbda749f README: use remotes instead of an obsoleted model 2018-05-24 20:07:57 +03:00
Ruslan Kuprieiev 33b26278fe Merge pull request #731 from efiop/master 
test: temporarily disable gs dependency test on CI
 2018-05-24 19:05:03 +03:00
Ruslan Kuprieiev ac3d37e58c test: temporarily disable gs dependency test on CI 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-05-24 18:58:20 +03:00
Ruslan Kuprieiev a35b3aa67a travis: specify BOTO_CONFIG=/dev/null 
See https://github.com/travis-ci/travis-ci/issues/7940
 2018-05-24 18:50:52 +03:00
Ruslan Kuprieiev 7a3aa54293 Merge pull request #730 from efiop/master 
gs/s3 as dependency
 2018-05-24 18:31:09 +03:00
Ruslan Kuprieiev b85c41c734 updater: use response.json() 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-05-24 18:24:18 +03:00
Ruslan Kuprieiev 2bbefc91ef deps: introduce s3/gs dependencies 
E.g.:
dvc run -d gs://bucket/file -o file gsutil cp gs://bucket/file file
dvc run -d s3://bucket/file -o file aws s3 cp s3://bucket/file file

Etags are used to track deps in both cases.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-05-24 18:24:18 +03:00
Ruslan Kuprieiev 69f9c5d837 Merge pull request #724 from efiop/master 
dvc: split output and dependency classes
 2018-05-23 01:51:09 +03:00
Ruslan Kuprieiev 56e76d0d8b outs/deps: use 'stage' instead of 'project' 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-05-23 00:51:08 +03:00