Commit Graph
42 Commits
Author SHA1 Message Date
Ruslan Kuprieiev a779424a36 WIP RFC
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-12-23 09:37:40 +02:00
Ruslan Kuprieiev e853fc76aa dvc: get rid of state dir and cache_state in favor of single .dvc
From now on everything is stored in filename + .dvc path, except for local_state.
This allows us to be more explicit and help users see everything they need in relation
to version control of their own data files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-12-05 20:33:21 +02:00
Ruslan Kuprieiev f12402771b init: add *.local_state to gitignore
Fixes #313

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-11-28 21:44:19 +02:00
Dmitry db625e8213 Use DvcLock from CmdBase class only 2017-11-19 04:14:12 -08:00
Dmitry 1349589ec7 Move CmdBase class to common dir 2017-11-19 03:12:37 -08:00
Dmitry 62e8b751ba Rename STATE_DIR to STATE_DIR_NAME 2017-11-12 22:41:46 -08:00
Dmitry 849dc2d873 get rid of the empty file 2017-11-05 18:18:51 -08:00
Ruslan Kuprieiev 4ffac507df dvc: remove data dir
From now on, we're no longer tied to fixed data dir, so we can
track individual data items without forcing user to use separate
dir for them. This way we add much more flexibility for dvc, so
users can use their own project structure.

Fixes #68

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev a813ebaeb7 dvc: use hardlinks instead of symlinks
Fixes #225
Fixes #273

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-30 05:05:28 +02:00
Ruslan Kuprieiev 8bb51f5efc cache: use checksums instead of commit_id
From now on, we identify our cache files by their md5sum,
so that we can avoid cache collission in branching scenario
and also dedup same data at the same time.

Fixes #250, #251

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-10-17 14:06:43 +03:00
Dmitry 898c4be0e2 Code improvements 2017-10-09 17:10:59 -07:00
Dmitry 276e910ba8 config command changes format of empty values. Clouse #245 2017-10-07 18:50:16 -07:00
Dmitry 9436430040 Read metrics from state file 2017-09-18 04:47:39 -07:00
Dmitry 0e9402d284 State file constructor param change 2017-09-18 01:50:43 -07:00
Ruslan Kuprieiev 3286af59ef target: remove 'target' command
Fixes #209

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-17 02:41:50 +03:00
Ruslan Kuprieiev 68186b08fc dvc: move config/cache/state/target to .dvc
This is a more natural way to store dvc-related files and dirs
and follows git-logic much better.

Fixes #200

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-09-16 16:48:46 +03:00
Ruslan Kuprieiev 30bacf7f95 dvc: rename empty to .empty
This will allow us to hide it.

Fixes #104

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-26 09:18:45 +03:00
Dmitry Petrov ee0e012f86 Config redesign 2017-08-23 00:38:28 -07:00
Dmitry Petrov 5c062aadaf Extract AWS credentials from data_cloud.py 2017-08-04 19:30:04 -07:00
Dmitry Petrov 54c1aa63b0 Cloud basic 2: init 2017-08-04 04:39:48 -07:00
Ruslan Kuprieiev 883e6773f7 dvc: get rid of pathlib
Fixes #118

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-03 23:31:59 +03:00
Ruslan Kuprieiev ee34fdfa31 RFC: move cmdline parsing to cli.py and settings RFC
This will make the structure of dvc more linear
making it easier to read. Plus, these changes
are needed in preparation for libdvc, as they
move all cmdline parsing to one common place.

This patch also refactors our settings system
also make it more linear and remove abstraction
levels that are not needed and only cause confusion.
There is a lot more to be done in preparation for
dvc lib and RFC overall, but this a first step
in that long journey.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-07-31 01:39:32 +03:00
Dmitry Petrov 97088d98b1 Target cmd. First commit. 2017-07-25 02:29:49 -07:00
Dmitry Petrov 1cc813027f Small cloud fixes 2017-05-02 23:03:25 -07:00
Dmitry Petrov 819af1cd22 Cloud rename: amazon to AWS, google to GCP 2017-05-02 22:49:58 -07:00
Dmitry Petrov 26461e910e dvc help messages 2017-05-01 16:33:58 -07:00
Dmitry Petrov f6ded2fa72 Lock cmd: small changes 2017-04-29 18:01:24 -07:00
Dmitry Petrov dac5d36f9f Small changes 2017-04-28 02:23:16 -07:00
Dmitry Petrov 16bd2f94b2 .cache dir was not created - sync issue in new repo. Close #51 2017-04-27 21:33:39 -07:00
Dmitry Petrov 8cc03f449c Chacke git status before dvc init 2017-04-24 15:52:47 -07:00
Dmitry Petrov 0f23045af3 Set default cloud to amazon 2017-04-24 13:46:50 -07:00
Earl 037758e20d Merge pull request #33 from dmpetrov/elh_config
config modifications
2017-04-22 17:44:16 -07:00
Dmitry Petrov a4d7c1dd8e Change default settings: cache --> .cache, state --> .state 2017-04-21 19:03:10 -07:00
Earl Hathaway 677ce3a8e2 default storagepath in global rather than data
remove aws creds from dvc.conf; instead, look in: look for creds path in dvc.conf, default to ~/.aws/credentials
warn if aws creds are specified but we fall back anyway
clean up config.get_cloud -> config.cloud
sanity check the config: complain in nicer way if cloud, aws creds, or various other requirements aren't set
2017-04-17 23:15:14 -07:00
Earl Hathaway 6fa96f5406 more docs;
remove debugging
2017-04-16 22:18:57 -07:00
Earl Hathaway f84cbd0d17 google cloud installs ALL THE THINGS
fixes to single file commands
got data import to work
get path_factory from settings
cloud selector
data sync -> s3 works again
blank dvc.conf
2017-04-16 19:51:58 -07:00
Dmitry Petrov 78573e9aca Set logging level in config. Close #10 2017-04-06 21:13:25 -07:00
Dmitry Petrov 5f3c53603f Refactoring: extract Settings from BaseCmd; move path_factory to Settings 2017-04-05 23:08:40 -07:00
Dmitry Petrov c3c2116220 Close #1 - repro cmd and close #2 repro unit tese 2017-04-05 20:41:35 -07:00
Dmitry Petrov 0525caf229 Propagate sumbit_id_needed() to all commands 2017-03-26 17:43:27 -07:00
Dmitry Petrov d4e8a6898d Extract commands to a separate module: remove cmd_ prefix in imports 2017-03-25 21:41:35 -07:00
Dmitry Petrov a536424141 Extract commands to a separate module: remove cmd_ file prefix 2017-03-25 21:40:58 -07:00