Commit Graph
352 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 49d286e5ad Merge pull request #170 from ophiry/md5_handle_missing_file
return empty md5 if file doesnt exist
2017-08-15 01:08:28 +03:00
Ophir Yoktan c21261b69f return empty md5 if file doesnt exist 2017-08-14 23:27:05 +03:00
Ruslan Kuprieiev 348f04462f Merge pull request #164 from efiop/master
import: resume download
2017-08-13 15:33:13 -07:00
Ruslan Kuprieiev ebeb32a8ac import: resume download
Download to .part file first and rename at the very end,
so if we lose connection we could resume download.
Note: not all servers support 'Range' header, so this
feature is not going to work everywhere.

This feature is activated by -c/--continue cmdline option.

Fixes #108

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-14 01:16:28 +03:00
Ruslan Kuprieiev 04bb836fe0 Merge pull request #162 from efiop/master
travis: add workaround for mac build
2017-08-12 21:10:21 -07:00
Ruslan Kuprieiev 45253ba225 travis: add workaround for mac build
Travis doesn't natively support python builds on Mac yet,
so we need to workaround it by installing everything ourselves.

Fixes #133.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-13 06:55:04 +03:00
Ruslan Kuprieiev 990c72fcf7 Merge pull request #161 from efiop/master
build: cleanup build_macos.sh
2017-08-12 14:57:39 -07:00
Ruslan Kuprieiev f34bcdd959 build: cleanup build_macos.sh
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-12 14:38:13 -07:00
Ruslan Kuprieiev 2454b89963 Merge pull request #160 from efiop/master
Sync/cloud RFC, pull/push commands
2017-08-12 13:07:42 -07:00
Ruslan Kuprieiev 178834e572 cloud: aws: check md5 when pulling data
Currently dvc downloads data from cloud even if we already
have the same file downloaded. This patch fixes it by checking
md5 before attempting to download.

Fixes #159

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-12 22:51:16 +03:00
Ruslan Kuprieiev f21defdc68 RFC: cloud: rename methods
New names fit much better:

    sync_to_cloud     -> push
    sync_from_cloud   -> pull
    remove_from_cloud -> remove

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-12 22:44:20 +03:00
Ruslan Kuprieiev db43e6bc91 dvc: add pull/push commands
We already have 'sync' command, but users report it to be confusing
when both local and remote files exist, so lets introduce two direct
commands to implicitly push and pull from cloud.

Fixes #157.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-12 22:44:10 +03:00
Ruslan Kuprieiev a234311980 sync/cloud: move target logic to DataCloud
This should come in handy for pull and push commands.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-12 19:44:17 +03:00
Ruslan Kuprieiev 10f19f5c2e cloud: parse and store cloud in settings
Cloud is determined from config and stays the same from that moment,
so it makes sense to parse it once and store in settings, so whoever
needs it, could just use self.settings.cloud. This is going to be
more useful in the few next commits, where push/pull/status are introduced.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-12 08:00:53 +03:00
Ruslan Kuprieiev 7a5a17e9c6 Merge pull request #153 from efiop/master
RFC: fix codeclimate warnings
2017-08-07 03:07:18 +03:00
Ruslan Kuprieiev afcbb148b9 RFC: fix codeclimate warnings
codeclimate noted a few similiar code chunks and it looks
like it is worth fixing them.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-07 02:41:55 +03:00
Ruslan Kuprieiev 93326c99ad tests: utils: don't forget to init env 2017-08-07 02:26:26 +03:00
Ruslan Kuprieiev fa9996fe30 Merge pull request #152 from efiop/master
tests: add test for utils.py
2017-08-07 01:56:02 +03:00
Ruslan Kuprieiev c7df4bd0ba tests: add test for utils.py
Some sanity tests to make sure something like #132
doesn't happen anymore.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-07 01:36:26 +03:00
Ruslan Kuprieiev bfd2085707 Merge pull request #151 from efiop/master
init: check user.{name,email} to make sure git is ready
2017-08-06 03:21:41 +03:00
Ruslan Kuprieiev 0cd30e727a init: check user.{name,email} to make sure git is ready
Making sure git is configured at least with name and email,
so our commits can be commited without any problems.

Fixes #64.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-06 02:40:50 +03:00
Ruslan Kuprieiev 4a66bf2d95 Merge pull request #147 from efiop/master
dvc: get rid of pathlib
2017-08-03 23:54:45 +03:00
Ruslan Kuprieiev 883e6773f7 dvc: get rid of pathlib
Fixes #118

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-03 23:31:59 +03:00
Ruslan Kuprieiev 0f2a672804 Merge pull request #146 from efiop/master
cli: set dvc prog name to 'dvc'
2017-08-03 12:01:15 +03:00
Ruslan Kuprieiev a1971ad39a cli: set dvc prog name to 'dvc'
Fixes #145

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-03 11:46:39 +03:00
Ruslan Kuprieiev 4df6e1bdbf Merge pull request #143 from efiop/master
cli: fix help, 'run', 'repro' and 'sync'
2017-08-03 05:10:12 +03:00
Ruslan Kuprieiev b5623a32bd cli: fix help, 'run', 'repro' and 'sync'
Adding metavar='' is a legacy from previous design and should
be removed to achieve better help msgs.

'run' should have 'command' as a positional and _required_ argument and 'args'
as a remainder.

'repro' had CmdRun triggered when called from cli.

'sync' should have 'targets' as a positional and _required_ argument.

Fixes #136.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-03 04:55:07 +03:00
Ruslan Kuprieiev 2931a9230b travis: add pip caching
pip installs take quite some time in the build process, so to speed it up lets add pip caching.
2017-08-03 03:37:52 +03:00
Ruslan Kuprieiev 15030e7bce appveyor: remove 'artifact' from 'deploy' section
It should upload artifacts automatically.
2017-08-03 03:24:50 +03:00
Ruslan Kuprieiev f336a0456d appveyour: Update auth token for release deploy
Apparently it is not the same as for travis.
2017-08-03 03:01:14 +03:00
Ruslan Kuprieiev b3ab103680 Merge pull request #142 from efiop/master
appveyor: rename yml back
2017-08-02 14:43:19 +03:00
Ruslan Kuprieiev 36f8f77aed appveyor: rename yml back
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-02 14:21:20 +03:00
Ruslan Kuprieiev 7fbfc778df appveyor: add 'artifact' to 'deploy' 2017-08-02 01:15:58 +03:00
Ruslan Kuprieiev 1854ac5e23 Merge pull request #140 from efiop/master
appveyor: rename yml and add 'branches'
2017-08-02 01:02:43 +03:00
Ruslan Kuprieiev 4eb333b6ef appveyor: rename yml and add 'branches'
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-02 00:59:44 +03:00
Ruslan Kuprieiev 4908337219 Merge pull request #139 from efiop/master
appveyor: deploy dvc windows installer
2017-08-02 00:46:22 +03:00
Ruslan Kuprieiev e79a8bf9f8 appveyor: deploy dvc windows installer
Same as with travis, appveyor will push dvc installer
for windows, when new dvc is being released on github.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-02 00:40:37 +03:00
Ruslan Kuprieiev 02ad3863fc Merge pull request #138 from efiop/master
travis: fix secure token
2017-08-01 21:02:51 +03:00
Ruslan Kuprieiev c54ba02260 travis: fix secure token
I made a mistake of generating tokens on my repo
efiop/dvc, so it was not correct for official repo
and thus travis couldn't upload packages.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-01 20:58:19 +03:00
Ruslan Kuprieiev 920fbec902 Merge pull request #137 from efiop/master
travis: publish dvc rpm and deb installers on releases
2017-08-01 20:48:21 +03:00
Ruslan Kuprieiev 8311c16ada travis: publish dvc rpm and deb installers on releases
Travis is able to automatically build and upload releases
to github, so when we will release next dvc version, travis
will automatically upload deb and rpm packages to github.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-08-01 20:40:20 +03:00
Dmitry Petrov 2eae3d1af8 Clean data cloud code. Utils logger bugfix 2017-07-31 02:38:18 -07:00
Dmitry Petrov 8792636793 Merge branch 'master' of https://github.com/dataversioncontrol/dvc 2017-07-30 21:47:50 -07:00
Dmitry Petrov dc61b1bf95 Clean data item code 2017-07-30 21:44:53 -07:00
Ruslan Kuprieiev 4c996b7ea5 Merge pull request #129 from efiop/master
Add appveyor icon to README
2017-07-31 07:43:20 +03:00
Ruslan Kuprieiev addf8b7808 Add appveyor icon to README
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-07-31 07:39:49 +03:00
Ruslan Kuprieiev c1ebe910ce Merge pull request #128 from efiop/master
innosetup: fix setup.iss semicolons
2017-07-31 07:14:45 +03:00
Ruslan Kuprieiev 4b57077c83 innosetup: fix setup.iss semicolons
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-07-31 07:09:21 +03:00
Ruslan Kuprieiev 25a80e2a8c Merge pull request #127 from efiop/master
appveyor: add windows build
2017-07-31 06:47:40 +03:00
Ruslan Kuprieiev a46c3936ac appveyor: add windows build
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2017-07-31 06:42:11 +03:00