Currently it is not possible to check if data_item == None,
as __eq__ tries to access .data in 'None' object and thus
throws an exception.
Signed-off-by: Ruslan Kuprieiev <[email protected]>
This command shows status for data files. I.e.
$ dvc status data/
new file: .cache/Posts-train.tsv_2ccd8e7
new file: data/llss
modified: .cache/Posts.xml_512a612
new file: .cache/empty_0000000
new file: data/oss
new file: .cache/matrix-test.p_69b924d
new file: .cache/dir21111/Posts.xml.tgz_cd71d01
so it will tell us if there are any new/modified/deleted data
files that you might want to push/pull/etc.
Fixes#158
Signed-off-by: Ruslan Kuprieiev <[email protected]>
From now on, 'dvc import' supports s3 and gcp links.
This patch also does some RFC to properly parse url's
scheme using urllib instead of relying on hand-made
regex. Code for downloding files from http urls is moved
to data_cloud.py in preparation for pull/push support
for http/https/ftp schemes in the future.
Also added dummy progress updates(start/finish) for gcp,
as i couldn't find an API call that allows callbacks to
update progress properly.
Fixes#49
Signed-off-by: Ruslan Kuprieiev <[email protected]>
Download to .part file first and rename at the very end,
so if we lose connection we could resume download.
Note: not all servers support 'Range' header, so this
feature is not going to work everywhere.
This feature is activated by -c/--continue cmdline option.
Fixes#108
Signed-off-by: Ruslan Kuprieiev <[email protected]>
Travis doesn't natively support python builds on Mac yet,
so we need to workaround it by installing everything ourselves.
Fixes#133.
Signed-off-by: Ruslan Kuprieiev <[email protected]>
Currently dvc downloads data from cloud even if we already
have the same file downloaded. This patch fixes it by checking
md5 before attempting to download.
Fixes#159
Signed-off-by: Ruslan Kuprieiev <[email protected]>
New names fit much better:
sync_to_cloud -> push
sync_from_cloud -> pull
remove_from_cloud -> remove
Signed-off-by: Ruslan Kuprieiev <[email protected]>
We already have 'sync' command, but users report it to be confusing
when both local and remote files exist, so lets introduce two direct
commands to implicitly push and pull from cloud.
Fixes#157.
Signed-off-by: Ruslan Kuprieiev <[email protected]>
Cloud is determined from config and stays the same from that moment,
so it makes sense to parse it once and store in settings, so whoever
needs it, could just use self.settings.cloud. This is going to be
more useful in the few next commits, where push/pull/status are introduced.
Signed-off-by: Ruslan Kuprieiev <[email protected]>
Making sure git is configured at least with name and email,
so our commits can be commited without any problems.
Fixes#64.
Signed-off-by: Ruslan Kuprieiev <[email protected]>
Adding metavar='' is a legacy from previous design and should
be removed to achieve better help msgs.
'run' should have 'command' as a positional and _required_ argument and 'args'
as a remainder.
'repro' had CmdRun triggered when called from cli.
'sync' should have 'targets' as a positional and _required_ argument.
Fixes#136.
Signed-off-by: Ruslan Kuprieiev <[email protected]>
Same as with travis, appveyor will push dvc installer
for windows, when new dvc is being released on github.
Signed-off-by: Ruslan Kuprieiev <[email protected]>
Ruslan Kuprieiev
Ophir Yoktan
Ophir Yoktan