Reworked existing tests and test-system, added a few new
tests(init, reworked repro, import).
Fixes#175
Signed-off-by: Ruslan Kuprieiev <[email protected]>
A few minor adjustments to make what we currently have work,
while I prepare new func tests.
Fixes#175
Signed-off-by: Ruslan Kuprieiev <[email protected]>
Currently it is not possible to check if data_item == None,
as __eq__ tries to access .data in 'None' object and thus
throws an exception.
Signed-off-by: Ruslan Kuprieiev <[email protected]>
This command shows status for data files. I.e.
$ dvc status data/
new file: .cache/Posts-train.tsv_2ccd8e7
new file: data/llss
modified: .cache/Posts.xml_512a612
new file: .cache/empty_0000000
new file: data/oss
new file: .cache/matrix-test.p_69b924d
new file: .cache/dir21111/Posts.xml.tgz_cd71d01
so it will tell us if there are any new/modified/deleted data
files that you might want to push/pull/etc.
Fixes#158
Signed-off-by: Ruslan Kuprieiev <[email protected]>
From now on, 'dvc import' supports s3 and gcp links.
This patch also does some RFC to properly parse url's
scheme using urllib instead of relying on hand-made
regex. Code for downloding files from http urls is moved
to data_cloud.py in preparation for pull/push support
for http/https/ftp schemes in the future.
Also added dummy progress updates(start/finish) for gcp,
as i couldn't find an API call that allows callbacks to
update progress properly.
Fixes#49
Signed-off-by: Ruslan Kuprieiev <[email protected]>
Download to .part file first and rename at the very end,
so if we lose connection we could resume download.
Note: not all servers support 'Range' header, so this
feature is not going to work everywhere.
This feature is activated by -c/--continue cmdline option.
Fixes#108
Signed-off-by: Ruslan Kuprieiev <[email protected]>
Travis doesn't natively support python builds on Mac yet,
so we need to workaround it by installing everything ourselves.
Fixes#133.
Signed-off-by: Ruslan Kuprieiev <[email protected]>
Currently dvc downloads data from cloud even if we already
have the same file downloaded. This patch fixes it by checking
md5 before attempting to download.
Fixes#159
Signed-off-by: Ruslan Kuprieiev <[email protected]>
New names fit much better:
sync_to_cloud -> push
sync_from_cloud -> pull
remove_from_cloud -> remove
Signed-off-by: Ruslan Kuprieiev <[email protected]>
We already have 'sync' command, but users report it to be confusing
when both local and remote files exist, so lets introduce two direct
commands to implicitly push and pull from cloud.
Fixes#157.
Signed-off-by: Ruslan Kuprieiev <[email protected]>
Ruslan Kuprieiev
Dmitry Petrov
Ophir Yoktan
Ophir Yoktan