Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-02 07:18:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,545 Commits 7 Branches 579 Tags
be187fad6e5572cd9f3466faefd19f75f39126f5
Commit Graph
1545 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ruslan Kuprieiev be187fad6e Merge pull request #897 from efiop/master 
Misc enhancements
 2018-07-16 17:08:13 +03:00
Ruslan Kuprieiev 1418ab81c9 pipeline: add -o|--outs option for show 
Outputs output files instead of paths to DVC files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-16 16:57:23 +03:00
Ruslan Kuprieiev 6a01578dfb status: print a warning about locked DVC files 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-16 16:48:00 +03:00
Ruslan Kuprieiev d98a166f87 Merge pull request #896 from efiop/master 
dvc: support `dvc add` for external files
 2018-07-16 16:42:05 +03:00
Ruslan Kuprieiev f1a28c3812 dvc: support dvc add for external files 
Fixes #890

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-16 16:34:16 +03:00
Ruslan Kuprieiev 99bd586151 Merge pull request #892 from efiop/master 
Misc enhancements
 2018-07-16 13:53:04 +03:00
Ruslan Kuprieiev 6d120f474e dvc: handle double dvc init 
Fixes #889

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-16 13:43:46 +03:00
Ruslan Kuprieiev 6d6653840e dvc: use active stages when collecting cache 
Fixes #887

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-16 13:43:46 +03:00
Ruslan Kuprieiev 7fea5d579c Merge pull request #886 from efiop/master 
dvc: add confirmation for `dvc destroy`
 2018-07-15 19:27:30 +03:00
Ruslan Kuprieiev fef8ea4602 dvc: add confirmation for dvc destroy 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-15 19:18:01 +03:00
Ruslan Kuprieiev 586fde5f95 Merge pull request #885 from efiop/master 
dvc: implement `dvc destroy`
 2018-07-15 07:59:59 +03:00
Ruslan Kuprieiev 918bb53b75 dvc: implement dvc destroy 
Fixes #621

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-15 07:45:25 +03:00
Ruslan Kuprieiev 64da1b126f dvc: bump to 0.12.0 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
0.12.0 		2018-07-14 18:00:05 +03:00
Ruslan Kuprieiev f7cb4afd33 Merge pull request #883 from efiop/master 
add `dvc pipeline show`
 2018-07-14 11:29:29 +03:00
Ruslan Kuprieiev 71d9fb44fc dvc: add dvc pipeline show 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-14 10:49:32 +03:00
Ruslan Kuprieiev 794dcc2a58 dvc: avoid collecting stages twice 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-14 10:49:32 +03:00
Ruslan Kuprieiev c636581699 test: gc: catch OSError 0.11.0 2018-07-12 10:41:34 +03:00
Ruslan Kuprieiev 4668c10e6e test: gs: catch WinError 2018-07-12 10:32:34 +03:00
Ruslan Kuprieiev 9be161de54 test: use IOError instead of FileNotFoundError 2018-07-12 10:25:40 +03:00
Ruslan Kuprieiev 79826b21a4 test: gcp: handle FileNotFoundError 2018-07-12 10:14:15 +03:00
Ruslan Kuprieiev e6e11ef015 Merge pull request #880 from efiop/master 
test: check if we need to test RemoteAzure with _should_test_azure
 2018-07-12 09:21:23 +03:00
Ruslan Kuprieiev f476143c52 test: check if we need to test RemoteAzure with _should_test_azure 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-12 09:13:07 +03:00
Ruslan Kuprieiev 3946463551 dvc: bump to 0.11.0 2018-07-12 08:31:38 +03:00
Ruslan Kuprieiev 774e635e60 Merge pull request #879 from efiop/master 
remote: s3: properly delete key
 2018-07-11 23:21:44 +03:00
Ruslan Kuprieiev 9fedecdf55 remote: s3: properly delete key 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-11 23:07:50 +03:00
Ruslan Kuprieiev 69f5ea3f3a Merge pull request #878 from efiop/master 
gc: introduce -c|--cloud
 2018-07-11 22:54:13 +03:00
Ruslan Kuprieiev d63d1db5b6 gc: introduce -c|--cloud 
Fixes #876

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-11 22:27:13 +03:00
Ruslan Kuprieiev d71df35f63 gc: take into account local cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-11 22:27:13 +03:00
Ruslan Kuprieiev 716c554b93 remote: allow AZURE cache 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-11 22:27:13 +03:00
Ruslan Kuprieiev d24457c14f gc: choose which cache to process inside the drivers 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-11 22:27:13 +03:00
Ruslan Kuprieiev 5f8b2f3b91 Merge pull request #875 from CatalystCode/azure-integration-tests 
Add integration tests for Azure Remote
 2018-07-11 16:57:32 +03:00
Ruslan Kuprieiev bb5f1de79f Merge pull request #877 from efiop/master 
dvc: sort dir cache by relpath
 2018-07-11 16:36:13 +03:00
Clemens Wolff 8f36587805 Set up Azurite on AppVeyor 2018-07-11 09:25:45 -04:00
Ruslan Kuprieiev 5b674c910d dvc: sort dir cache by relpath 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-11 14:01:49 +03:00
Clemens Wolff 7897dd8c45 Make tests more verbose 
This helps verify in the CI that the environment variables for the
integration tests are set up correctly since we can see exactly which
tests are being executed and which ones are being skipped.
 2018-07-10 16:44:29 -04:00
Clemens Wolff 8a32292f46 Fix tests on Python 2 2018-07-10 16:44:28 -04:00
Clemens Wolff 97dfc88647 Flag skipped tests during test run 2018-07-10 16:44:28 -04:00
Clemens Wolff fcd0e34269 Enable Azure integration test on Travis CI 
Note: the tests are run against the Azurite [1] local emulator for Azure
Blob Storage and not against a live service.

[1] https://github.com/azure/azurite
 2018-07-10 16:33:53 -04:00
Clemens Wolff a438f77db2 Move to list-then-check exists implementation 2018-07-10 16:33:52 -04:00
Clemens Wolff fcbc6d115c Wire-up Azure in TestDataCloud 2018-07-10 16:33:52 -04:00
Clemens Wolff 1b1ca68b64 Fix inspections 2018-07-10 16:33:52 -04:00
Clemens Wolff 9724bd94aa Replace os.system with subprocess.check_output 
It is generally recommended to use the subprocess module instead of the
os module to run subshell commands given since the former makes it
easier to comunicate with the process, has an improved security model,
etc. More information is available in [1].

Note that this change uses `check_output` instead of `check_call` to
prevent the command output from being printed to stdout.

This change also introduces two additional enhancements:
- Skip the hadoop test if the hadoop binary is not available.
- Skip the ssh test if the ssh binary is not available.

[1] https://docs.python.org/3/library/subprocess.html#replacing-os-system
 2018-07-10 16:33:14 -04:00
Ruslan Kuprieiev 3e08cd503c Merge pull request #874 from efiop/master 
utils: copyfile: properly join paths
 2018-07-10 21:50:36 +03:00
Ruslan Kuprieiev e9377dd65d utils: copyfile: properly join paths 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-10 21:39:46 +03:00
Clemens Wolff 581132bbe0 Fix environment variable name 2018-07-10 13:54:49 -04:00
Ruslan Kuprieiev e051964a1b Merge pull request #873 from efiop/master 
collect: skip if cache dir doesn't exist
 2018-07-10 20:09:44 +03:00
Ruslan Kuprieiev 2aa9288f55 collect: skip if cache dir doesn't exist 
Related to #872

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-10 19:22:18 +03:00
Ruslan Kuprieiev 6996d0a9e6 Merge pull request #870 from efiop/master 
remote: add comments for s3/azure exists() method
 2018-07-09 23:49:48 +03:00
Ruslan Kuprieiev 1f30d29b57 remote: add comments for s3/azure exists() method 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2018-07-09 23:40:56 +03:00
Ruslan Kuprieiev abee5f07bb Merge pull request #869 from CatalystCode/code-climate 
Fix CodeClimate inspections
 2018-07-09 23:21:02 +03:00