Commit Graph
1564 Commits
Author SHA1 Message Date
Ruslan Kuprieiev 9bf0fc89df Merge pull request #912 from efiop/master
metrics: csv support and additional type verification
2018-07-18 12:36:57 +03:00
Ruslan Kuprieiev 6c7bf390c6 metrics: check that specified path is a text file and not a directory or binary file
Fixes #911

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-18 12:25:11 +03:00
Ruslan Kuprieiev 5565ece1f8 metrics: add support for csv and hcsv
Fixes #910
Fixes #909

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-18 12:15:59 +03:00
Ruslan Kuprieiev ebecc9996b tests: use 0.3 sec as a max startup time 2018-07-18 11:39:24 +03:00
Ruslan Kuprieiev f9ba365a25 Merge pull request #906 from efiop/master
dvc: optimize imports to speedup startup time
2018-07-18 11:32:35 +03:00
Ruslan Kuprieiev 3410f8048a dvc: optimize imports to speedup startup time
Speeds up `time dvc` from 1.2 seconds to <0.2 seconds.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-18 11:20:05 +03:00
Ruslan Kuprieiev f54428d5ed test: properly check for hadoop availability
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-18 10:12:49 +03:00
Ivan Shcheklein 6e1839df90 minor: help for pipeline 2018-07-17 16:24:53 -07:00
Ivan Shcheklein 2d9b062fc4 minor: remove a temporary file in tests 2018-07-17 16:00:30 -07:00
Ruslan Kuprieiev 169db1fe29 dvc: bump to 0.13.0 0.13.0 2018-07-17 16:26:22 +03:00
Ruslan Kuprieiev 870d98bc18 test: fix expected number of stages 2018-07-17 15:57:31 +03:00
Ruslan Kuprieiev dc5fec6a75 test: remove unused add() call 2018-07-17 15:47:38 +03:00
Ruslan Kuprieiev 2885c00f80 Merge pull request #900 from efiop/master
remote: misc bug fixes
2018-07-17 13:14:45 +03:00
Ruslan Kuprieiev d424fc3825 remote: misc bug fixes
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-17 13:02:31 +03:00
Ruslan Kuprieiev 5cf8c8b598 Merge pull request #898 from efiop/master
import: support external urls as outputs
2018-07-17 12:11:01 +03:00
Ruslan Kuprieiev 805eb908d0 import: support external urls
Fixes #891

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-17 12:00:12 +03:00
Ruslan Kuprieiev 39fc1d2cc6 Merge pull request #899 from yustoris/feature/s3-endpoint-url-for-new-remote
Specify endpoint_url on S3 session client
2018-07-17 08:50:41 +03:00
kenji.yamauchi 88afad7202 Specify endpoint_url on S3 session client
We have to specify `endpoint_url` option for S3 Session client
along with Resource object.
2018-07-17 13:05:48 +09:00
Ruslan Kuprieiev dd06f53bc7 remote: use path_infos instead of regular paths in upload/download
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-16 20:00:53 +03:00
Ruslan Kuprieiev be187fad6e Merge pull request #897 from efiop/master
Misc enhancements
2018-07-16 17:08:13 +03:00
Ruslan Kuprieiev 1418ab81c9 pipeline: add -o|--outs option for show
Outputs output files instead of paths to DVC files.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-16 16:57:23 +03:00
Ruslan Kuprieiev 6a01578dfb status: print a warning about locked DVC files
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-16 16:48:00 +03:00
Ruslan Kuprieiev d98a166f87 Merge pull request #896 from efiop/master
dvc: support `dvc add` for external files
2018-07-16 16:42:05 +03:00
Ruslan Kuprieiev f1a28c3812 dvc: support dvc add for external files
Fixes #890

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-16 16:34:16 +03:00
Ruslan Kuprieiev 99bd586151 Merge pull request #892 from efiop/master
Misc enhancements
2018-07-16 13:53:04 +03:00
Ruslan Kuprieiev 6d120f474e dvc: handle double dvc init
Fixes #889

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-16 13:43:46 +03:00
Ruslan Kuprieiev 6d6653840e dvc: use active stages when collecting cache
Fixes #887

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-16 13:43:46 +03:00
Ruslan Kuprieiev 7fea5d579c Merge pull request #886 from efiop/master
dvc: add confirmation for `dvc destroy`
2018-07-15 19:27:30 +03:00
Ruslan Kuprieiev fef8ea4602 dvc: add confirmation for dvc destroy
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-15 19:18:01 +03:00
Ruslan Kuprieiev 586fde5f95 Merge pull request #885 from efiop/master
dvc: implement `dvc destroy`
2018-07-15 07:59:59 +03:00
Ruslan Kuprieiev 918bb53b75 dvc: implement dvc destroy
Fixes #621

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-15 07:45:25 +03:00
Ruslan Kuprieiev 64da1b126f dvc: bump to 0.12.0
Signed-off-by: Ruslan Kuprieiev <[email protected]>
0.12.0
2018-07-14 18:00:05 +03:00
Ruslan Kuprieiev f7cb4afd33 Merge pull request #883 from efiop/master
add `dvc pipeline show`
2018-07-14 11:29:29 +03:00
Ruslan Kuprieiev 71d9fb44fc dvc: add dvc pipeline show
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-14 10:49:32 +03:00
Ruslan Kuprieiev 794dcc2a58 dvc: avoid collecting stages twice
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-14 10:49:32 +03:00
Ruslan Kuprieiev c636581699 test: gc: catch OSError 0.11.0 2018-07-12 10:41:34 +03:00
Ruslan Kuprieiev 4668c10e6e test: gs: catch WinError 2018-07-12 10:32:34 +03:00
Ruslan Kuprieiev 9be161de54 test: use IOError instead of FileNotFoundError 2018-07-12 10:25:40 +03:00
Ruslan Kuprieiev 79826b21a4 test: gcp: handle FileNotFoundError 2018-07-12 10:14:15 +03:00
Ruslan Kuprieiev e6e11ef015 Merge pull request #880 from efiop/master
test: check if we need to test RemoteAzure with _should_test_azure
2018-07-12 09:21:23 +03:00
Ruslan Kuprieiev f476143c52 test: check if we need to test RemoteAzure with _should_test_azure
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-12 09:13:07 +03:00
Ruslan Kuprieiev 3946463551 dvc: bump to 0.11.0 2018-07-12 08:31:38 +03:00
Ruslan Kuprieiev 774e635e60 Merge pull request #879 from efiop/master
remote: s3: properly delete key
2018-07-11 23:21:44 +03:00
Ruslan Kuprieiev 9fedecdf55 remote: s3: properly delete key
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-11 23:07:50 +03:00
Ruslan Kuprieiev 69f5ea3f3a Merge pull request #878 from efiop/master
gc: introduce -c|--cloud
2018-07-11 22:54:13 +03:00
Ruslan Kuprieiev d63d1db5b6 gc: introduce -c|--cloud
Fixes #876

Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-11 22:27:13 +03:00
Ruslan Kuprieiev d71df35f63 gc: take into account local cache
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-11 22:27:13 +03:00
Ruslan Kuprieiev 716c554b93 remote: allow AZURE cache
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-11 22:27:13 +03:00
Ruslan Kuprieiev d24457c14f gc: choose which cache to process inside the drivers
Signed-off-by: Ruslan Kuprieiev <[email protected]>
2018-07-11 22:27:13 +03:00
Ruslan Kuprieiev 5f8b2f3b91 Merge pull request #875 from CatalystCode/azure-integration-tests
Add integration tests for Azure Remote
2018-07-11 16:57:32 +03:00