From cc2d2495c0e4a987ffb61f9f4eb93622ff47979c Mon Sep 17 00:00:00 2001 From: dberenbaum Date: Fri, 22 Jul 2022 13:49:19 -0400 Subject: [PATCH] readme: link to docs for related tech --- README.rst | 33 +-------------------------------- 1 file changed, 1 insertion(+), 32 deletions(-) diff --git a/README.rst b/README.rst index 3623fea73..cea0e7b7b 100644 --- a/README.rst +++ b/README.rst @@ -4,10 +4,10 @@ • `Docs `_ • `Blog `_ • `Tutorial `_ +• `Related Technologies `_ • `How DVC works`_ • `VS Code Extension`_ • `Installation`_ -• `Related Technologies`_ • `Contributing`_ • `Community and Support`_ @@ -190,37 +190,6 @@ Fedora / CentOS (rpm) sudo yum update sudo yum install dvc -.. _`Related Technologies`: - -Comparison to related technologies -================================== - -#. Data Engineering tools such as `AirFlow `_, `Luigi `_, and others - in DVC data, model and ML pipelines represent a single ML project focused on data scientists' experience. - Data engineering tools orchestrate multiple data projects and focus on efficient execution. - A DVC project can be used from existing data pipelines as a single execution step. - -#. `Git-annex `_: - DVC uses the idea of storing the content of large files (which should not be in a Git repository) in a local key-value store, and uses file hardlinks/symlinks instead of copying/duplicating files. - -#. `Git-LFS `_: DVC is compatible with many remote storage services (S3, Google Cloud, Azure, SSH, etc). - DVC also uses reflinks or hardlinks to avoid copy operations on checkouts; thus handling large data - files much more efficiently. - -#. Makefile (and analogues including ad-hoc scripts): - DVC tracks dependencies (in a directed acyclic graph). - -#. `Workflow Management Systems `_: - DVC is a workflow management system designed specifically to manage machine learning experiments. - DVC is built on top of Git. - -#. `DAGsHub `_: Online service to host DVC projects. - It provides a useful UI around DVC repositories and integrates other tools. - -#. `Iterative Studio `_: Official web platform for DVC projects. - It can be used to manage data and models, run and track experiments, and visualize and share results. - Also, it integrates with `CML (CI/CD for ML) `__ for training models in the cloud or Kubernetes, and with `MLEM ` for model deployment. - - Contributing ============