Stone_Red/dvc
1
0
Fork 0
mirror of https://github.com/Stone-Red-Code/dvc.git synced 2026-11-02 07:18:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,874 Commits 7 Branches 579 Tags
29f58bda9bd3c3c5ac74637f71d664f5318fd2e3
Commit Graph
2874 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Mr. Outis 29f58bda9b status: optimization for already downloaded files 
Fix #1839
 2019-04-30 17:09:04 -07:00
Ruslan Kuprieiev e99fc2d8e8 Merge pull request #1946 from Suor/pbar-large-dir 
dvc: add progress bar when hashing a large dir
 2019-04-30 19:15:53 +03:00
Alexander Schepanovski a6823e0113 dvc: add progress bar when hashing a large dir 
Added an easier way to show progress bar over for loops.
 2019-04-30 20:26:02 +07:00
Ruslan Kuprieiev 8c02cefb9e Merge pull request #1947 from Suor/tests-log-level 
test: fix tests being dependent on log level and abandon default DEBUG level
 2019-04-30 15:22:35 +03:00
Ruslan Kuprieiev c13dbc69eb Merge pull request #1948 from Suor/dup-tests 
test: dedup some metrics tests
 2019-04-30 14:14:44 +03:00
Alexander Schepanovski af4af45458 test: dedup some metrics tests 
Closes #1928.
 2019-04-30 18:01:54 +07:00
Alexander Schepanovski cdf318fff7 test: abandon default DEBUG log level in tests 
Now simple `py.test` command won't use DEBUG log level and `py.test ...
--log-level=LEVEL` will do what it's supposed to.

Staging continues to use DEBUG log level.

This is part of #1888 resolution.
 2019-04-30 17:43:39 +07:00
Alexander Schepanovski 7d067f78b2 test: fix tests being dependent on log level 
Note we call main() to spare process overhead, this leads to main()
inheriting log level and later tests inheriting whatever main() run
left. This makes main to behave.
 2019-04-30 17:33:49 +07:00
Ruslan Kuprieiev 8bb21261e3 metrics: show: adjust warning 2019-04-30 01:37:05 +03:00
Ruslan Kuprieiev 3265a259f8 Merge pull request #1937 from pared/1917 
metrics: show: do not throw on no metric present on branch
 2019-04-30 01:35:02 +03:00
pared b13707cd0a metrics: show: refactor arguments naming 2019-04-29 15:24:07 -07:00
pared 59b4090e64 metrics: show: do not throw on no metric present on branch 2019-04-29 15:16:05 -07:00
Ruslan Kuprieiev 435095e35f Merge pull request #1914 from pared/1890 
repo: different cache link types info on long lasting operations
 2019-04-29 19:14:27 +03:00
Ruslan Kuprieiev 8a077ba5db Merge pull request #1945 from ag613915cao/replace_yield_fixture 
Replace yield_fixture()
 2019-04-29 14:48:10 +03:00
ag613915cao 0dabf7bbaa Replace yield_fixture() 
Because yield_fixture() is deprecated since pytest 3.0 [1]. It is
not recommend to use the decorator instead of fixture().

[1] https://docs.pytest.org/en/latest/yieldfixture.html
 2019-04-29 15:17:10 +07:00
Ruslan Kuprieiev 329385eb80 Merge pull request #1944 from brbarkley/feature_jsonpath-ng 
dvc metrics show: implement jsonpath-ng
 2019-04-28 16:53:24 +03:00
Brett Barkley 4260a6246d dvc metrics show: implement jsonpath-ng 
updated setup.py
updated test_metrics.py::assertMetricsHaveRelativePaths

Fixes #1919
 2019-04-28 09:01:28 -04:00
Brett Barkley beef1e32b0 dvc metrics show: implement jsonpath-ng 
Fixes #1919
 2019-04-28 08:28:36 -04:00
Ivan Shcheklein 27bf6e2928 readme: add donate patreon badge 2019-04-26 12:33:45 -07:00
pared f496ba4f03 remote: local: different cache link types info on long lasting linking 2019-04-26 10:17:16 -07:00
Ruslan Kuprieiev 360e459161 Merge pull request #1939 from Suor/gc-optimize 
dvc: some minor optimizations
 2019-04-26 19:02:05 +03:00
Alexander Schepanovski cdba077b61 dvc: some minor optimizations 2019-04-26 19:10:08 +07:00
Ruslan Kuprieiev 3a183f5303 Merge pull request #1911 from ag613915cao/enable_ssh_test_on_windows 
Mocked SSH server and enable ssh test on windows
 2019-04-26 14:24:00 +03:00
ag613915cao fd385c913b This commit intends to: 
- Keep current SSH remote connection test on real system
- Faked and Mocked SSH server which running on both Linux and Windows
- Add corresponding tests

Fixed #1704
 2019-04-26 18:07:16 +07:00
Ruslan Kuprieiev edefb5470f ssh: respect no_progress_bar on download/upload 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-04-26 04:45:52 +03:00
Ruslan Kuprieiev 65d31db8db state: remove redundant lines 2019-04-25 16:53:24 +03:00
Alexander Schepanovski 7478e7d4b0 test: clean up test dirs (#1904) 
* test: clean up test dirs

Closes #1770. Partially does #1888.

* dvc: close anything opened

* test: finalize git repo explicitly to remove test dir later

This was previously an issue on Windows.
 2019-04-25 14:55:39 +03:00
Mr. Outis c0104e2e61 repro: implement downstream option (#1926) 
* repro: implement downstream option

Close #1555

* Update scripts/completion/dvc.zsh

Co-Authored-By: mroutis <[email protected]>

* Update dvc/command/repro.py

Co-Authored-By: mroutis <[email protected]>
 2019-04-25 04:50:44 +03:00
Ruslan Kuprieiev 44e20f1aa8 Merge pull request #1877 from mroutis/fix-1852 
repro: persisting outputs invalidates build cache
 2019-04-25 02:56:27 +03:00
Mr. Outis d42c8fbd14 repro: persisting outputs invalidates build cache 
Fix #1852
 2019-04-24 16:45:03 -07:00
Ruslan Kuprieiev 165f6472ca Merge pull request #1925 from efiop/1655 
stage: commit cached stage to avoid data duplication
 2019-04-24 22:22:48 +03:00
Ruslan Kuprieiev 9c77f2818c stage: commit cached stage to avoid data duplication 
Fixes #1655

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-04-24 21:14:08 +03:00
Ruslan Kuprieiev b8018c16a7 Merge pull request #1892 from efiop/1654 
support external ssh directories as dependencies and outputs
 2019-04-24 05:57:06 +03:00
Ruslan Kuprieiev 37ee55b1f8 test: test ssh 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-04-24 05:09:48 +03:00
Ruslan Kuprieiev 49f87a5bff use ValueError instead of JSONDecodeError 
JSONDecodeError is only available in never python 3 versions and still
inherits from ValueError, so we could just use it.

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-04-24 05:09:48 +03:00
Ruslan Kuprieiev b97b99cf15 test: func: use pytest for outputs/dependencies 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-04-24 05:09:48 +03:00
Ruslan Kuprieiev 44b95f23a3 remote: ssh: support directories 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-04-24 05:09:48 +03:00
Ruslan Kuprieiev 00cfb04fea remote: generalize file/dir handling 
Fixes #1654
Fixes #1655

Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-04-24 05:09:48 +03:00
Ruslan Kuprieiev 41b67c3730 move: move directory into an existing directory 
Signed-off-by: Ruslan Kuprieiev <[email protected]>
 2019-04-24 04:56:33 +03:00
Alexander Schepanovski ee8d9a1312 dvc: improve apply_diff() docstring 
- explain how it works and why is it needed
- fix typo
 2019-04-24 02:45:02 +03:00
Alexander Schepanovski 277b9e566c test: use caplog.at_level() to restore log level after test 2019-04-24 02:45:02 +03:00
pared dd8598e53e tree: walk: operate on tree absolute root 2019-04-23 02:38:23 +03:00
Alexander Schepanovski 8ef52f92ee dvc: add meta key to stages to store user data 2019-04-22 16:26:57 +03:00
ag613915cao 47fb2d3a3b Add test for ssh connection 
This commit intends to mock SSH server that not depends on
OS which the test running on for testing purpose.
 2019-04-21 04:22:59 +03:00
Alexander Schepanovski 0c867399bb dvc: retain formatting and comments in .dvc files (#1885) 
* test: remove never used copy of load_stage_file()

* dvc: save comments and custom formatting in stage files

* Add a couple of TODOs

* test: test repro doesn't clear comments and formatting in .dvc

As part of this I started writing pytest-like tests and added commonly
used fixtures.

* test: simplify and prettify dvc formatting retained test

Also test that line comments after md5 fields are retained.

* test: fix tests

* dvc: fix stage and metrics opens not closed

* dvc: always use utf-8 in stage files

It used to encode in system default encoding. Not sure if PyYAML was
handling this silently or we were just lucky all the way.

* test: unit test apply_diff()

* test: remove TODOs and ASK

* dvc: polish dvc-formatting PR

* dvc: move stage load/dump utils to a new stage utils file

* dvc: clean up apply_diff()

* test: test stage md5 ignores comments

* test: remove pytests starting marker
 2019-04-20 01:12:53 +03:00
Ruslan Kuprieiev b057c814ea Merge pull request #1895 from vyloy/master 
import: support the '--file' option
 2019-04-18 14:18:17 +03:00
vyloy 60c89adeb5 import: use os.path.join instead of hardcode path in the test 2019-04-18 09:25:38 +08:00
vyloy 01a28f2de9 import: improve some details about the '--file' option. 2019-04-18 08:56:14 +08:00
vyloy b07c386d02 import: support the '--file' option 2019-04-18 08:56:14 +08:00
Ruslan Kuprieiev 30573c4546 Merge pull request #1899 from efiop/pkg 
pkg: comply with design of other dvc commands
 2019-04-18 03:31:21 +03:00