dvc queue start
checkout more files than required
#10293
Labels
A: experiments
Related to dvc exp
p2-medium
Medium priority, should be done, but less important
performance
improvement over resource / time consuming tasks
Bug Report / Feature Request
I have a project with a data directory (150 GB) containing 11 files. I have added the entire directory using
dvc add data
.In my workflow each experiment I want to conduct only depends on a single file in the
data
directory.Running an experiment using the
dvc queue
willdvc checkout
the entiredata
directory.It would be much faster if the command only
dvc checkout
data files, which are actually required by the workflow, as defined in thedvc.yaml
.Expected
The
data
directory in.dvc/tmp/exp/...
would only contain files, specified as explicit dependencies in thedvc.yaml
workflow file.Environment information
Output of
dvc doctor
:The text was updated successfully, but these errors were encountered: