metrics diff atol and rtol #10408
Labels
A: metrics
Related to dvc metrics
feature request
Requesting a new feature
p3-nice-to-have
It should be done this or next sprint
It would be useful to be able to filter the results of the
dvc metrics diff
command based on absolute or relative tolerance.This type of solution allows, first of all, to filter negligible changes but also, for example, to build jobs on CI that fail if any of the metrics have changed too drastically.
Currently, this can be done with a custom python script, or using AWK:
Looking forward for your feedback!
Tasks
The text was updated successfully, but these errors were encountered: