New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Perform health checks for each component of a strategy #1007
Comments
#1112 is a real-life example of too much filtering in a sub-strategy (field for a Django model). |
A closely related problem is that the error messages for failed healthchecks do not show the strategy which failed the check!
Adding the repr of the relevant strategy would probably be helpful right now, but even more so when we can run this check on smaller parts and discover the minimal unhealthy components. |
Overlaps substantially with #434, which proposes yet another solution. |
#1153 would also be easier to solve with more granular reporting of health check failures. |
As part of our eternal quest to stop people (accidentally) misusing Hypothesis, we have a number of health checks to warn about strategies that will have poor shrinking behavior or are impossible to draw from.
binary(9000)
fails withlarge_base_example
, because the minimal example is too large (Add new health check for large base examples #996).binary(9000) | none()
has the same error, for the same reason.none() | binary(9000)
should (Failure of duplication detection during generation #995) fail with an error related to duplicated examples.text() | binary(9000)
should (this issue!) fail, because there is a branch or component of the strategy which cannot ever be drawn from. See these comments:This issue is meant to keep track of that ambition.
The text was updated successfully, but these errors were encountered: