Hook to optionally skip specific failures

[Stranger6667]

Users sometimes encounter errors during testing that they don't wish to address for various reasons, like server issues out of their control. Current options like disabling checks lack the required granularity, and Schemathesis halts on these failures, disrupting the testing flow.

Proposed Solution

Introduce a new hook named ignore_failure_if to allow conditionally skipping certain test cases based on custom logic.:

import schemathesis


@schemathesis.hook
def ignore_failure_if(context, error, case, response):
    # Custom logic to determine if this case should be ignored
    context.ignore(error)

Benefits

• Provides users with more control over what constitutes a failure.
• Enables more granular control than simply disabling checks.
• Allows users to dig deeper into their API by ignoring certain superficial errors.

Reporting

Mark intentionally skipped cases as [IGNORED] in the CLI output, similar to how flaky tests are marked [FLAKY].