[FEATURE] Live stats update

[vkosuri]

It would be great if we would have live test count increments

Verb --- Number tests performed for each verb

GET
PUT
PATH
DELETE

Test status --- Denotes the number of tests passed or failed

Pass:
Fail:

Stauts code: For each status code number of tests performed

1xx
2xx
3xx
4xx

[Stranger6667]

These stats are definitely nice to see, but I don't have a complete vision of what the end result might look like. It is somehow incompatible with the current CLI style that follows pytest that outputs a line for each tested endpoint. I'd like to have some CLI redesign and such an idea is definitely something I want to consider - some folks already asked about certain statistics in the output (for example #1414).

I won't start working on this right now, but rather would like to gather more information first. If I'd share a questionnaire on the new output style, would you fill it in?

[vkosuri]

I won't start working on this right now, but rather would like to gather more information first

Our API requests are very time consuming around 20 to 30mins duration will take in the future may go beyond, and The end-use at least knows what exactly is failing or passing etc. By looking at these stats we can something happening

a questionnaire on the new output style, would you fill it in?

Sure

[hoog1511]

@Stranger6667 was this questionnaire sent out at some point? I am still interested in having this specific feature added to schemathesis.

[Stranger6667]

Hey @hoog1511 !

Thanks for pinging! Unfortunately, I digressed on other stuff back in the day and didn't manage to get back to it.

I am open to collecting feedback on this still, but at this point, I'd like to focus on everything related to customizing checks, hooks, filters, etc.

Then, I plan to work on CLI output style indeed. Probably such a questionnaire could be written now and then we collect data, so when the time comes we have some input there.

[hoog1511]

@Stranger6667 if I could get a heads-up for when the questionnaire is ready to be shared, I would love to give my input for it.

[Stranger6667]

@hoog1511 Sure, the questionnaire is here - https://forms.gle/gkhGHJPbgkCG7HcA8

There are also a few issues where I'd appreciate feedback:

• [FEATURE] Rework checks API #1689
• [FEATURE] Custom request data in CLI #1676
• [FEATURE] Rework the hook system #1673