Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reorder tests based on execution time #3284

Closed
sebastianbergmann opened this issue Sep 8, 2018 · 1 comment
Closed

Reorder tests based on execution time #3284

sebastianbergmann opened this issue Sep 8, 2018 · 1 comment
Labels
type/enhancement A new idea that should be implemented

Comments

@sebastianbergmann
Copy link
Owner

Thanks to the caching of test results, we know how long it took to execute each test the last time.

It could make sense to reorder tests based on execution time: fast tests first, slow tests last.

@epdenouden What do you think?

@sebastianbergmann sebastianbergmann added the type/enhancement A new idea that should be implemented label Sep 8, 2018
@epdenouden
Copy link
Contributor

Technically that is super easy, the current sorter will already use the time when it the 'defect severity' is the same.

Personally I have never found a use case for just sorting by time. The quickest tests are always these loooong lists of @dataprovider tests for input validation, parsers and minor logic building blocks. These tests all count as one per data row which makes them super fast and you're still stuck with this huge testMyInputAgainstAllUTFWeirdness as @dataprovider-driven tests become a DataproviderTestSuite when running.

But hey, it's a simple thing that might help somebody out IRL. :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/enhancement A new idea that should be implemented
Projects
None yet
Development

No branches or pull requests

2 participants