Runner hangs with "File or directory ... set in failed group does not exist" after deleting a failed Cest file

[ThomasLandauer]

I ran the entire suite (vendor/bin/codecept run unit,functional) and some tests failed. Then I deleted one of them (i.e. the entire file), and ran the entire suite again, as before. Now I'm getting:

In GroupManager.php line 131:
GroupManager: File or directory /.../DeletedCest.php set in failed group does not exist

It's clear that Codeception needs to save the failed tests somewhere, in order to be able to rerun just the failed. However, when running all, this list should be ignored.

Details

• Codeception version: codeception/codeception 4.1.21

[Naktibalda]

Previous issue #5938

[ThomasLandauer]

Sorry for not finding that issue myself. The difference I'm seeing is:

• At Codeception >= 3.1.1 and PHP 7.3 PHP error #5735 the guys have explicitly configured groups, and certainly want to see an error if an entire group is not there.
• At RunFailed module is trying to run removed test  #5938 they don't have any groups at all. (That's also my case here). So people might not even know what groups are at all.

So the question for me is: If I just do run, why is Codeception looking at the failed group at all?
Is everything organized into groups behind the scenes? => If no, would it be possible to raise the error only if there are groups?

Note for myself: The place where Codeception stores the failed tests (for rerun failed) is obviously just _output/failed ;-)

[ggmanuilov]

Why codeception not removed this file before run group test cases?