Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Disable global state preservation for process isolation by default #3954

Closed
greg0ire opened this issue Nov 23, 2019 · 6 comments
Closed

Disable global state preservation for process isolation by default #3954

greg0ire opened this issue Nov 23, 2019 · 6 comments
Assignees
@sebastianbergmann
Labels
feature/process-isolation Issues related to running tests in separate PHP processes type/backward-compatibility Something will be/is intentionally broken type/enhancement A new idea that should be implemented
Milestone
PHPUnit 10.0

Comments

@greg0ire
Copy link
Contributor

It's just a saner default, see symfony/symfony#33331

cc @nicolas-grekas @epdenouden
@greg0ire greg0ire added the type/enhancement A new idea that should be implemented label Nov 23, 2019
@sebastianbergmann sebastianbergmann self-assigned this Nov 23, 2019
@sebastianbergmann sebastianbergmann added this to the PHPUnit 9.0 milestone Nov 23, 2019
@sebastianbergmann sebastianbergmann added the type/backward-compatibility Something will be/is intentionally broken label Nov 23, 2019
@sebastianbergmann
Copy link
Owner

This is not as trivial as I originally thought:

PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.

Runtime:       PHP 7.3.12 with PCOV 1.0.6
Configuration: /usr/local/src/phpunit/phpunit.xml

.............................................................   61 / 2230 (  2%)
.............................................................  122 / 2230 (  5%)
.............................................................  183 / 2230 (  8%)
.............................................................  244 / 2230 ( 10%)
.............................................................  305 / 2230 ( 13%)
.............................................................  366 / 2230 ( 16%)
.............................................................  427 / 2230 ( 19%)
.............................................................  488 / 2230 ( 21%)
.............................................................  549 / 2230 ( 24%)
.............................................................  610 / 2230 ( 27%)
.............................................................  671 / 2230 ( 30%)
.................................S...........................  732 / 2230 ( 32%)
.............................................................  793 / 2230 ( 35%)
.............................................................  854 / 2230 ( 38%)
.............................................................  915 / 2230 ( 41%)
.............................................................  976 / 2230 ( 43%)
............................................................. 1037 / 2230 ( 46%)
............................................................. 1098 / 2230 ( 49%)
............................................................. 1159 / 2230 ( 51%)
............................................................. 1220 / 2230 ( 54%)
............................................................. 1281 / 2230 ( 57%)
............................................................. 1342 / 2230 ( 60%)
............................................................. 1403 / 2230 ( 62%)
............................................................. 1464 / 2230 ( 65%)
............................................................. 1525 / 2230 ( 68%)
............................................................. 1586 / 2230 ( 71%)
............................................................. 1647 / 2230 ( 73%)
............................................................. 1708 / 2230 ( 76%)
............................................................. 1769 / 2230 ( 79%)
............................................................. 1830 / 2230 ( 82%)
............................................................. 1891 / 2230 ( 84%)
............................................................. 1952 / 2230 ( 87%)
.................SS....F.F...SS..F....FF.F................... 2013 / 2230 ( 90%)
F..F.F.F.F.F.F.F.F.F...F....F.F.............................. 2074 / 2230 ( 93%)
............................................................. 2135 / 2230 ( 95%)
..............F............F....FFF......SS....F......FF..... 2196 / 2230 ( 98%)
.................F..........F.....                            2230 / 2230 (100%)

Time: 19.51 seconds, Memory: 32.00 MB

There were 29 failures:

1) /usr/local/src/phpunit/tests/end-to-end/dataprovider-log-xml-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-..F.                                                                4 / 4 (100%)<?xml version="1.0" encoding="UTF-8"?>
+EEEE                                                                4 / 4 (100%)<?xml version="1.0" encoding="UTF-8"?>
 <testsuites>
-  <testsuite name="DataProviderTest" file="%sDataProviderTest.php" tests="4" assertions="4" errors="0" warnings="0" failures="1" skipped="0" time="%f">
-    <testsuite name="DataProviderTest::testAdd" tests="4" assertions="4" errors="0" warnings="0" failures="1" skipped="0" time="%f">
-      <testcase name="testAdd with data set #0" class="DataProviderTest" classname="DataProviderTest" file="%sDataProviderTest.php" line="%d" assertions="1" time="%f"/>
-      <testcase name="testAdd with data set #1" class="DataProviderTest" classname="DataProviderTest" file="%sDataProviderTest.php" line="%d" assertions="1" time="%f"/>
-      <testcase name="testAdd with data set #2" class="DataProviderTest" classname="DataProviderTest" file="%sDataProviderTest.php" line="%d" assertions="1" time="%f">
-        <failure type="PHPUnit\Framework\ExpectationFailedException">DataProviderTest::testAdd with data set #2 (1, 1, 3)
-Failed asserting that 2 matches expected 3.
+  <testsuite name="DataProviderTest" file="/usr/local/src/phpunit/tests/_files/DataProviderTest.php" tests="4" assertions="0" errors="4" warnings="0" failures="0" skipped="0" time="0.000000">
+    <testsuite name="DataProviderTest::testAdd" tests="4" assertions="0" errors="4" warnings="0" failures="0" skipped="0" time="0.000000">
+      <testcase name="testAdd with data set #0" class="DataProviderTest" classname="DataProviderTest" file="/usr/local/src/phpunit/tests/_files/DataProviderTest.php" line="27" assertions="0" time="0.000000">
+        <error type="PHPUnit\Framework\Exception">DataProviderTest::testAdd with data set #0 (0, 0, 0)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
 
-%s:%i
-</failure>
+</error>
       </testcase>
-      <testcase name="testAdd with data set #3" class="DataProviderTest" classname="DataProviderTest" file="%sDataProviderTest.php" line="%d" assertions="1" time="%f"/>
+      <testcase name="testAdd with data set #1" class="DataProviderTest" classname="DataProviderTest" file="/usr/local/src/phpunit/tests/_files/DataProviderTest.php" line="27" assertions="0" time="0.000000">
+        <error type="PHPUnit\Framework\Exception">DataProviderTest::testAdd with data set #1 (0, 1, 1)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
+
+</error>
+      </testcase>
+      <testcase name="testAdd with data set #2" class="DataProviderTest" classname="DataProviderTest" file="/usr/local/src/phpunit/tests/_files/DataProviderTest.php" line="27" assertions="0" time="0.000000">
+        <error type="PHPUnit\Framework\Exception">DataProviderTest::testAdd with data set #2 (1, 1, 3)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
+
+</error>
+      </testcase>
+      <testcase name="testAdd with data set #3" class="DataProviderTest" classname="DataProviderTest" file="/usr/local/src/phpunit/tests/_files/DataProviderTest.php" line="27" assertions="0" time="0.000000">
+        <error type="PHPUnit\Framework\Exception">DataProviderTest::testAdd with data set #3 (1, 0, 1)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
+
+</error>
+      </testcase>
     </testsuite>
   </testsuite>
 </testsuites>
 
 
-Time: %s, Memory: %s
+Time: 143 ms, Memory: 6.00 MB
 
-There was 1 failure:
+There were 4 errors:
 
-1) DataProviderTest::testAdd with data set #2 (1, 1, 3)
-Failed asserting that 2 matches expected 3.
+1) DataProviderTest::testAdd with data set #0 (0, 0, 0)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
 
-%s:%i
+2) DataProviderTest::testAdd with data set #1 (0, 1, 1)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
 
-FAILURES!
-Tests: 4, Assertions: 4, Failures: 1.
+3) DataProviderTest::testAdd with data set #2 (1, 1, 3)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
+
+4) DataProviderTest::testAdd with data set #3 (1, 0, 1)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderTest.php on line 12
+
+ERRORS!
+Tests: 4, Assertions: 0, Errors: 4.

/usr/local/src/phpunit/tests/end-to-end/dataprovider-log-xml-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

2) /usr/local/src/phpunit/tests/end-to-end/default-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-...                                                                 3 / 3 (100%)
+EEE                                                                 3 / 3 (100%)
 
 Time: 110 ms, Memory: 6.00 MB
 
-OK (3 tests, 3 assertions)
+There were 3 errors:
+
+1) BankAccountTest::testBalanceIsInitiallyZero
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+
+2) BankAccountTest::testBalanceCannotBecomeNegative
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+
+3) BankAccountTest::testBalanceCannotBecomeNegative2
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+
+ERRORS!
+Tests: 3, Assertions: 0, Errors: 3.

/usr/local/src/phpunit/tests/end-to-end/default-isolation.phpt:15
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

3) /usr/local/src/phpunit/tests/end-to-end/exclude-group-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-..                                                                  2 / 2 (100%)
+EE                                                                  2 / 2 (100%)
 
 Time: 85 ms, Memory: 6.00 MB
 
-OK (2 tests, 2 assertions)
+There were 2 errors:
+
+1) BankAccountTest::testBalanceCannotBecomeNegative
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+
+2) BankAccountTest::testBalanceCannotBecomeNegative2
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+
+ERRORS!
+Tests: 2, Assertions: 0, Errors: 2.

/usr/local/src/phpunit/tests/end-to-end/exclude-group-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

4) /usr/local/src/phpunit/tests/end-to-end/execution-order/dependencies-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 
 Runtime:       PHP 7.3.12 with PCOV 1.0.6
 
-...FSSSWS                                                           9 / 9 (100%)
+ESSESSSWS                                                           9 / 9 (100%)
 
 Time: 87 ms, Memory: 6.00 MB
 
+There were 2 errors:
+
+1) DependencySuccessTest::testOne
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DependencySuccessTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DependencySuccessTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DependencySuccessTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DependencySuccessTest.php on line 12
+
+2) DependencyFailureTest::testOne
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DependencyFailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DependencyFailureTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DependencyFailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DependencyFailureTest.php on line 12
+
+--
+
 There was 1 warning:
 
 1) DependencyFailureTest::testHandlesDependsAnnotationForNonexistentTests
@@ @@
 
 --
 
-There was 1 failure:
+There were 6 skipped tests:
 
-1) DependencyFailureTest::testOne
+1) DependencySuccessTest::testTwo
+This test depends on "DependencySuccessTest::testOne" to pass.
 
-%s:%i
+2) DependencySuccessTest::testThree
+This test depends on "DependencySuccessTest::testTwo" to pass.
 
---
-
-There were 4 skipped tests:
-
-1) DependencyFailureTest::testTwo
+3) DependencyFailureTest::testTwo
 This test depends on "DependencyFailureTest::testOne" to pass.
 
-2) DependencyFailureTest::testThree
+4) DependencyFailureTest::testThree
 This test depends on "DependencyFailureTest::testTwo" to pass.
 
-3) DependencyFailureTest::testFour
+5) DependencyFailureTest::testFour
 This test depends on "DependencyFailureTest::testOne" to pass.
 
-4) DependencyFailureTest::testHandlesDependsAnnotationWithNoMethodSpecified
+6) DependencyFailureTest::testHandlesDependsAnnotationWithNoMethodSpecified
 This method has an invalid @depends annotation.
 
-FAILURES!
-Tests: 9, Assertions: 4, Failures: 1, Warnings: 1, Skipped: 4.
+ERRORS!
+Tests: 9, Assertions: 0, Errors: 2, Warnings: 1, Skipped: 6.

/usr/local/src/phpunit/tests/end-to-end/execution-order/dependencies-isolation.phpt:21
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

5) /usr/local/src/phpunit/tests/end-to-end/execution-order/depends-as-parameter-with-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-..                                                                  2 / 2 (100%)
+ES                                                                  2 / 2 (100%)
 
 Time: 61 ms, Memory: 6.00 MB
 
-OK (2 tests, 5 assertions)
+There was 1 error:
+
+1) StackTest::testPush
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/StackTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/StackTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/StackTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/StackTest.php on line 12
+
+ERRORS!
+Tests: 2, Assertions: 0, Errors: 1, Skipped: 1.

/usr/local/src/phpunit/tests/end-to-end/execution-order/depends-as-parameter-with-isolation.phpt:18
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

6) /usr/local/src/phpunit/tests/end-to-end/execution-order/depends-multiple-parameter-with-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-.....                                                               5 / 5 (100%)
+EESSE                                                               5 / 5 (100%)
 
 Time: 110 ms, Memory: 6.00 MB
 
-OK (5 tests, 6 assertions)
+There were 3 errors:
+
+1) MultiDependencyTest::testOne
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/MultiDependencyTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/MultiDependencyTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/MultiDependencyTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/MultiDependencyTest.php on line 12
+
+2) MultiDependencyTest::testTwo
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/MultiDependencyTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/MultiDependencyTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/MultiDependencyTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/MultiDependencyTest.php on line 12
+
+3) MultiDependencyTest::testFive
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/MultiDependencyTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/MultiDependencyTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/MultiDependencyTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/execution-order/_files/MultiDependencyTest.php on line 12
+
+ERRORS!
+Tests: 5, Assertions: 0, Errors: 3, Skipped: 2.

/usr/local/src/phpunit/tests/end-to-end/execution-order/depends-multiple-parameter-with-isolation.phpt:18
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

7) /usr/local/src/phpunit/tests/end-to-end/failure-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-FFFFFFFFFFFFF                                                     13 / 13 (100%)
+EEEEEEEEEEEEE                                                     13 / 13 (100%)
 
 Time: 369 ms, Memory: 6.00 MB
 
-There were 13 failures:
+There were 13 errors:
 
 1) FailureTest::testAssertArrayEqualsArray
-message
-Failed asserting that two arrays are equal.
---- Expected
-+++ Actual
-@@ @@
- Array (
--    0 => 1
-+    0 => 2
- )
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 
-%s:%i
-
 2) FailureTest::testAssertIntegerEqualsInteger
-message
-Failed asserting that 2 matches expected 1.
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 
-%s:%i
-
 3) FailureTest::testAssertObjectEqualsObject
-message
-Failed asserting that two objects are equal.
---- Expected
-+++ Actual
-@@ @@
- stdClass Object (
--    'foo' => 'bar'
-+    'bar' => 'foo'
- )
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 
-%s:%i
-
 4) FailureTest::testAssertNullEqualsString
-message
-Failed asserting that 'bar' matches expected null.
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 
-%s:%i
-
 5) FailureTest::testAssertStringEqualsString
-message
-Failed asserting that two strings are equal.
---- Expected
-+++ Actual
-@@ @@
--'foo'
-+'bar'
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 
-%s:%i
-
 6) FailureTest::testAssertTextEqualsText
-message
-Failed asserting that two strings are equal.
---- Expected
-+++ Actual
-@@ @@
- 'foo\n
--bar\n
-+baz\n
- '
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 
-%s:%i
-
 7) FailureTest::testAssertStringMatchesFormat
-message
-Failed asserting that string matches format description.
---- Expected
-+++ Actual
-@@ @@
--*%s*
-+**
-
 PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 
 8) FailureTest::testAssertNumericEqualsNumeric
-message
-Failed asserting that 2 matches expected 1.
-
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 
 9) FailureTest::testAssertTextSameText
-message
-Failed asserting that two strings are identical.
---- Expected
-+++ Actual
-@@ @@
--'foo'
-+'bar'
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 
-%s:%i
-
 10) FailureTest::testAssertObjectSameObject
-message
-Failed asserting that two variables reference the same object.
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 
-%s:%i
-
 11) FailureTest::testAssertObjectSameNull
-message
-Failed asserting that null is identical to an object of class "stdClass".
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 
-%s:%i
-
 12) FailureTest::testAssertFloatSameFloat
-message
-Failed asserting that 1.5 is identical to 1.0.
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 
-%s:%i
-
 13) FailureTest::testAssertStringMatchesFormatFile
-Failed asserting that string matches format description.
---- Expected
-+++ Actual
-@@ @@
--FOO
-+...BAR...
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/FailureTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/FailureTest.php on line 12
 
-%s:%i
-
-FAILURES!
-Tests: 13, Assertions: 14, Failures: 13.
+ERRORS!
+Tests: 13, Assertions: 0, Errors: 13.

/usr/local/src/phpunit/tests/end-to-end/failure-isolation.phpt:15
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

8) /usr/local/src/phpunit/tests/end-to-end/filter-class-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-...                                                                 3 / 3 (100%)
+EEE                                                                 3 / 3 (100%)
 
 Time: 114 ms, Memory: 6.00 MB
 
-OK (3 tests, 3 assertions)
+There were 3 errors:
+
+1) BankAccountTest::testBalanceIsInitiallyZero
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+
+2) BankAccountTest::testBalanceCannotBecomeNegative
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+
+3) BankAccountTest::testBalanceCannotBecomeNegative2
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+
+ERRORS!
+Tests: 3, Assertions: 0, Errors: 3.

/usr/local/src/phpunit/tests/end-to-end/filter-class-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

9) /usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-classname-and-range-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-...                                                                 3 / 3 (100%)
+EEE                                                                 3 / 3 (100%)
 
 Time: 113 ms, Memory: 6.00 MB
 
-OK (3 tests, 3 assertions)
+There were 3 errors:
+
+1) DataProviderFilterTest::testTrue with data set #1 (true)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+2) DataProviderFilterTest::testTrue with data set #2 (true)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+3) DataProviderFilterTest::testTrue with data set #3 (true)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+ERRORS!
+Tests: 3, Assertions: 0, Errors: 3.

/usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-classname-and-range-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

10) /usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-number-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-.                                                                   1 / 1 (100%)
+E                                                                   1 / 1 (100%)
 
 Time: 61 ms, Memory: 6.00 MB
 
-OK (1 test, 1 assertion)
+There was 1 error:
+
+1) DataProviderFilterTest::testTrue with data set #3 (true)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+ERRORS!
+Tests: 1, Assertions: 0, Errors: 1.

/usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-number-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

11) /usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-only-range-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-...                                                                 3 / 3 (100%)
+EEE                                                                 3 / 3 (100%)
 
 Time: 113 ms, Memory: 6.00 MB
 
-OK (3 tests, 3 assertions)
+There were 3 errors:
+
+1) DataProviderFilterTest::testTrue with data set #1 (true)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+2) DataProviderFilterTest::testTrue with data set #2 (true)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+3) DataProviderFilterTest::testTrue with data set #3 (true)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+ERRORS!
+Tests: 3, Assertions: 0, Errors: 3.

/usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-only-range-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

12) /usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-only-regexp-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-..                                                                  2 / 2 (100%)
+EE                                                                  2 / 2 (100%)
 
 Time: 88 ms, Memory: 6.00 MB
 
-OK (2 tests, 2 assertions)
+There were 2 errors:
+
+1) DataProviderFilterTest::testFalse with data set "false test" (false)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+2) DataProviderFilterTest::testFalse with data set "false test 2" (false)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+ERRORS!
+Tests: 2, Assertions: 0, Errors: 2.

/usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-only-regexp-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

13) /usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-only-string-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-.                                                                   1 / 1 (100%)
+E                                                                   1 / 1 (100%)
 
 Time: 62 ms, Memory: 6.00 MB
 
-OK (1 test, 1 assertion)
+There was 1 error:
+
+1) DataProviderFilterTest::testFalse with data set "false test" (false)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+ERRORS!
+Tests: 1, Assertions: 0, Errors: 1.

/usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-only-string-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

14) /usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-range-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-...                                                                 3 / 3 (100%)
+EEE                                                                 3 / 3 (100%)
 
 Time: 112 ms, Memory: 6.00 MB
 
-OK (3 tests, 3 assertions)
+There were 3 errors:
+
+1) DataProviderFilterTest::testTrue with data set #1 (true)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+2) DataProviderFilterTest::testTrue with data set #2 (true)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+3) DataProviderFilterTest::testTrue with data set #3 (true)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+ERRORS!
+Tests: 3, Assertions: 0, Errors: 3.

/usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-range-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

15) /usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-regexp-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-..                                                                  2 / 2 (100%)
+EE                                                                  2 / 2 (100%)
 
 Time: 87 ms, Memory: 6.00 MB
 
-OK (2 tests, 2 assertions)
+There were 2 errors:
+
+1) DataProviderFilterTest::testFalse with data set "false test" (false)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+2) DataProviderFilterTest::testFalse with data set "false test 2" (false)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+ERRORS!
+Tests: 2, Assertions: 0, Errors: 2.

/usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-regexp-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

16) /usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-string-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-.                                                                   1 / 1 (100%)
+E                                                                   1 / 1 (100%)
 
 Time: 62 ms, Memory: 6.00 MB
 
-OK (1 test, 1 assertion)
+There was 1 error:
+
+1) DataProviderFilterTest::testFalse with data set "false test" (false)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/DataProviderFilterTest.php on line 12
+
+ERRORS!
+Tests: 1, Assertions: 0, Errors: 1.

/usr/local/src/phpunit/tests/end-to-end/filter-dataprovider-by-string-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

17) /usr/local/src/phpunit/tests/end-to-end/filter-method-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-.                                                                   1 / 1 (100%)
+E                                                                   1 / 1 (100%)
 
 Time: 61 ms, Memory: 6.00 MB
 
-OK (1 test, 1 assertion)
+There was 1 error:
+
+1) BankAccountTest::testBalanceIsInitiallyZero
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+
+ERRORS!
+Tests: 1, Assertions: 0, Errors: 1.

/usr/local/src/phpunit/tests/end-to-end/filter-method-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

18) /usr/local/src/phpunit/tests/end-to-end/group-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-.                                                                   1 / 1 (100%)
+E                                                                   1 / 1 (100%)
 
 Time: 61 ms, Memory: 6.00 MB
 
-OK (1 test, 1 assertion)
+There was 1 error:
+
+1) BankAccountTest::testBalanceIsInitiallyZero
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/BankAccountTest.php:15
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/BankAccountTest.php on line 15
+
+ERRORS!
+Tests: 1, Assertions: 0, Errors: 1.

/usr/local/src/phpunit/tests/end-to-end/group-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

19) /usr/local/src/phpunit/tests/end-to-end/ini-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-.                                                                   1 / 1 (100%)
+E                                                                   1 / 1 (100%)
 
 Time: 60 ms, Memory: 6.00 MB
 
-OK (1 test, 1 assertion)
+There was 1 error:
+
+1) IniTest::testIni
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/IniTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/IniTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/IniTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/IniTest.php on line 12
+
+ERRORS!
+Tests: 1, Assertions: 0, Errors: 1.

/usr/local/src/phpunit/tests/end-to-end/ini-isolation.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

20) /usr/local/src/phpunit/tests/end-to-end/output-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-.                                                                   1 / 1 (100%)
+E                                                                   1 / 1 (100%)
 
 Time: 62 ms, Memory: 6.00 MB
 
-OK (1 test, 1 assertion)
+There was 1 error:
+
+1) OutputTestCase::testExpectOutputStringFooActualFoo
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/OutputTestCase.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/OutputTestCase.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/OutputTestCase.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/OutputTestCase.php on line 12
+
+ERRORS!
+Tests: 1, Assertions: 0, Errors: 1.

/usr/local/src/phpunit/tests/end-to-end/output-isolation.phpt:16
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

21) /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1149.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-.1.                                                                  2 / 2 (100%)2
+.1E                                                                  2 / 2 (100%)
 
 Time: 62 ms, Memory: 6.00 MB
 
-OK (2 tests, 2 assertions)
+There was 1 error:
+
+1) Issue1149Test::testTwo
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1149/Issue1149Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1149/Issue1149Test.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1149/Issue1149Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1149/Issue1149Test.php on line 12
+
+ERRORS!
+Tests: 2, Assertions: 1, Errors: 1.

/usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1149.phpt:14
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

22) /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1337.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-..                                                                  2 / 2 (100%)
+EE                                                                  2 / 2 (100%)
 
 Time: 90 ms, Memory: 6.00 MB
 
-OK (2 tests, 2 assertions)
+There were 2 errors:
+
+1) Issue1337Test::testProvider with data set "c:\" (true)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1337/Issue1337Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1337/Issue1337Test.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1337/Issue1337Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1337/Issue1337Test.php on line 12
+
+2) Issue1337Test::testProvider with data set #0 (true)
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1337/Issue1337Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1337/Issue1337Test.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1337/Issue1337Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1337/Issue1337Test.php on line 12
+
+ERRORS!
+Tests: 2, Assertions: 0, Errors: 2.

/usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1337.phpt:15
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

23) /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1348.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-.
-STDOUT does not break test result
-E                                                                  2 / 2 (100%)
+EE                                                                  2 / 2 (100%)
 
-Time: %s, Memory: %s
+Time: 85 ms, Memory: 6.00 MB
 
-There was 1 error:
+There were 2 errors:
 
-1) Issue1348Test::testSTDERR
-PHPUnit\Framework\Exception: STDERR works as usual.
+1) Issue1348Test::testSTDOUT
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1348/Issue1348Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1348/Issue1348Test.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1348/Issue1348Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1348/Issue1348Test.php on line 12
 
+2) Issue1348Test::testSTDERR
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1348/Issue1348Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1348/Issue1348Test.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1348/Issue1348Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1348/Issue1348Test.php on line 12
+
 ERRORS!
-Tests: 2, Assertions: 1, Errors: 1.
+Tests: 2, Assertions: 0, Errors: 2.

/usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1348.phpt:18
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

24) /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-F.E.E                                                               5 / 5 (100%)
+EEEEE                                                               5 / 5 (100%)
 
 Time: 162 ms, Memory: 6.00 MB
 
-There were 2 errors:
+There were 5 errors:
 
-1) Issue1351Test::testExceptionPre
-RuntimeException: Expected rethrown exception.
+1) Issue1351Test::testFailurePre
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php:12
 Stack trace:
-Caused by
-LogicException: Expected exception.
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
 #2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php on line 12
 
-2) Issue1351Test::testPhpCoreLanguageException
-PDOException: SQLSTATE[HY000]: General error: 1 no such table: php_wtf
+2) Issue1351Test::testFailurePost
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php:12
+Stack trace:
 #0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php on line 12
 
---
+3) Issue1351Test::testExceptionPre
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php on line 12
 
-There was 1 failure:
+4) Issue1351Test::testExceptionPost
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php on line 12
 
-1) Issue1351Test::testFailurePre
-Expected failure.
+5) Issue1351Test::testPhpCoreLanguageException
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php:12
+Stack trace:
 #0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351/Issue1351Test.php on line 12
+
 ERRORS!
-Tests: 5, Assertions: 5, Errors: 2, Failures: 1.
+Tests: 5, Assertions: 0, Errors: 5.

/usr/local/src/phpunit/tests/end-to-end/regression/GitHub/1351.phpt:20
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

25) /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2158.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-..                                                                  2 / 2 (100%)
+.E                                                                  2 / 2 (100%)
 
 Time: 63 ms, Memory: 6.00 MB
 
-OK (2 tests, 2 assertions)
+There was 1 error:
+
+1) Issue2158Test::testSomethingElse
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2158/Issue2158Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2158/Issue2158Test.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2158/Issue2158Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2158/Issue2158Test.php on line 12
+
+ERRORS!
+Tests: 2, Assertions: 1, Errors: 1.

/usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2158.phpt:14
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

26) /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2724-diff-pid-from-master-process.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-.                                                                   1 / 1 (100%)
+E                                                                   1 / 1 (100%)
 
 Time: 61 ms, Memory: 6.00 MB
 
-OK (1 test, 3 assertions)
+There was 1 error:
+
+1) SeparateClassRunMethodInNewProcessTest::testMethodShouldGetDifferentPidThanMaster
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2724/SeparateClassRunMethodInNewProcessTest.php:14
+Stack trace:
+#0 Standard input code(30): require_once()
+#1 Standard input code(108): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2724/SeparateClassRunMethodInNewProcessTest.php on line 14
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2724/SeparateClassRunMethodInNewProcessTest.php:14
+Stack trace:
+#0 Standard input code(30): require_once()
+#1 Standard input code(108): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2724/SeparateClassRunMethodInNewProcessTest.php on line 14
+
+ERRORS!
+Tests: 1, Assertions: 0, Errors: 1.

/usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2724-diff-pid-from-master-process.phpt:17
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

27) /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2725-separate-class-before-after-pid.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-..                                                                  2 / 2 (100%)
+EE                                                                  2 / 2 (100%)
 
 Time: 88 ms, Memory: 6.00 MB
 
-OK (2 tests, 2 assertions)
+There were 2 errors:
+
+1) Issue2725\BeforeAfterClassPidTest::testMethod1WithItsBeforeAndAfter
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2725/BeforeAfterClassPidTest.php:17
+Stack trace:
+#0 Standard input code(30): require_once()
+#1 Standard input code(108): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2725/BeforeAfterClassPidTest.php on line 17
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2725/BeforeAfterClassPidTest.php:17
+Stack trace:
+#0 Standard input code(30): require_once()
+#1 Standard input code(108): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2725/BeforeAfterClassPidTest.php on line 17
+
+2) Issue2725\BeforeAfterClassPidTest::testMethod2WithItsBeforeAndAfter
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2725/BeforeAfterClassPidTest.php:17
+Stack trace:
+#0 Standard input code(30): require_once()
+#1 Standard input code(108): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2725/BeforeAfterClassPidTest.php on line 17
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2725/BeforeAfterClassPidTest.php:17
+Stack trace:
+#0 Standard input code(30): require_once()
+#1 Standard input code(108): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2725/BeforeAfterClassPidTest.php on line 17
+
+ERRORS!
+Tests: 2, Assertions: 0, Errors: 2.

/usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2725-separate-class-before-after-pid.phpt:13
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

28) /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/74.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 There was 1 error:
 
 1) Issue74Test::testCreateAndThrowNewExceptionInProcessIsolation
-NewException: Testing GH-74
-
-%sIssue74Test.php:%d
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/74/Issue74Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/74/Issue74Test.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/74/Issue74Test.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/74/Issue74Test.php on line 12
 
 ERRORS!
 Tests: 1, Assertions: 0, Errors: 1.

/usr/local/src/phpunit/tests/end-to-end/regression/GitHub/74.phpt:22
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

29) /usr/local/src/phpunit/tests/end-to-end/report-useless-tests-isolation.phpt
Failed asserting that string matches format description.
--- Expected
+++ Actual
@@ @@
 PHPUnit 9.0-gf078ffefe by Sebastian Bergmann and contributors.
 
-R                                                                   1 / 1 (100%)
+E                                                                   1 / 1 (100%)
 
 Time: 61 ms, Memory: 6.00 MB
 
-There was 1 risky test:
+There was 1 error:
 
 1) NothingTest::testNothing
-This test did not perform any assertions
+PHPUnit\Framework\Exception: PHP Fatal error:  Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/NothingTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/NothingTest.php on line 12
+Fatal error: Uncaught Error: Class 'PHPUnit\Framework\TestCase' not found in /usr/local/src/phpunit/tests/_files/NothingTest.php:12
+Stack trace:
+#0 Standard input code(31): require_once()
+#1 Standard input code(111): __phpunit_run_isolated_test()
+#2 {main}
+  thrown in /usr/local/src/phpunit/tests/_files/NothingTest.php on line 12
 
-%s:14
-
-OK, but incomplete, skipped, or risky tests!
-Tests: 1, Assertions: 0, Risky: 1.
+ERRORS!
+Tests: 1, Assertions: 0, Errors: 1.

/usr/local/src/phpunit/tests/end-to-end/report-useless-tests-isolation.phpt:15
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

--

There were 7 skipped tests:

1) PHPUnit\Framework\Constraint\ExceptionMessageRegExpTest::testMessageXdebugScreamCompatibility
Extension xdebug is required.

/usr/local/src/phpunit/tests/unit/Framework/Constraint/ExceptionMessageRegExpTest.php:37
/usr/local/src/phpunit/tests/unit/Framework/Constraint/ExceptionMessageRegExpTest.php:37
/usr/local/src/phpunit/src/Framework/TestCase.php:1912
/usr/local/src/phpunit/src/Framework/TestCase.php:1001
/usr/local/src/phpunit/src/Framework/TestResult.php:691
/usr/local/src/phpunit/src/Framework/TestCase.php:755

2) /usr/local/src/phpunit/tests/end-to-end/code-coverage-ignore.phpt
Extension xdebug is required.

/usr/local/src/phpunit/tests/end-to-end/code-coverage-ignore.phpt:6
/usr/local/src/phpunit/src/Runner/PhptTestCase.php:149
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

3) /usr/local/src/phpunit/tests/end-to-end/code-coverage-phpt.phpt
Extension xdebug is required.

/usr/local/src/phpunit/tests/end-to-end/code-coverage-phpt.phpt:6
/usr/local/src/phpunit/src/Runner/PhptTestCase.php:149
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

4) /usr/local/src/phpunit/tests/end-to-end/disable-code-coverage-ignore.phpt
Extension xdebug is required.

/usr/local/src/phpunit/tests/end-to-end/disable-code-coverage-ignore.phpt:6
/usr/local/src/phpunit/src/Runner/PhptTestCase.php:149
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

5) /usr/local/src/phpunit/tests/end-to-end/dump-xdebug-filter.phpt
xdebug not loaded

/usr/local/src/phpunit/tests/end-to-end/dump-xdebug-filter.phpt:6
/usr/local/src/phpunit/src/Runner/PhptTestCase.php:149
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

6) /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2085-enforce-time-limit-options-via-config-without-invoker.phpt
package phpunit/php-invoker is installed

/usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2085-enforce-time-limit-options-via-config-without-invoker.phpt:8
/usr/local/src/phpunit/src/Runner/PhptTestCase.php:149
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

7) /usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2085-without-invoker.phpt
package phpunit/php-invoker is installed

/usr/local/src/phpunit/tests/end-to-end/regression/GitHub/2085-without-invoker.phpt:10
/usr/local/src/phpunit/src/Runner/PhptTestCase.php:149
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/Framework/TestSuite.php:597
/usr/local/src/phpunit/src/TextUI/TestRunner.php:617
/usr/local/src/phpunit/src/TextUI/Command.php:199
/usr/local/src/phpunit/src/TextUI/Command.php:158

FAILURES!
Tests: 2230, Assertions: 3712, Failures: 29, Skipped: 7.

@sebastianbergmann
Copy link
Owner

The errors in #3954 (comment) seem to have the same root cause: PHPUnit\Framework\TestCase cannot be found when protected $preserveGlobalState = false; is used instead of protected $preserveGlobalState = true;, meaning PHPUnit's autoloader is not active.

@sebastianbergmann sebastianbergmann mentioned this issue Jan 23, 2020
Closed
@sebastianbergmann sebastianbergmann added the feature/process-isolation Issues related to running tests in separate PHP processes label Feb 11, 2020
@sebastianbergmann sebastianbergmann changed the title Disable preserveGlobalState by default Disable global state preservation for process isolation by default May 8, 2021
@sebastianbergmann
Copy link
Owner

The errors in #3954 (comment) seem to have the same root cause: PHPUnit\Framework\TestCase cannot be found when protected $preserveGlobalState = false; is used instead of protected $preserveGlobalState = true;, meaning PHPUnit's autoloader is not active.

The root cause for these errors only affects TestCase tests that run in isolation from a PHPT test that is part of PHPUnit's own test suite. Yes, that's two levels of isolation: main process creates a new process to run the PHPT process from which a new process is created to run the test. That's what we call a "spezialgelagerter Sonderfall" in German.

@Ocramius
Copy link
Sponsor Contributor

@sebastianbergmann is this something that could be reconsidered for PHPUnit 10, considering Composer is the main autoloader? 🤔

@sebastianbergmann
Copy link
Owner

This has been implemented for PHPUnit in 373b047.

@Ocramius
Copy link
Sponsor Contributor

Excellent, thanks for the reference! 💪

@mamazu mamazu mentioned this issue May 17, 2024
Draft
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sebastianbergmann sebastianbergmann

Labels
feature/process-isolation Issues related to running tests in separate PHP processes type/backward-compatibility Something will be/is intentionally broken type/enhancement A new idea that should be implemented
Projects
None yet
Milestone
PHPUnit 10.0
Development

No branches or pull requests
3 participants
@sebastianbergmann @Ocramius @greg0ire