Ensure workers do not kill on restart

[fjetter]

Closes #7312
Supersedes #7323

closes #7321

xref #7320

[github-actions]

Unit Test Results

See test report for an extended history of previous test failures. This is useful for diagnosing flaky tests.

    28 files   -     1      28 suites   - 1   10h 39m 36s ⏱️ - 26m 16s
 4 062 tests +    1   3 942 ✅  -     6    109 💤 ± 0  11 ❌ + 7 
53 572 runs   - 1 398  51 199 ✅  - 1 359  2 344 💤  - 64  29 ❌ +25 

For more details on these failures, see this check.

Results for commit e62302a. ± Comparison against base commit cd9951b.

This pull request removes 4 and adds 5 tests. Note that renamed tests count towards both.

distributed.tests.test_client ‑ test_restart_workers_kill_timeout[False]
distributed.tests.test_client ‑ test_restart_workers_kill_timeout[True]
distributed.tests.test_scheduler ‑ test_restart_nanny_timeout_exceeded
distributed.tests.test_scheduler ‑ test_restart_worker_rejoins_after_timeout_expired

distributed.deploy.tests.test_local ‑ test_localcluster_restart
distributed.tests.test_nanny ‑ test_restart_stress[kill]
distributed.tests.test_nanny ‑ test_restart_stress[restart]
distributed.tests.test_nanny ‑ test_worker_start_exception_after_restart[kill]
distributed.tests.test_nanny ‑ test_worker_start_exception_after_restart[restart]

♻️ This comment has been updated with latest results.