Release 2024.3.0

[fjetter]

Release version	2024.3.0
Planned release date	2024-03-12
Status	Completed
Release manager	@fjetter

Best effort

Try to close before the release but will not block the release

• ...
• ...

Blocker

Issues that would cause us to block and postpone the release if not fixed

• ...
• ...

Comments

...

[fjetter]

It is currently discussed that this release could drop pandas 1.X support and enable dask-expr by default. See dask/dask#10934 and dask/dask#10962 for the discussion

[crusaderky]

• dask-expr is now a hard dependency dask#10979 should be a blocker for the conda recipes

[crusaderky]

Blockers

• dask-expr is now a hard dependency dask#10979 (conda recipes)
• Make CI happy again distributed#8560
• either
  • Mark fast tasks of tasks-based shuffle when dask-expr is enabled distributed#8563
    or
  • Change split names in task based shuffle dask-expr#962
• test_dask_collections.py::test_dataframe_set_index_sync passes locally, fails on CI distributed#8561 (resolve or understand what's going on)

Best effort

• Refactor restart() and restart_workers() distributed#8550
• Restart workers when worker-ttl expires distributed#8538
• Weigh gilknocker Prometheus metric by duration distributed#8558

[jacobtomlinson]

I've been thinking more about something @fjetter said the other day. I understand the desire to hold off the announcement of the dask-expr changes until we have some nice benchmark numbers. But given the impact of this release I feel like there will be a lot of fallout next week. So maybe we want to have a small blog post or at least an issue explaining the changes that we can point folks to.

[phofl]

dask/dask-expr#962 is not a blocker imo

[hendrikmakait]

Best effort:
dask/distributed#8549 (I'm essentially waiting for CI to be fixed to run this one last time before merging.)

[fjetter]

We got a little delayed due to the above linked blockers. Instead of rushing the release through now I will postpone it until tomorrow morning (EU time)

[fjetter]

Release uploaded to PyPI. I opened a feedback issue with a brief intro here dask/dask#10995

[mrocklin]

Tweeted this, hopefully that's ok: https://twitter.com/dask_dev/status/1767558105649352918