You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As part of cloudpickle's downstream testing support (to test with different libraries using cloudpickle), the distributed portion of these tests fails. In particular all the failures are from distributed itself. Relevant CI log. More details in PR ( cloudpipe/cloudpickle#471 ).
Maybe the CI config in cloucpickle is lacking some mandatory test dependencies but it's not obvious for instance the p2p shuffle error does not raise any error message related to a missing package.
We recently added a new, but still unreleased p2p shuffle algorithm for dask.dataframe which uses distributed under the hood. The NotImplementedError: Unknown shuffle method p2p failure in the distributed tests is because (I think) CI is using the latest main branch of distributed, but the latest release of dask, which doesn't yet have the p2p shuffle option added. We're releasing dask and distributed in a couple of hours, so this particular issue should resolve itself once the new dask release is out. That said, in general dask and distributed are co-developed and released together, so we should probably update cloudpickle's CI to install the main branch of both dask and distributed in the downstream distributed CI build
As part of cloudpickle's downstream testing support (to test with different libraries using cloudpickle), the distributed portion of these tests fails. In particular all the failures are from distributed itself. Relevant CI log. More details in PR ( cloudpipe/cloudpickle#471 ).
cc @ogrisel @jrbourbeau @mrocklin
The text was updated successfully, but these errors were encountered: