Assign tasks to all workers

[nejigane]

Hi.

I have a pc with 8 core cpu, and want to run the following code with python 3.8.10 and dask 2022.1.1.

import dask
import time

def foo(i: int) -> None:
    t = time.time() + 30
    while time.time() < t:
        pass

if __name__ == '__main__':
    tasks = [dask.delayed(foo)(i) for i in range(10)]
    dask.compute(*tasks, scheduler='processes')

8 workers start, but only 2 of them run with 100% cpu usage, other workers remain idle.
How do I assign tasks to all 8 workers?

Thanks,

[nejigane]

I found chunksize=1 enables all workers get 100% cpu usage.
https://github.com/dask/dask/blob/2022.01.1/dask/multiprocessing.py#L173-L176

dask.compute(*tasks, scheduler='processes', chunksize=1)