Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dask Cluster #337

Draft
wants to merge 20 commits into
base: master
Choose a base branch
from
Draft

Dask Cluster #337

wants to merge 20 commits into from

Conversation

srggrs
Copy link
Contributor

@srggrs srggrs commented Sep 15, 2020

Close #335. Close #125.

Testing with the following commands:

  1. clean up db ./manage.py reset_db --noinput && ./manage.py migrate
  2. run a local dask cluster ./manage.py run_local_dask_cluster (open the dashboard in printed link)
  3. run a pipeline normally

@github-actions github-actions bot added this to In progress in Pipeline Backlog Sep 15, 2020
@srggrs srggrs changed the title Issue 335 dask cluster Dask Cluster Sep 17, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Pipeline Backlog
  
In progress
Development

Successfully merging this pull request may close these issues.

Migrate to Dask Cluster Improve groupby parallelisation with Dask
1 participant