Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adjust docs for scheduling policies #8467

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Adjust docs for scheduling policies #8467

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
10 changes: 2 additions & 8 deletions docs/source/scheduling-policies.rst
View file
Open in desktop
Expand Up @@ -60,7 +60,8 @@ Instead, we use the task's TaskGroup, which is the collection of all tasks with
same key prefix. (``(random-a1b2c3, 0)``, ``(random-a1b2c3, 1)``, ``(random-a1b2c3, 2)``
would all belong to the TaskGroup ``random-a1b2c3``.)

To identify the root(ish) tasks, we use this heuristic:
To identify the root(ish) tasks, we check whether the task has been explicitly marked as
(non-)rootish. If this is not the case, we use this heuristic:

1. The TaskGroup has 2x more tasks than there are threads in the cluster
2. The TaskGroup has fewer than 5 unique dependencies across *all* tasks in the group.
Expand Down Expand Up @@ -129,13 +130,6 @@ functions in ``scheduler.py``.
.. currentmodule:: distributed.scheduler

.. autosummary:: decide_worker

.. autosummary:: Scheduler.decide_worker_non_rootish

.. autosummary:: Scheduler.decide_worker_rootish_queuing_disabled

.. autosummary:: Scheduler.decide_worker_rootish_queuing_enabled

.. autosummary:: Scheduler.worker_objective


Expand Down