You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A chef script produced thousands of enqueued calculate_user_storage_tasks for the same user, which overwhelmed the task workers
Expected behavior
For most tasks, any attempts to enqueue the task should only enqueue it if there isn't already a queued or currently executing task for the same arguments
User-facing consequences
Other users actively editing channels experience long delays for operations like copying and publishing, where the UI clearly shows the progress of the operation
Errors and logs
Seems as though the fetch_or_enqueue behavior isn't working properly
INFO:root:Enqueuing task:id calculate_user_storage_task:3a505d01cb9e447f9360158b0dad61e1 for user:channel 2858:None | {'user_id': 2858}
INFO:root:Didn't fetch matching task calculate_user_storage_task for user 2858 | {'user_id': 2858}
bjester
changed the title
Concurrent and repeated attempts to calculate_user_storage_task through cheffing API
Pending task results are missing task name and kwargs
Nov 17, 2022
Observed behavior
A chef script produced thousands of enqueued
calculate_user_storage_task
s for the same user, which overwhelmed the task workersExpected behavior
For most tasks, any attempts to enqueue the task should only enqueue it if there isn't already a queued or currently executing task for the same arguments
User-facing consequences
Other users actively editing channels experience long delays for operations like copying and publishing, where the UI clearly shows the progress of the operation
Errors and logs
Seems as though the
fetch_or_enqueue
behavior isn't working properlyAdditional information
https://learningequality.slack.com/archives/C0LK8QS9J/p1668640815323059
celery/django-celery-results#334
Despite enabling extended results, the pending result does not have the 'extended' information
The text was updated successfully, but these errors were encountered: