-
Notifications
You must be signed in to change notification settings - Fork 236
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Jobs get delayed #328
Comments
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. |
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. |
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. |
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. |
@mahmoudawadeen a few questions for you:
|
Hello,
Background:
sidekiq: 5.2.3
sidekiq-scheduler: 3.0.1
redis: 5.0.2
jruby: 9.1.17.0
We are running only one container for sidekiq-scheduler and the sidekiq config of that container (the client) is listening to an always empty queue, to ensure that this container is only busy scheduling tasks and not processing any jobs. We have multiple sidekiq worker containers listening to the queues used in the scheduler schedule file. We are using cron syntax for all the jobs we have. sidekiq-scheduler and all sidekiq workers are connected to the same redis db.
Issue:
The jobs most of the time run at the scheduled time but sometimes they are delayed.
Investigation:
We looked at one instance of such behavior and compared the timestamps the job actually ran at (check screenshot from kibana)
vs
the timestamps in the pushed sorted set in redis (check screenshot from redis db)for and found that the pushed set (sidekiq:sidekiq-scheduler:pushed:<job_class>) contained a value for the delayed job with the expected timestamp.
Question
We don't believe the workers are a bottleneck, is there anything in the sidekiq-scheduler that would make it behave this way. are there any metrics we could look at to be able to identify if the issue is in sidekiq or sidekiq-scheduler?
The text was updated successfully, but these errors were encountered: