Allow backlog parameter to be set with ssl_bind DSL #2780
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
We're adding option for setting the socket backlog value with the
ssl_bind
DSL, and updating the docs with a hint to thenet.core.somaxconn
sysctl value. What's interesting here is that on older Linux kernels it defaults to 128 (reference), so the actual backlog value is capped to it.Even with the default backlog value of 1024 (when kernel allows it), we are seeing some requests get dropped (504 errors with AWS ALB). That happens with a super fast end-points that respond in < 5ms occasionally when receiving a blast of requests within few seconds and there are other slower end-points that saturate the queue causing some requests to get dropped. So, I'm tweaking slightly the original doc about
backlog
that were misleading:Your checklist for this pull request
[ci skip]
to the title of the PR.#issue
" to the PR description or my commit messages.