Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Application crashing with "Uncaught signal: 11, pid=9, tid=9" #22580

Open
benjsec opened this issue Feb 5, 2024 · 0 comments
Open

[BUG] Application crashing with "Uncaught signal: 11, pid=9, tid=9" #22580

benjsec opened this issue Feb 5, 2024 · 0 comments

Comments

@benjsec
Copy link

benjsec commented Feb 5, 2024

Agent Environment

datadog/serverless-init:1.2.0
ddtrace 2.5.2

Describe what happened:

Since upgrading from serverless-init 1.1.4 to 1.2.0 our API application has been intermittently crashing whilst processing some requests. We haven't been able to discern any pattern to the crashes, but when they do happen the inner python application is not able to record any log message, not even a traceback to show if there was an internal error.
The only log messages we get are

Uncaught signal: 11, pid=9, tid=9, fault_addr=68283313160192.

(fault_addr changes each time), and

The request failed because either the HTTP response was malformed or connection to the instance had an error. Additional troubleshooting documentation can be found at: https://cloud.google.com/run/docs/troubleshooting#malformed-response-or-connection-error

We've worked through the linked troubleshooting and are confident that this isn't an issue in our application, nor has our GCP config changed.

Downgrading to serverless-init 1.1.4 (and ddtrace 2.4.1) seems to have resolved this issue, although given their intermittent nature it's hard to be sure.

Describe what you expected:

API requests to succeed

Steps to reproduce the issue:

Additional environment details (Operating System, Cloud provider, etc):

Running in GCP cloud run, wrapping a FastAPI application
Base docker image python:3.12-slim

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants