Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to modify environment variables for Kubernetes job after switching from PostgreSQL to MySQL in Dagster #21716

Closed
Shahrullo opened this issue May 8, 2024 · 1 comment
Labels
area: docs Related to documentation in general deployment: k8s Related to deploying Dagster to Kubernetes

Comments

@Shahrullo
Copy link

What's the issue or suggestion?

Hello, I have a question about modifying environment variables for a Kubernetes job. I have modified the Dagster Helm chart to switch the storage backend from PostgreSQL to MySQL instead. The webserver and daemon components are working fine with the new MySQL configuration, but the code-user deployment is still expecting the PostgreSQL password environment variable.

When I look at the job logs for the code-user deployment, I see the following:
DAGSTER_PG_PASSWORD: .

In the current Helm chart configuration, there are no variables related to PostgreSQL. I believe the issue might be within the code-user Docker image itself, where the PostgreSQL environment variable is still being expected.

How can I modify the environment variables for this Kubernetes job (specifically the code-user deployment) to use the MySQL password instead of the PostgreSQL password?

Additional information

No response

Message from the maintainers

Impacted by this issue? Give it a 👍! We factor engagement into prioritization.

@Shahrullo Shahrullo added the area: docs Related to documentation in general label May 8, 2024
@garethbrickman garethbrickman added the deployment: k8s Related to deploying Dagster to Kubernetes label May 8, 2024
@Shahrullo
Copy link
Author

I have found a solution to the issue. The Kubernetes Dagster cluster is now using MySQL instead of PostgreSQL. However, this is not an optimal solution as the PostgreSQL environment variables are hard-coded within the Python packages. In the future, I plan to modify the packages and submit a pull request to address this issue more comprehensively.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area: docs Related to documentation in general deployment: k8s Related to deploying Dagster to Kubernetes
Projects
None yet
Development

No branches or pull requests

2 participants