Unable to find Spark Support in helm chart #38856
Unanswered
anandlingaraj
asked this question in
General
Replies: 2 comments
-
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval. |
Beta Was this translation helpful? Give feedback.
0 replies
-
Airlfow has 90+ providers - https://airflow.apache.org/docs/ - only subset of those is installed in the reference airflow image. You need to extend airflow image and use your own if you want to add providers that are missing https://airflow.apache.org/docs/helm-chart/stable/production-guide.html#extending-and-customizing-airflow-image |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Apache Airflow version
2.9.0
If "Other Airflow 2 version" selected, which one?
apache/airflow:2.8.3
What happened?
When selecting connection type for Spark, its missing.
What you think should happen instead?
Expect Spark Connections to be default.
How to reproduce
Install Apche Spark in AKS/ MiniKube. Try to add Connections and select Spark.
Operating System
Docker
Versions of Apache Airflow Providers
No response
Deployment
Official Apache Airflow Helm Chart
Deployment details
No response
Anything else?
No response
Are you willing to submit PR?
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions