[error] airflow postgres

[Geronium]

Apache Airflow version

2.1.2

Operating System

Debian GNU/Linux 10 (buster)

Versions of Apache Airflow Providers

airflow@airflow-webserver-54b99db477-fs46m:/opt/airflow$ pip freeze | grep providers
apache-airflow-providers-amazon==2.0.0
apache-airflow-providers-celery==2.0.0
apache-airflow-providers-cncf-kubernetes==2.0.0
apache-airflow-providers-docker==2.0.0
apache-airflow-providers-elasticsearch==2.0.2
apache-airflow-providers-ftp==2.0.0
apache-airflow-providers-google==4.0.0
apache-airflow-providers-grpc==2.0.0
apache-airflow-providers-hashicorp==2.0.0
apache-airflow-providers-http==2.0.0
apache-airflow-providers-imap==2.0.0
apache-airflow-providers-microsoft-azure==3.0.0
apache-airflow-providers-mysql==2.0.0
apache-airflow-providers-postgres==2.0.0
apache-airflow-providers-redis==2.0.0
apache-airflow-providers-sendgrid==2.0.0
apache-airflow-providers-sftp==2.0.0
apache-airflow-providers-slack==4.0.0
apache-airflow-providers-sqlite==2.0.0
apache-airflow-providers-ssh==2.0.0

Deployment

Official Apache Airflow Helm Chart

Deployment details

just do a :

helm upgrade --debug --cleanup-on-fail --install airflow ./airflow.tgz --namespace airflow --create-namespace

What happened

after the installation, i added an example of a dag inside the dag directory, and i don't saw this dag with the navigator

https://airflow.apache.org/docs/apache-airflow/stable/tutorial.html

so i done a db init

airflow@airflow-webserver-54b99db477-fs46m:/opt/airflow$ airflow db init
DB: postgresql://postgres:***@airflow-postgresql.airflow:5432/postgres?sslmode=disable
[2021-09-17 13:14:21,956] {db.py:692} INFO - Creating tables
INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
INFO [alembic.runtime.migration] Will assume transactional DDL.
Initialization done

after that i can saw my dag

but it disappear after something like 2 minutes

and i can saw in the logs of postgres this errors at the starting of the postgresql pod, i don't know if this is the reason of the disappearing of my dag

`[root] # kubectl logs airflow-postgresql-0 -n airflow
postgresql 12:26:27.57
postgresql 12:26:27.58 Welcome to the Bitnami postgresql container
postgresql 12:26:27.59 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-postgresql
postgresql 12:26:27.59 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-postgresql/issues
postgresql 12:26:27.60
postgresql 12:26:27.65 INFO ==> ** Starting PostgreSQL setup **
postgresql 12:26:27.69 INFO ==> Validating settings in POSTGRESQL_* env vars..
postgresql 12:26:27.71 INFO ==> Loading custom pre-init scripts...
postgresql 12:26:27.73 INFO ==> Initializing PostgreSQL database...
postgresql 12:26:27.80 INFO ==> pg_hba.conf file not detected. Generating it...
postgresql 12:26:27.81 INFO ==> Generating local authentication configuration
postgresql 12:26:29.04 INFO ==> Starting PostgreSQL in background...
postgresql 12:26:29.22 INFO ==> Changing password of postgres
postgresql 12:26:29.30 INFO ==> Configuring replication parameters
postgresql 12:26:29.39 INFO ==> Configuring fsync
postgresql 12:26:29.52 INFO ==> Loading custom scripts...
postgresql 12:26:29.54 INFO ==> Enabling remote connections
postgresql 12:26:29.58 INFO ==> Stopping PostgreSQL...
waiting for server to shut down.... done
server stopped
postgresql 12:26:29.71 INFO ==> ** PostgreSQL setup finished! **

postgresql 12:26:29.75 INFO ==> ** Starting PostgreSQL **
2021-09-17 12:26:29.784 GMT [1] LOG: pgaudit extension initialized
2021-09-17 12:26:29.785 GMT [1] LOG: listening on IPv4 address "0.0.0.0", port 5432
2021-09-17 12:26:29.785 GMT [1] LOG: listening on IPv6 address "::", port 5432
2021-09-17 12:26:29.788 GMT [1] LOG: listening on Unix socket "/tmp/.s.PGSQL.5432"
2021-09-17 12:26:29.812 GMT [130] LOG: database system was shut down at 2021-09-17 12:26:29 GMT
2021-09-17 12:26:29.819 GMT [1] LOG: database system is ready to accept connections
2021-09-17 12:26:38.853 GMT [143] LOG: incomplete startup packet
2021-09-17 12:26:38.912 GMT [144] LOG: incomplete startup packet
2021-09-17 12:26:39.567 GMT [145] LOG: incomplete startup packet
2021-09-17 12:26:39.634 GMT [146] LOG: incomplete startup packet
2021-09-17 12:26:42.909 GMT [149] ERROR: relation "log" does not exist at character 13
2021-09-17 12:26:42.909 GMT [149] STATEMENT: INSERT INTO log (dttm, dag_id, task_id, event, execution_date, owner, extra) VALUES ('2021-09-17T12:26:42.877318+00:00'::timestamptz, NULL, NULL, 'cli_upgradedb', NULL, 'airflow', '{"host_name": "airflow-run-airflow-migrations-wwccb", "full_command": "[''/home/airflow/.local/bin/airflow'', ''db'', ''upgrade'']"}') RETURNING log.id
2021-09-17 12:26:43.238 GMT [149] ERROR: relation "connection" does not exist at character 55
2021-09-17 12:26:43.238 GMT [149] STATEMENT: SELECT connection.conn_id AS connection_conn_id
FROM connection GROUP BY connection.conn_id
HAVING count(*) > 1
2021-09-17 12:26:43.240 GMT [149] ERROR: current transaction is aborted, commands ignored until end of transaction block
2021-09-17 12:26:43.240 GMT [149] STATEMENT: SELECT connection.password AS connection_password, connection.extra AS connection_extra, connection.id AS connection_id, connection.conn_id AS connection_conn_id, connection.conn_type AS connection_conn_type, connection.description AS connection_description, connection.host AS connection_host, connection.schema AS connection_schema, connection.login AS connection_login, connection.port AS connection_port, connection.is_encrypted AS connection_is_encrypted, connection.is_extra_encrypted AS connection_is_extra_encrypted
FROM connection
WHERE connection.conn_type IS NULL
2021-09-17 12:26:43.302 GMT [150] ERROR: relation "log" does not exist at character 13
2021-09-17 12:26:43.302 GMT [150] STATEMENT: INSERT INTO log (dttm, dag_id, task_id, event, execution_date, owner, extra) VALUES ('2021-09-17T12:26:43.269569+00:00'::timestamptz, NULL, NULL, 'cli_flower', NULL, 'airflow', '{"host_name": "airflow-flower-545dd8bf97-pwjbp", "full_command": "[''/home/airflow/.local/bin/airflow'', ''celery'', ''flower'']"}') RETURNING log.id
2021-09-17 12:27:01.648 GMT [166] LOG: incomplete startup packet
2021-09-17 12:27:02.277 GMT [167] LOG: incomplete startup packet
2021-09-17 12:27:02.919 GMT [168] LOG: incomplete startup packet`

What you expected to happen

No response

How to reproduce

No response

Anything else

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[boring-cyborg[bot]]

Thanks for opening your first issue here! Be sure to follow the issue template!

[dtiethan]

Did you ever figure this out?

[Taragolis]

This one with stale from very beginning, I would recommend to open a new discussion with exact a problem that you have, what version of Airflow do you use and what is your deployment and what step you already done

[dtiethan]

Classic XKCD. There's probably no point, I figured I'd just toss a note in the off chance the OP gets the email alert and remembers ;) Seems like this isn't a common issue as far as I've seen.

[Geronium]

Hello,

sorry I don't really remember the error.

I know I had a problem because I didn't have all the airflows components at the right version. You really have to be careful that they are all on the same version, otherwise there may be compatibility problems.

Do you know Kubernetes well ?

Good luck

[dtiethan]

Sorry for the delay, it's been a wild few weeks. I did actually end up figuring it out. The problem was due to resource quotas on the namespace. The claim didn't have a limit set, so it wasn't regulating how large some of the files were getting (I believe a log file was the main culprit). When the file got to the point where the resource quota was violated, it just hard reset the storage resource which broke the claim. I didn't ever see a log showing that the claim had broken or anything, but that's what I deduced after watching it happen over and over while monitoring the different resources involved.

Once I added a limit to the volume claim made, everything started working correctly.