Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Don't show stale Serialized DAGs if they are deleted in DB #16368

Merged
merged 1 commit into from Jun 11, 2021
Merged

Don't show stale Serialized DAGs if they are deleted in DB #16368

merged 1 commit into from Jun 11, 2021

Commits on Jun 11, 2021

  1. Don't show stale Serialized DAGs if they are deleted in DB 

    If `DagBag.get_dag()` is called currently, it will return the DAG
even if the DAG does not exist in `serialized_dag` table.

This PR changes that logic to remove the dag from local cache too
when `DagBag.get_dag()` is called. This happens after
`min_serialized_dag_fetch_secs`.
    @kaxil
    kaxil committed Jun 11, 2021
    Copy the full SHA
    fd42751 View commit details
    Browse the repository at this point in the history