Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle mapped tasks in task duration chart #26722

Merged

Conversation

dstandish
Copy link
Contributor

@dstandish dstandish commented Sep 27, 2022

Previously mapped tasks each existed as their own independent-but-unlabeled points. Makes sense to aggregate them somehow.

Going with sum for now... would avg be better?

Depends on #26717

The before / after images below were achieved by running this a dag with 3 mapped tasks (base task hello) three times. Each task takes 10 seconds approximately.

After - non-cumulative

image

Before - non-cumulative

image

After - cumulative

image

Before - cumululative

image

@boring-cyborg boring-cyborg bot added the area:webserver Webserver related Issues label Sep 27, 2022
@bbovenzi
Copy link
Contributor

Do you have a before/after screenshot of this?

@dstandish
Copy link
Contributor Author

i will add

Previously mapped tasks each existed as their own independent-but-unlabeled points.  Makes sense to aggregate them somehow.
@dstandish dstandish force-pushed the handle-mapped-tasks-in-task-duration-chart branch from b975273 to d660752 Compare September 28, 2022 04:35
@dstandish dstandish merged commit 8829c07 into apache:main Sep 28, 2022
@dstandish dstandish deleted the handle-mapped-tasks-in-task-duration-chart branch September 28, 2022 06:31
@dstandish dstandish added this to the Airflow 2.4.2 milestone Oct 12, 2022
@ephraimbuddy ephraimbuddy added the type:bug-fix Changelog: Bug Fixes label Oct 18, 2022
ephraimbuddy pushed a commit that referenced this pull request Oct 18, 2022
Previously mapped tasks each existed as their own independent-but-unlabeled points.  Makes sense to aggregate them somehow.

(cherry picked from commit 8829c07)
ephraimbuddy pushed a commit that referenced this pull request Oct 18, 2022
Previously mapped tasks each existed as their own independent-but-unlabeled points.  Makes sense to aggregate them somehow.

(cherry picked from commit 8829c07)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:webserver Webserver related Issues type:bug-fix Changelog: Bug Fixes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants