Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement expand_kwargs() against a literal list #25925

Merged
merged 4 commits into from Sep 1, 2022

Conversation

uranusjr
Copy link
Member

This adds literal support to expand_kwargs():

task.expand_kwargs([{"arg": 1}, {"arg": 2}, ...])

# Literal list can contain either literal dict or XComArg.
task.expand_kwargs([xcom_arg, {"arg": 2}, ...])

This matches the expand() interface.

This needs #25924 to go in first and is submitted for CI now.

@ashb
Copy link
Member

ashb commented Aug 26, 2022

(Attempted to resolve conflicts vis GH, may not have worked out very well)

@uranusjr uranusjr force-pushed the aip-42-expand-kwargs-literal branch 2 times, most recently from e28341f to 2b7452e Compare August 28, 2022 17:04
The literal list may contain dict (operator kwargs) or an XComArg
(resolved to operator kwargs at runtime).
@uranusjr uranusjr force-pushed the aip-42-expand-kwargs-literal branch from 2b7452e to e28183d Compare August 29, 2022 08:11
Probably caused by rebasing.
@uranusjr uranusjr marked this pull request as ready for review August 29, 2022 17:12
@uranusjr uranusjr merged commit 4791443 into apache:main Sep 1, 2022
AIP-42: Dynamic Task Mapping automation moved this from In progress to Done Sep 1, 2022
@uranusjr uranusjr deleted the aip-42-expand-kwargs-literal branch September 1, 2022 00:51
@ephraimbuddy ephraimbuddy added the type:new-feature Changelog: New Features label Sep 13, 2022
@ephraimbuddy ephraimbuddy added this to the Airflow 2.4.0 milestone Sep 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:dynamic-task-mapping AIP-42 type:new-feature Changelog: New Features
Projects
No open projects
Development

Successfully merging this pull request may close these issues.

None yet

3 participants