Setup / Teardown after a branch #39316
Unanswered
TomFaulkner
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have a branched setup procedure, that either creates one Spark master instance and N workers or just creates the master instance. I have both of these branches as setup tasks, and two teardown tasks to terminate them all. This setup works as expected.
However, the task that follows a setup task must have ALL_SUCCESS as the trigger rule. Due to the branching tasks are skipped, causing this task to be skipped, and the DAG happily moves on to the teardown(s) and completes.
How do I not skip this task if the branch before it didn't include the setup workers tasks?
Beta Was this translation helpful? Give feedback.
All reactions