Stages with conditional dependency #10418
Labels
A: pipelines
Related to the pipelines feature
feature request
Requesting a new feature
p3-nice-to-have
It should be done this or next sprint
Correct me if this already exists, I seem to see some merges from 2018 that may be related (#646 ) but see no examples.
Essentially I have a stage that prepares a model, of which I would like to specify multiple options as parameters. Each model has a potentially unique preprocessing step, BUT some models share an additional preprocessing step.
For example, param
model
modulates stagepredict
, which for some models requires no previous stage, but for others requires a stagepreprocess
. How can I ensure that preprocess is run for the required models but not rerun it because it is expensive. If I have the preprocess step also conditioned on parammodel
, it will rerun the step even if I switch between models where it does not need to be rerun.Thanks for any wisdom.
The text was updated successfully, but these errors were encountered: