is there a concept of conditional steps?
the use case in the quickstart would be after step 1, only run step 2
explore-data.ipynb
if some condition X is true, else if condition Y is true run
pre-processing.ipynb
r
Rick Lamers
10/01/2021, 10:19 PM
This would be easiest by passing in information that you branch on in the step itself by using
orchest.output
and
orchest.get_inputs()
In the sending and receiving step respectively
k
Kay Kayyy
10/01/2021, 10:21 PM
hmm so you're advising to still run every single step, but you would just have conditional entry and based on that whether to run the rest of the script/notebook or not
r
Rick Lamers
10/01/2021, 10:27 PM
Yes. So the step would basically be a no-op. We might add more native branching logic in the near future. That’s more practical if the branching is more extensive (e.g. there’s a whole branch - with multiple child nodes - of the DAG that should be conditional)