https://www.orchest.io/ logo
Title
b

Bartłomiej Tokarzewski

04/13/2022, 11:50 AM
Hi everyone, I like developing workflows in visual programming languages. I have 2 questions about the orchest. 1. Is it possible to export the workflow as a single python script? 2. How can I change the visibility of the inputs and outputs so I can see more than one input or output?
👋 2
👀 1
r

Rick Lamers

04/13/2022, 11:57 AM
Hi Bartomiej! Great to see another enthusiast of complex visualizations 🙂 1. The workflow is declaratively specified as a JSON file. E.g. this file: https://github.com/orchest/quickstart/blob/main/california_housing.orchest 2. What do you mean by "visibility of inputs"? The output of each step can be an arbitrary object, so it can be a dictionary with multiple keys for example. But each step can only output a single object at this time. For serialization we currently rely on Python's Pickle.
b

Bartłomiej Tokarzewski

04/13/2022, 5:58 PM
@Rick Lamers This is what I meant
🤔 1
r

Rick Lamers

04/14/2022, 9:21 AM
Node multi-output doesn't really fit the model we have for the DAG. One area that we're still exploring actively is how we can visualize better the data that's being passed from one step to the next (this is dynamic however, it depends on the execution of the script/notebook). It would be cool to explore some ideas there, and might give the functionality you're seeking.
(although after our switch to k8s we've disabled passing by memory server as usually passing by disk was fast enough and supported multi-node and large data outputs better)