Makes sense! I like the point on the vendor lock in very much. Did you personally find yourself struggle with cloud specific abstractions, and find the friction to hinder iteration? Is that the motivation for starting Orchest?
Lastly, a friend who works at a Robotics startup in SF mentioned that their team do everything with
Databricks notebooks and PySpark. Orchest provides subtle additional benefits like
services. However, barring this and the ability to create pipelines with a graphical editor, other features you outline above seem to in large part be addressed by DataBricks as well. Am I right in understanding then that the beauty of Orchest stems from the additional concept of services?
To be transparent (since the above can feel quite blunt/an attack on Orchest which this is not), I'm merely trying to ascertain industry solutions and why people have chosen some over others. The stars on Github evidence the success of the platform.