Release - v2022.03.3 New release published by yannickperrenet What's Changed Improvements 👷 • Fix onboarding redirect to quickstart issue by @iannbing in #809 Full Changelog: v2022.03.2...v2022.03.3 orchest/orchest

Release - v2022.03.4 New release published by yannickperrenet What's Changed Improvements 👷 • Fix the issue when saving services in pipeline editor by @iannbing in #815 Full Changelog: v2022.03.3...v2022.03.4 orchest/orchest

Release - v2022.03.5 New release published by yannickperrenet What's Changed Improvements 👷 • Fix showing onboarding dialog in help view by @iannbing in #819 Full Changelog: v2022.03.4...v2022.03.5 orchest/orchest

Release - v2022.03.6 New release published by yannickperrenet Full Changelog: v2022.03.5...v2022.03.6 orchest/orchest

Release - v2022.03.7 New release published by yannickperrenet What's Changed Breaking changes 🚨 • k8s PR by @ricklamers in #623 Exciting new features 🎉 • [Feature] File Manager by @iannbing in #795 New Contributors • @nhaghighat made their first contribution in #654 Full Changelog: v2022.03.6...v2022.03.7 orchest/orchest

orchest we will be sending a longer announcement soon, but in the meantime, we are thrilled to tell you that Orchest v2022.03.7 is backed by Kubernetes kubernetes in the words of @Rick Lamers, "The move to Kubernetes was long in the making, it truly unleashes the architecture of Orchest to operate at cluster scale. With containers as first class primitives throughout the application we're seeing linear speedups across a number of features. This change makes it possible to work with a large team on a single beefy cluster. That opens up many interesting opportunities for collaboration." we are now working to take these changes to Orchest Cloud, but in the meantime you can try out the new version yourselves, using local kubernetes solutions like minikube. check out our installation instructions https://docs.orchest.io/en/latest/getting_started/installation.html and if you have any question, let us know!

Release - v2022.03.8 New release published by yannickperrenet What's Changed Improvements 👷 • add pvc to docker-registry by @nhaghighat in #828 Full Changelog: v2022.03.7...v2022.03.8 orchest/orchest

Long time I havent posted here since successfully passed paid pipeline to client. But i have few questions more due to my new project: 1. Is there any way to notify of failed run to webhook? 2. There is no collaboration at this point - and someone can accidentally overwrite others file, right?

hi @Serhii! about (1), we were discussing exactly that last week, feel free to weigh in https://github.com/orchest/orchest/issues/120 at the moment, the best workaround would be to add custom logic to your notebook/script that pings a given service of your choice. but we plan to improve this very soon

about (2), we did experiment enabling the new Real Time Collaboration feature of JupyterLab, but it turns out it's not production-ready yet so we disabled it. however, the good news is that https://github.com/jupyterlab/jupyterlab/pull/11599 is about to be merged very soon, which means that the next release of JupyterLab will probably have a robust RTC feature we can try out

hi everybody! we've been using orchest a few months, but we updated and now we are struggling with the minikubes disk space (20 gb) , how can we configure a bigger disk, the server has 200gb of disk

Release - v2022.03.9 New release published by yannickperrenet What's Changed Improvements 👷 • Inject user defined environment variables on kernel start by @yannickperrenet in #839 • Allow specifying user dir, builder cache and nfs claim size on install by @fruttasecca in #840 Full Changelog: v2022.03.8...v2022.03.9 orchest/orchest

Release - v2022.03.10 New release published by yannickperrenet Full Changelog: v2022.03.9...v2022.03.10 orchest/orchest

Hi everyone. We've been using Orchest in the last couple of months and now we have some problems with the kernel connection of Jupyter Lab. We did a clean install on our server last week (we have now Orchest in version v2022.03.8). Refferring to the problem with the kernel connection, when we run the script cells, in Jupyter Lab appears "Python 3 | Connecting" and after a few minutes, "Python 3 | Disconnected". What could be the problem here? Because when we run our pipelines' jobs or even when we run scripts in .py files we don't have problems

<!channel> Check out Data Overload Vol. 8, the latest edition of our monthly newsletter! ⚡ kubernetes Orchest on Kubernetes now a reality! 📂 New file manager 🐛 JupyterLab debugger 🤏 Panning and pinching on the pipeline editor ...and lots more! Read the full post online here. Do you want to receive the next edition directly in your inbox? Subscribe here!

😅

Hey Orchest community! Here is our Weaviate Podcast with Rick Lamers presenting many ideas around Orchest! I am having so much fun learning about this exciting tool for Data Science, and I really hope you all enjoy the podcast with Rick!

Release - v2022.04.0 New release published by yannickperrenet What's Changed Improvements 👷 • Enable panning and pinching on Pipeline Editor by @iannbing in #842 • Fix the error when moving a folder while its sub folders or files are also selected by @iannbing in #847 • Fix: FilePicker should have access to /data folder by @iannbing in #836 • Enable creating or uploading files or folders in sub folders within

Project files

and

/data

by @iannbing in #833 • Add development mode (internal use) by @fruttasecca in #832 • Set

DEBIAN_FRONTEND=noninteractive

for

sudo

in environments by @yannickperrenet in #846 • Redirect to Pipelines if user deleted the orchest file of the current pipeline. by @iannbing in #861 Full Changelog: v2022.03.10...v2022.04.0 orchest/orchest

👋 Bonjour à tous !

Hey everyone! We've published @Rick Lamers's demo on using Weaviate + Orchest + Streamlit to search through a dutch tech blog. Thank you so much for this Rick, this is such a cool hands-on demo and this application is super exciting!

Hi, quick question. Does someone know if it is posible to capture the exit of a pipeline? For example, a pipeline step that fails or exit with some response

it's Friday! what did you use Orchest for this week? I'm all eyes 👀orchest

Release - v2022.04.1 New release published by yannickperrenet What's Changed Improvements 👷 • Speedup environment image and jupyter builds by using

buildah

for image builds by @fruttasecca in #837 • Merge the functionality of the

Pipelines

view into PipelineEditor by @iannbing in #869 • Automatically delete unused custom Jupyter server images from nodes and registry by @fruttasecca in #873 • Automatically delete unused Orchest images from nodes by @fruttasecca in #875 • Automatically delete unused environment images from nodes and registry by @fruttasecca in #872 • Fix session not auto-started when changing pipeline in PipelineEditor by @iannbing in #882 Full Changelog: v2022.04.0...v2022.04.1 orchest/orchest

Release - v2022.04.2 New release published by yannickperrenet What's Changed Improvements 👷 • Fix broken

update-sidecar

dependencies by @fruttasecca in #886 Full Changelog: v2022.04.1...v2022.04.2 orchest/orchest

Release - v2022.04.3 New release published by yannickperrenet Full Changelog: v2022.04.2...v2022.04.3 orchest/orchest

Release - v2022.04.4 New release published by yannickperrenet orchest/orchest

Release - v2022.04.5 New release published by yannickperrenet What's Changed Improvements 👷 • Fix Configure Jupyter Lab view not loading issue by @iannbing in #898 Full Changelog: v2022.04.4...v2022.04.5 orchest/orchest

👋 Hi everyone!

hi folks! we have been discussing internally how to offer a better experience for Orchest users writing their own ETL/EL(T) data pipelines. I posted some thoughts here, feel free to weigh in or tell us about your experiences so far doing this sort of thing with Orchest. feedback greatly appreciated!

📣 Check out our latest blog post: "Out-of-core processing with Vaex" https://www.orchest.io/blog/the-great-python-dataframe-showdown-part-2-out-of-core-processing-with-vaex If you have ever heard of Vaex but never actually tried it, this post clarifies how it operates, gives some tips and tricks, and compares it with pandas 🌌 let me know what you think about it!