Hi everyone! I have a problem with a job in this version of Orchest. I configured a job to run every 10 minutes but apparently, some pipelines don't start in the right time, causing that the next pipeline start out of time. I already check inside every pipeline if there is a process that it takes more time to run but everything it's going great inside. Here is a screenshot of the pipelines and a screenshot of the pipeline that run at 3.20pm.

Release - v2022.06.7 New release published by yannickperrenet What's Changed Breaking changes 🚨 • remove helm releated labels by @nhaghighat in #1049 Improvements 👷 • Add system requirements to documentation by @astrojuanlu in #1051 • Celery worker queries

orchest-api

for parallelism setting on start by @fruttasecca in #1061 • Keep track of pipeline runs creation time at the database level by @fruttasecca in #1062 Full Changelog: v2022.06.6...v2022.06.7 orchest/orchest

Release - v2022.07.0 New release published by yannickperrenet What's Changed Improvements 👷 • Fix celery-worker bringup and image builder on arm64 by @ricklamers in #1076 Full Changelog: v2022.06.7...v2022.07.0 orchest/orchest

<!channel> Check out Data Overload Vol. 11, the latest edition of our monthly newsletter! ⚡ 🎨 Working on the new navigation 🐳 Bringing Orchest to all of Kubernetes 🇬🇧 Spreading the love at PyData London 🔔 Notifications for job failures 🗄️ Load job pipeline parameters from JSON files ...and lots more! Read the full post online. Do you want to receive the next edition directly in your inbox? Subscribe here!

Hey team! Is there a way for fellow-team members to start / stop an instance on cloud.orchest.io? At the moment, my account has a free instance - but we're looking into a paid instance from orchest, but I think I still have to be the one to login to start / stop instances. Since our team works in different time zones and hours, it would be great if they could be allowed to start / stop instances as and when they work.

Couple feature questions: • Is there a provision for some kind of Orchest API that allows one to sync a git repo with Orchest in some way? That is, is it possible to develop on another computer other than orchest's instances and then commit the developments to test / deploy directly on orchest's execution environment? Perhaps this could be achieved through some form of Github actions • Is it possible to use some sort of simple DAG syntax (like airflow) that orchest can then use to auto-construct pipelines? • Can we consider a "library" / "marketplace" of commonly-used Orchest nodes in the pipeline available for general use? For ex: ◦ A node that reads data from any database based on the pipeline / job parameters and gets data. ◦ Common text transformations like uppercase / lowercase / removing nulls, etc ◦ Integrations with libraries like Great Expectations, etc by default without having to initialize the container with them

hello everyone! we're thrilled to share with you our Public Roadmap 😮rchest:🏗️ https://github.com/orgs/orchest/projects/1/ we hope this gives wider visibility of what we're working on, what we intend to tackle next, and what do we have in the back of our minds. remember that you can always upvote issues on GitHub or leave comments there and we will always take your input into account. happy pipelining!

Release - v2022.07.1 New release published by yannickperrenet What's Changed Improvements 👷 • Support multiple client sessions per user by @fruttasecca in #1073 • Allow specifying volume claim sizes on

orchest install

by @fruttasecca in #1079 • Periodically cleanup builder cache by @fruttasecca in #1074 Full Changelog: v2022.07.0...v2022.07.1 orchest/orchest

Big celebration going on here with the team 🎉 We just released the

Kubernetes

based Orchest version to Orchest Cloud. All new instances created will run on the latest version of Orchest OSS and updating to the latest version again works as expected 💯 Thank you for the amazing work @Jacopo @Navid H @Huang-Ming @Yannick @juanlu @Nick Post !

Release - v2022.07.2 New release published by yannickperrenet What's Changed Exciting new features 🎉 • Support

containerd

as the container runtime by @nhaghighat in #1048 Improvements 👷 • Add GKE and EKS installation instructions by @nhaghighat in #1094 • rename tools to utility-containers and fix image-pull shell by @nhaghighat in #1095 • Mount jupyterlab settings directory in image builder when building custom jupyter images by @fruttasecca in #1096 • Fix web server request logging in dev mode by @jerdna-regeiz in #1087 • Autofocus the parameter edit field in Job Edit view. by @iannbing in #1100 • Set correct permissions on

/pip-cache

by @nhaghighat in #1093 • Only use

image-puller

initContainer

if

jupyter-server

is customized by user by @nhaghighat in #1099 • Fix: Allow multiple pipeline files (

.orchest

extension) to be present in a subdirectory by @jerdna-regeiz in #1107 New Contributors • @jerdna-regeiz made their first contribution in #1087 Full Changelog: v2022.07.1...v2022.07.2 orchest/orchest

notice that, if you were waiting for a way to install Orchest in your GKE or EKS cluster, now you can!

Exciting news ⭐🤖! Today we launched MutableAI on Orchest Cloud. Are you familiar with Github Copilot? It's like that, but for JupyterLab! It works on Jupyter Notebooks, both autocompletion and intelligent refactoring! Check the video or read the blog post: https://www.orchest.io/blog/mutableai-ai-coding-assistant MutableAI features: • Autocomplete • Open ended transforms • Productionize code • Type annotations The best thing about all of this? It's available for free on Orchest Cloud using the free tier instances. Check it out now 🏃 💨

Hi, guys! We've being trying Orchest k8s version here, but we want to migrate the work that we built on top a previous version

v2021.12.0

(deployed using docker-compose). Do you have a guide for this migration? Is there a script to do this? Or can we just suppose that if we migrate all the files - including those

.orchest

everything will work fine?

Hey everyone! I've installed orchest for the first time using microk8s, however, I'm facing an issue: When using "Switch to JupyterLab" the website says "Setting up JupyterLab..." and starts flickering. This goes on as long as I don't do anything. I can stop it by pressing any button but this also means I can't get into JupyterLab.

In the browser console it's also stating: "Reloading iframe page because JupyterLab page not loaded (4XX or 5XX)."

Release - v2022.07.3 New release published by yannickperrenet What's Changed Improvements 👷 • Create pipeline step on file creation by @mausworks in #1097 • Include OS specific instructions in CLI by @mausworks in #1110 • Fix project import race condition by @fruttasecca in #1111 • Fix

Run selected steps

in the context menu not working issue. by @iannbing in #1118 • Improve

orchest-cli

loading spinner robustness by @yannickperrenet in #1117 • Add rating widget, fix sidebar scrollbar issue. by @ricklamers in #1116 • File editor improvements by @mausworks in #1115 • Pass detected ingress class name to orchest-api by @nhaghighat in #1123 • fix: show a Snackbar when stopping all sessions. by @iannbing in #1130 Full Changelog: v2022.07.2...v2022.07.3 orchest/orchest

Release - v2022.07.4 New release published by yannickperrenet What's Changed Improvements 👷 • Fix Javascript errors in docs by correctly handling

READTHEDOCS_DATA

by @ricklamers in #1132 • Show a proper warning in PipelineEditor if Jupyterlab is being built. by @iannbing in #1131 Full Changelog: v2022.07.3...v2022.07.4 orchest/orchest

Release - v2022.07.5 New release published by yannickperrenet What's Changed Improvements 👷 • Fix: App crashing due to bad length check by @mausworks in #1136 • Fix: Pipeline editor readonly after viewing job by @mausworks in #1137 Full Changelog: v2022.07.4...v2022.07.5 orchest/orchest

Hi, guys! How you doing? I'm testing the new k8s deployment here, and I'm getting this error, when I try to start a kernel: ``HTTP 599: Unknown (Error attempting to connect to Gateway server url 'http://jupyter-eg-41d7c6a2-e579-467ec0ee3f1a-723f-4294:8888/jupyter-server-41d7c6a2-e579-467ec0ee3f1a-723f-4294'. Ensure gateway url is valid and the Gateway instance is running.)`` Do you have some tips about how to deal with it?

Release - v2022.07.6 New release published by yannickperrenet What's Changed Improvements 👷 • Fix error on environments page by @mausworks in #1141 • Fix Flask services' performance issues on Windows by @ricklamers in #1134 • Add version warning for latest docs by @astrojuanlu in #1144 • Update third-parties on Orchest update by @nhaghighat in #1126 • Fallback to buildah pull if docker pull fails by @fruttasecca in #1159 Full Changelog: v2022.07.5...v2022.07.6 orchest/orchest

Hi, guys! Do Orchest have an easy way to translate the UI to other languages?

<!channel> Check out Data Overload Vol. 12, the latest edition of our monthly newsletter! ⚡ 🧠 We are partnering with MutableAI 👤 Multiple client sessions per user now supported 🐳 Revamped installation instructions ⚗️ Create pipeline step for new files :ninja: Better indicator for not exposed services ...and lots more! Read the full post online 😮rchest: Do you want to receive the next edition directly in your inbox? Subscribe here!

Release - v2022.08.0 New release published by yannickperrenet Full Changelog: v2022.07.6...v2022.08.0 orchest/orchest

Release - v2022.08.1 New release published by yannickperrenet What's Changed Improvements 👷 • Get exit code to avoid race condition on failure by @fruttasecca in #1167 • Only remove helm histories if there is already a helm release by @nhaghighat in #1169 Full Changelog: v2022.08.0...v2022.08.1 orchest/orchest

Release - v2022.08.2 New release published by yannickperrenet Full Changelog: v2022.08.1...v2022.08.2 orchest/orchest

Release - v2022.08.3 New release published by yannickperrenet What's Changed Improvements 👷 • Always post environment to

orchest-api

when creating a project by @fruttasecca in #1174 Full Changelog: v2022.08.2...v2022.08.3 orchest/orchest

Release - v2022.08.4 New release published by yannickperrenet What's Changed Improvements 👷 • Remove generated CRD definitions by @nhaghighat in #1177 • Remove package managers builder cache by @fruttasecca in #1178 Full Changelog: v2022.08.3...v2022.08.4 orchest/orchest

Hi, guys! Do you usually use Github inside Orchest? I've been looking around this, and I noticed that every time that we build a container, All the

ssh keys

are deleted. Do you have some guideline about the best way to keep a Project in sync with a Github Repo?

Release - v2022.08.5 New release published by yannickperrenet What's Changed Improvements 👷 • Improve race condition handling in image builds errors by @fruttasecca in #1184 Full Changelog: v2022.08.4...v2022.08.5 orchest/orchest