added an integration to this channel: linen.dev

Release - v2022.05.0 New release published by yannickperrenet What's Changed Exciting new features 🎉 • Notifications back-end support by @fruttasecca in #896 • Upload files to create a new project by @iannbing in #908 Improvements 👷 • orchest-api scheduler keeps track of tasks in the database by @fruttasecca in #883 • Orchest-api keeps track of job events by @fruttasecca in #888 • Add project-not-found error by @iannbing in #892 • Fix failed to rename files in File Manager by @iannbing in #912 • Fix remove unsafe path joins by @fruttasecca in #913 • Add recurring task to process deliveries by @fruttasecca in #904 • Add Webhooks logic to

orchest-api

by @fruttasecca in #902 • Introduce event subscriptions and subscribers in

orchest-api

by @fruttasecca in #900 • Expand webhook payload content by @fruttasecca in #905 • Add security policy by @fruttasecca in #919 • Keep current tab selected on editor when selecting a different step by @BrunoOrchest in #920 • Improv/add scripts to copy projects and data by @fruttasecca in #923 New Contributors • @BrunoOrchest made their first contribution in #920 Full Changelog: v2022.04.5...v2022.05.0 orchest/orchest

What's the best way to handle a lot of requirements, currently in .yml? https://github.com/lalligagger/geo-notebooks/blob/main/environment.yml

Release - v2022.05.1 New release published by yannickperrenet What's Changed Breaking changes 🚨 • Introduce Orchest Kubernetes Operator by @yannickperrenet in #916 Improvements 👷 • Allow increasing jobs and interactive runs parallelism without restarting Orchest by @fruttasecca in #874 •

orchest-api

owns the orchest settings by @fruttasecca in #868 Full Changelog: v2022.05.0...v2022.05.1 orchest/orchest

Release - v2022.05.2 New release published by yannickperrenet Full Changelog: v2022.05.1...v2022.05.2 orchest/orchest

Release - v2022.05.3 New release published by yannickperrenet Full Changelog: v2022.05.2...v2022.05.3 orchest/orchest

Hey! Is there a feature for the pipelines yet where a single node can just be a sql query as opposed to a full fledged notebook?

Hi! Is there a way to get logs or something similar when a step on a pipeline job or even the job itself had failed? I want to implement a Lambda function that alert us in Slack when a step or job failed but I'm not sure if it's possible to get that status from Orchest.

👋 @Camille Beguin

👋 @Joel Walker

📣 Check out our latest blog post: "Lightning-fast queries with Polars" https://www.orchest.io/blog/the-great-python-dataframe-showdown-part-3-lightning-fast-queries-with-polars If you have ever heard of Polars but never actually tried it, this post clarifies how it operates, gives some tips and tricks, and compares it with pandas 😛olar_bear: let me know what you think about it!

Release - v2022.05.4 New release published by yannickperrenet What's Changed Breaking changes 🚨 • Improve robustness of Orchest Operator and update mechanism by @nhaghighat in #966 Exciting new features 🎉 • Add JavaScript support to Orchest by @ricklamers in #915 • Feat/canvas context menu by @BrunoOrchest in #931 • Add convenience installation script by @fruttasecca in #983 Improvements 👷 • Gate the session toggle by @yannickperrenet in #712 • Do not assume cluster name and namespace across Orchest by @fruttasecca in #940 • Persist the last-viewed pipeline in the project. by @iannbing in #949 • Remove unnecessary log terminatiog flag in custom jupyter builds by @fruttasecca in #997 • Prevent logged in user from deleting own account by @yannickperrenet in #999 • Disable opening file when the project has no pipeline by @iannbing in #1000 New Contributors • @ncspost made their first contribution in #984 Full Changelog: v2022.05.3...v2022.05.4 orchest/orchest

Release - v2022.06.1 New release published by yannickperrenet What's Changed Improvements 👷 • Fix issue: Command Palette is not callable in JupyterLab view by @iannbing in #1004 Full Changelog: v2022.05.4...v2022.06.1 orchest/orchest

Release - v2022.06.2 New release published by yannickperrenet What's Changed Exciting new features 🎉 • Enable keyboard navigation for File Picker in Step Properties by @BrunoOrchest in #992 Improvements 👷 • Fix key press not working in Jupyter Lab issue by @iannbing in #1012 Full Changelog: v2022.06.1...v2022.06.2 orchest/orchest

lots of new releases, monthly newsletter coming soon 😎

<!channel> Check out Data Overload Vol. 10, the latest edition of our monthly newsletter! ⚡ 🚧 Migration of cloud users approaching 🐳 Simplified installation procedure 🌐 Support for JavaScript 🖱️ Context menu in pipeline editor ...and lots more! Read the full post online here. Do you want to receive the next edition directly in your inbox? Subscribe here!

I’m having a weird issue where python libraries are successfully identified and run within JupyterLab, but in pipeline view, the libraries are not identified. (cc: @Shaleen Bengani)

Hi everyone! I ran into a minor problem. We deal with highly sensitive customer data at the company where I currently work, we work on virtual machines that are fully disconnected from the internet. Is there a way for me to download the Orchest package from my online environment and install and dockerize it on the VMs?

Release - v2022.06.3 New release published by yannickperrenet What's Changed Exciting new features 🎉 • Sending notifications when jobs fail. by @iannbing in #1008 Improvements 👷 • Don't lose settings "restart required" state on restart by @fruttasecca in #1001 • Improve base image development process by @fruttasecca in #985 • Fix pipeline auto-saving when deleting steps by @iannbing in #1023 • Fix UI flickering when polling by @iannbing in #1025 • Allow deleting steps using the keyboard by @BrunoOrchest in #1017 Full Changelog: v2022.06.2...v2022.06.3 orchest/orchest

<!everyone> Outgoing webhooks are available in the open source version! Now you can get notified when a job run fails 🎉

Release - v2022.06.4 New release published by yannickperrenet Full Changelog: v2022.06.3...v2022.06.4 orchest/orchest

Hello Everyone. I have an Orchest version: v2022.03.6 installed through Docker. I am playing with the source code, and I did something wrong. I need to remove the authentication because I lost the user password (shame on me). I read the documentation, that recommended to do the following command:

psql -U postgres -d orchest_api

UPDATE settings
SET value = '{"value": false}'
WHERE name='AUTH_ENABLED';

however, there is no database called settings in my Postgre. How should I proceed? In my version, there is a different way to remove the authentication?

hello team!! <!channel> I'm about to use Orchest for a Web Scrapping Selenium based proyect. Has anyone any experience using pyppeteer or similar python libraries with Orchest??

Hello team! Has the user auth configuration ready to use? I have set “auth_enabled” to true, but cannot find any page to add a user.

Release - v2022.06.5 New release published by yannickperrenet What's Changed Exciting new features 🎉 • Add support for loading job pipeline parameters with JSON files by @ricklamers in #1024 Improvements 👷 • Move analytics module to the shared internal library by @fruttasecca in #918 • Add project and pipeline events to

orchest-api

(notifications) by @fruttasecca in #956 • Add environment created/delete events to

orchest-api

(notifications) by @fruttasecca in #962 • Move job_update event to the

orchest-api

(notifications) by @fruttasecca in #961 • Add interactive pipeline run events to

orchest-api

(notifications) by @fruttasecca in #953 • Add jupyter builds and interactive sessions events to

orchest-api

(notifications) by @fruttasecca in #950 • Give orchest api access to the analytics module by @fruttasecca in #947 • Add environment image builds events to

orchest-api

(notifications) by @fruttasecca in #963 • Use the position of the Context Menu as the center when zoom in & zoom out by @iannbing in #1035 • Expand 'orchest-api' events and analytics capabilities by @fruttasecca in #964 • Fix file manager browsing on the read-only mode issue by @iannbing in #1043 New Contributors • @cavriends made their first contribution in #1038 Full Changelog: v2022.06.4...v2022.06.5 orchest/orchest

Hi <!channel>. Do you have some updated guide/video related to GIT with Orchest? I found a video but it seems to be out of date.

Hi Team. I have two questions. 1) I followed the tutorial and installed the Orchest using the convenience_install.sh. Is there a way to change the code and reflect changes as previous version by using orchest --dev? 2) Is there any documentation helping to access orchest outside of localhost (externally). following the convenience_install.sh, the installation process is on localhost, right?

Hello Everyone! I'm a windows10 user wanting to run Orchest locally. I followed the installation steps in the docs (installed minikube then Orchest) and I can see the Orchest interface in my web browser at 127.0.0.1 using the "minikube tunnel" command. But it is extremely slow and unresponsive. It takes minutes to load simple stuff. I have assigned 12 cpus to my minikube cluster. I went through older messages in this channel and using WSL is mentioned for running on Windows. Does anyone have the steps on running Orchest on windows?

Hello! I'm trying to setup Orchest for development. I followed the tutorial and got Orchest running (I just could not do sudo apt-get install -y default-libmysqlclient-dev as I'm on OpenSUSE where this package doesn't exist. But I figured it's just for the unit tests so I'll postbone the problem). So Orchest is running and in the settings it says 'development mode'. To test out the hot reload, I changed the title of the step details property tab. Pnpm recognized the changed and rebuild the frontend:

services/orchest-webserver/client dev: [watch] build started (change: "src/pipeline-view/step-details/StepDetails.tsx")
services/orchest-webserver/client dev: [watch] build finished

But the change is actually not visible on the page. Am I missing a step which I need to do?