@ul has joined the channel

<!channel> hello Orchest community! we would like to invite you to our Community Event 😮rchest: Join us live on September 21 to learn more about the latest improvements we have made to Orchest, see a project walkthrough showcasing the new UI, get a glimpse of what’s in the pipeline for the coming months, and get to talk with the team! I will be your host and both @Rick Lamers and @Jacopo will be with us as well. Register here! ➡️ https://lu.ma/orchest-new-ui-better-performance

@Bilal Aslam has joined the channel

Upcoming feature in the next Orchest release! Y'all like terminals, right?

rick@orchest:~$ release new-feature-🔥

https://www.tella.tv/video/cl7uhhf2t00dx0gmeck4pfx3w/view

@Vusal Salmanov has joined the channel

Release - v2022.09.0 New release published by yannickperrenet What's Changed Improvements 👷 • Bust cache when manually checking for updates by @yannickperrenet in #1243 • Detect k8s distro and add ingress if needed by @nhaghighat in #1182 • Tweak Orchest to better handle times of CPU contention by @yannickperrenet in #1250 • Adopt Orchest PVCs with no ownerReferences by @nhaghighat in #1254 New Contributors • @sbarrios93 made their first contribution in #1216 Full Changelog: v2022.08.11...v2022.09.0 orchest/orchest

@Mirantha Jayathilaka has joined the channel

Release - v2022.09.1 New release published by yannickperrenet What's Changed Exciting new features 🎉 • Environment shells by @ricklamers in #1248 Full Changelog: v2022.09.0...v2022.09.1 orchest/orchest

<!channel> TODAY is the big day! Tune in at 15:00 UTC (17:00 CEST) to learn more about the new Orchest UI and performance improvements! https://lu.ma/orchest-new-ui-better-performance?utm_source=slack

Release - v2022.09.2 New release published by yannickperrenet What's Changed Exciting new features 🎉 • Allow parallelism for environment and jupyter builds by @fruttasecca in #1227 • Container performance improvements & UI revamp by @fruttasecca in #1269 Improvements 👷 • Improve pipeline run performance on single-node Orchest deployments by @yannickperrenet in #1214 • Build images on the node directly by @fruttasecca in #1253 • Print help message if orchest-cli did not install in PATH by @yannickperrenet in #1259 • Alter pods scheduling based on image location across the cluster by @fruttasecca in #1263 Full Changelog: v2022.09.1...v2022.09.2 orchest/orchest

Join directly on YouTube You can leave your questions in the chat (roadmap? features? open source collaborations?) 🙌

thanks a lot to everyone who joined! ✨ especially to our power users Jay and @Abid for sharing the stage with us. it was a great experience! 🙌🏼

The new UI is a banger.

Hey folks. Nice demo and congrats on the new release. I was wondering if you could consider few feature requests and ideas 1.Have some low code capabilities baked into the system. For instance a lot of the work that happens is just invoking a bunch of APIs , instead of me creating lets say a script that does this , can it be a drag and drop component in orchest which makes REST calls. Something like what postman does , but make it like a pipeline through orchest’s clean UI so that it is repeatable and comes with all the goodies like retry logic. 2. GPU support 3. Support for storing data and versioning it. Making datasets a first class citizen within orchest so that pipelines are fully reproducible. Not sure if all these ideas make sense 😅 But thought of sharing here.

Release - v2022.09.3 New release published by yannickperrenet What's Changed Improvements 👷 • Update file tree when pipeline is deleted by @mausworks in #1273 • More empty state actions by @mausworks in #1272 • fix: App crashed when creating an environment from PipelineEditor by @iannbing in #1275 Full Changelog: v2022.09.2...v2022.09.3 orchest/orchest

Release - v2022.09.4 New release published by yannickperrenet Full Changelog: v2022.09.3...v2022.09.4 orchest/orchest

Release - v2022.09.5 New release published by yannickperrenet What's Changed Improvements 👷 • Fix k3s support by @fruttasecca in #1284 Full Changelog: v2022.09.4...v2022.09.5 orchest/orchest

@Claire Pan has joined the channel

@Sangyun Han has joined the channel

@jake has joined the channel

Release - v2022.09.6 New release published by yannickperrenet What's Changed Improvements 👷 • fix: Hide job status alert when editing a recurring Job. by @iannbing in #1291 • Fix: You get navigated back into JupyterLab on load by @mausworks in #1279 • Don't autostart sessions for job runs by @mausworks in #1286 • fix: Unable to create a file in /data folder by @iannbing in #1293 • Update images in docs to use new UI by @yannickperrenet in #1298 • fix: PipelineLogs should show all steps. by @iannbing in #1296 • Clear step logs on interactive run request by @fruttasecca in #1294 • Expanded canvas: the simple solution. by @mausworks in #1300 • Fix - k8s for docker for desktop support by @fruttasecca in #1290 • Display the "no steps" empty state when no steps have been created but there are scripts available by @mausworks in #1295 • Show dialog when session is stopping and you open JupyterLab by @mausworks in #1304 • Disable "run incoming" if there are no incoming by @mausworks in #1308 Full Changelog: v2022.09.5...v2022.09.6 orchest/orchest

Release - v2022.09.7 New release published by yannickperrenet Full Changelog: v2022.09.6...v2022.09.7 orchest/orchest

<!channel> We are excited to announce that we are launching our UI redesign, Orchest 2.0, on Product Hunt 🎉 If you would like to show your support for our small team, consider joining the conversation and sharing our page with your network! https://www.producthunt.com/posts/orchest-2-0

Release - v2022.09.8 New release published by yannickperrenet What's Changed Improvements 👷 • fix: Jobs view crashes on Safari by @iannbing in #1315 Full Changelog: v2022.09.7...v2022.09.8 orchest/orchest

@Jan Blans has joined the channel

@Sean Birchall has joined the channel

Hi all, I saw an ad for orchest.io about an hour ago and have been reading the docs since... prob need to keep reading but maybe I can get a good answer here. I run a rather large data pipeline in R scraping some government websites, ultimately this data ends up in an AWS Aurora database. How can I securely go about getting this data to there. Also regarding idle time of my orchest.io instances do I pay for that? I've done 3 things in the past 1) buy a large expensive on demand EC2 instance and start and stop the instance when scripts need to execute. This works always but is too expensive. 2) move code to AWS Lambda, this works for some of my scripts but others have runtimes longer than 15mins. 3) Cloud containers using Google Cloud Build + Google Cloud Runner + Google Scheduler, this is pretty good by overly complex at times. Also have run into issues with some scripts needing very different compute / memory. Thanks, Sean

@Jeff Huth has joined the channel

welcome @Jeff Huth! 🙌🏼