💡 We just released a cool new feature! Release v2021.12.0 introduces the beloved Command Palette to Orchest. Search for pages, projects, pipelines, and jobs at light speed using Ctrl/Command + K.

Hi ,

I have used orchest, i have created one user, but i deleted it by mistake. how to login the same again.

Hi guys, could you point me out how to make it work with JS kernel or is it possible at all? (where do I install it)

ehh, cloud is down 😞

Orchest plays well with other tools 🙌, to show how you can combine them I created a sample project that takes: • Meilisearch document store • PyWebIO Python-only web application development framework • Orchest To create a pipeline that collects comment data from the web (Hacker News) and makes it searchable in a Python-only web GUI (PyWebIO). Video: https://www.tella.tv/video/ckxgcilet007w09ia0kei2z0z/view Code: https://github.com/ricklamers/orchest-meilisearch-pywebio-hn

I'm running locally and I'm trying to install pytorch, but during the installation in the enironments the container is killed at the downloading stage. Did anyone get pytorch installed into an environment before?

Orchest making moves, I like it

How do i use the same environment i'm working on an orchest project within the vscode service?

For those who want to add a private key file to use

git

(terminal or GUI in JupyterLab) inside Orchest, we've added instructions here: https://docs.orchest.io/en/latest/fundamentals/projects.html#git-inside-orchest

I was tinkering a bit with Orchest Cloud and it's got me wondering a few things: We're still setting things up and choosing our tools where I'm working, but some of them are kinda mature now: Prefect (on-prem), DBT (on-prem), GCS, GKE and BigQuery. This is pretty much our main stack. Our pipelines are very simple atm, they're essentially classic ETLs from SQL Server instances, APIs and BQ to BQ itself. The main challenge we face is that we'd need teams/projects/environments separation in order to achieve better cost splitting. That's why we're using Prefect, btw, for its Hybrid Execution Model (https://www.prefect.io/why-prefect/hybrid-model/) (we host our Prefect Server instance for cost optimization) Your UI would be awesome for our junior coders to develop, that's what caught my attention. Would you have any ideas on how to handle execution environments separation (like Prefect's hybrid model) on Orchest? Something like the Prefect agents, maybe

We talked about Orchest on Open-Source Spotlight hosted by Alexey from DataTalksClub. Check it out here 👇 https://m.youtube.com/watch?v=rGfghS9AnS0

Release - v2022.02.3 New release published by yannickperrenet What's Changed Improvements 👷 • Do not run fix userdir permissions after restarting with

--cloud

by @yannickperrenet in #694 • Fix failing end-to-end tests for Orchest update checks by @iannbing in #692 • Fix page loading when visiting file preview, pipeline settings, logs with an interactive run by @iannbing in #695 Full Changelog: v2022.02.2...v2022.02.3 orchest/orchest

Release - v2022.02.4 New release published by yannickperrenet What's Changed Improvements 👷 • Show service list correctly in PipelineView by @iannbing in #699 Full Changelog: v2022.02.3...v2022.02.4 orchest/orchest

Release - v2022.02.5 New release published by yannickperrenet What's Changed Improvements 👷 • Fix command palette broken when entities with same name by @iannbing in #706 Full Changelog: v2022.02.4...v2022.02.5 orchest/orchest

Release - v2022.02.6 New release published by yannickperrenet What's Changed Improvements 👷 • Invoke scripts with the

sh

extension using

bash

by @yannickperrenet in #711 • Fix service name collision or breakage by @iannbing in #710 Full Changelog: v2022.02.5...v2022.02.6 orchest/orchest

Release - v2022.02.7 New release published by yannickperrenet What's Changed Improvements 👷 • Always return identical error message on invalid login credentials by @yannickperrenet in #704 • Make

/jobs

DELETE

endpoints resolve quicker by @yannickperrenet in #716 • Fix hanging data table when a delete dialog is cancelled by @iannbing in #715 • Improve error handling for deleting selected rows by @iannbing in #709 Full Changelog: v2022.02.6...v2022.02.7 orchest/orchest

Release - v2022.02.8 New release published by yannickperrenet What's Changed Improvements 👷 • Fix services deletion by @yannickperrenet in #718 Full Changelog: v2022.02.7...v2022.02.8 orchest/orchest

Friendly reminder: there are a number of example projects you can use as a starting point. 👉 https://github.com/orchest/orchest-examples

Release - v2022.02.9 New release published by yannickperrenet What's Changed Improvements 👷 • Add 100 rows per page option to DataTable by @iannbing in #723 • New environment edit page by @iannbing in #722 • Use

-exec ... +

notation on

find

that fixes permissions by @yannickperrenet in #731 • Fix saving issues with JupyterLab by @yannickperrenet in #733 Full Changelog: v2022.02.8...v2022.02.9 orchest/orchest

In case you hadn't checked out the new environments page, check it out below 👇 Great work by @Huang-Ming! 💡 🔥

Hi guys, Couple questions here: Is it possible to externalize the execution of the code from the instance running Orchard ? What if you have multiple hundreds/thousands of tasks that you want to execute in parallel ? Can we connect that with an external kurbernetes cluster or lambda funtions for example? Basically how to have unlimited resources ? Also what’s the scheduler running under orchest ? Celery ? is it able to handle huge amount of tasks ? Thanks

<!channel> Check out Data Overload Vol. 7, the latest edition of our monthly newsletter! ⚡ 📣 Preparing for Data Council Austin 2022! ✨ New environment edit page ⤵️ New "import project" dialog 🔔 New version upgrade prompt ...and lots more! Read the full post online here. Do you want to receive the next edition directly in your inbox? Subscribe here!

Hi! Do you understand what am I doing wrong here? I’m using Apple Silicon.

Release - v2022.03.0 New release published by yannickperrenet What's Changed Improvements 👷 • Upgrade JupyterLab to

v3.3.0

by @yannickperrenet in #752 Full Changelog: v2022.02.9...v2022.03.0 orchest/orchest

this new release includes JupyterLab 3.3.0! it contains a bunch of cool additions, like a UI for the settings, rich rendering for the variable inspector, progress indicators, and a new functionality to open notebooks directly from URLs. check out the announcement: https://discourse.jupyter.org/t/jupyterlab-3-3-0-is-released/13231?u=astrojuanlu

📣 Check out our latest blog post: "Demystifying Apache Arrow" https://www.orchest.io/blog/the-great-python-dataframe-showdown-part-1-demystifying-apache-arrow Hope you like it!

Release - v2022.03.1 New release published by yannickperrenet What's Changed Exciting new features 🎉 • Enable debugger in JupyterLab by @yannickperrenet in #786 Improvements 👷 • Fix opening files in JupyterLab that contain uppercase characters in their name by @yannickperrenet in #767 • Remove jquery from pipeline editor and add minor UX improvements by @iannbing in #748 • Fix highlighting navigation item "Jobs" when viewing the pipeline of a job run by @iannbing in #782 • Fix not redirecting to Pipeline List after importing if the import URL contains trailing slash by @iannbing in #778 • Fix losing progress on Pipeline Settings when browser tab regaining focus by @iannbing in #781 • Show Project Selector in deeper levels of the UI by @iannbing in #783 • Decrease size of Python base image and the Enterprise Gateway image by @yannickperrenet in #789 • Raise PyArrow version cap by @astrojuanlu in #794 New Contributors • @astrojuanlu made their first contribution in #761 Full Changelog: v2022.03.0...v2022.03.1 orchest/orchest

this new release includes new base images, based on Python 3.9 and with mamba preinstalled! try them out, and let us know if you have any feedback 💪🏼