https://www.orchest.io/ logo
Docs
Join the conversationJoin Slack
Channels
announcements
be-shameless
hacktoberfest-22
introduce-yourself
random
tech-support
welcome
Powered by Linen
announcements
  • g

    GitHub

    03/17/2022, 1:03 PM
    Release - v2022.03.3 New release published by yannickperrenet What's Changed Improvements 👷 • Fix onboarding redirect to quickstart issue by @iannbing in #809 Full Changelog: v2022.03.2...v2022.03.3 orchest/orchest
    🐿 2
  • g

    GitHub

    03/18/2022, 11:38 AM
    Release - v2022.03.4 New release published by yannickperrenet What's Changed Improvements 👷 • Fix the issue when saving services in pipeline editor by @iannbing in #815 Full Changelog: v2022.03.3...v2022.03.4 orchest/orchest
  • g

    GitHub

    03/18/2022, 5:05 PM
    Release - v2022.03.5 New release published by yannickperrenet What's Changed Improvements 👷 • Fix showing onboarding dialog in help view by @iannbing in #819 Full Changelog: v2022.03.4...v2022.03.5 orchest/orchest
  • g

    GitHub

    03/21/2022, 7:08 AM
    Release - v2022.03.6 New release published by yannickperrenet Full Changelog: v2022.03.5...v2022.03.6 orchest/orchest
  • g

    GitHub

    03/22/2022, 10:51 AM
    Release - v2022.03.7 New release published by yannickperrenet What's Changed Breaking changes 🚨 • k8s PR by @ricklamers in #623 Exciting new features 🎉 • [Feature] File Manager by @iannbing in #795 New Contributors • @nhaghighat made their first contribution in #654 Full Changelog: v2022.03.6...v2022.03.7 orchest/orchest
    🎉 2
    🚨 1
  • j

    juanlu

    03/23/2022, 10:36 AM
    😮rchest: we will be sending a longer announcement soon, but in the meantime, we are thrilled to tell you that Orchest v2022.03.7 is backed by Kubernetes :kubernetes: in the words of @Rick Lamers, "The move to Kubernetes was long in the making, it truly unleashes the architecture of Orchest to operate at cluster scale. With containers as first class primitives throughout the application we're seeing linear speedups across a number of features. This change makes it possible to work with a large team on a single beefy cluster. That opens up many interesting opportunities for collaboration." we are now working to take these changes to Orchest Cloud, but in the meantime you can try out the new version yourselves, using local kubernetes solutions like minikube. check out our installation instructions https://docs.orchest.io/en/latest/getting_started/installation.html and if you have any question, let us know!
    🚀 2
    😮rchest: 3
    :kubernetes: 3
    k
    r
    • 3
    • 11
  • g

    GitHub

    03/25/2022, 6:52 AM
    Release - v2022.03.8 New release published by yannickperrenet What's Changed Improvements 👷 • add pvc to docker-registry by @nhaghighat in #828 Full Changelog: v2022.03.7...v2022.03.8 orchest/orchest
  • s

    Serhii

    03/28/2022, 11:29 AM
    Long time I havent posted here since successfully passed paid pipeline to client. But i have few questions more due to my new project: 1. Is there any way to notify of failed run to webhook? 2. There is no collaboration at this point - and someone can accidentally overwrite others file, right?
    🤓 1
  • j

    juanlu

    03/28/2022, 11:33 AM
    hi @Serhii! about (1), we were discussing exactly that last week, feel free to weigh in https://github.com/orchest/orchest/issues/120 at the moment, the best workaround would be to add custom logic to your notebook/script that pings a given service of your choice. but we plan to improve this very soon
    👍 2
    s
    • 2
    • 2
  • j

    juanlu

    03/28/2022, 11:35 AM
    about (2), we did experiment enabling the new Real Time Collaboration feature of JupyterLab, but it turns out it's not production-ready yet so we disabled it. however, the good news is that https://github.com/jupyterlab/jupyterlab/pull/11599 is about to be merged very soon, which means that the next release of JupyterLab will probably have a robust RTC feature we can try out
    👍 3
  • j

    José Tomás Pérez

    03/29/2022, 3:54 PM
    hi everybody! we've been using orchest a few months, but we updated and now we are struggling with the minikubes disk space (20 gb) , how can we configure a bigger disk, the server has 200gb of disk
    j
    r
    +3
    • 6
    • 50
  • g

    GitHub

    03/30/2022, 3:48 PM
    Release - v2022.03.9 New release published by yannickperrenet What's Changed Improvements 👷 • Inject user defined environment variables on kernel start by @yannickperrenet in #839 • Allow specifying user dir, builder cache and nfs claim size on install by @fruttasecca in #840 Full Changelog: v2022.03.8...v2022.03.9 orchest/orchest
  • g

    GitHub

    03/30/2022, 4:06 PM
    Release - v2022.03.10 New release published by yannickperrenet Full Changelog: v2022.03.9...v2022.03.10 orchest/orchest
  • d

    Diego Vasquez

    04/04/2022, 9:25 PM
    Hi everyone. We've been using Orchest in the last couple of months and now we have some problems with the kernel connection of Jupyter Lab. We did a clean install on our server last week (we have now Orchest in version v2022.03.8). Refferring to the problem with the kernel connection, when we run the script cells, in Jupyter Lab appears "Python 3 | Connecting" and after a few minutes, "Python 3 | Disconnected". What could be the problem here? Because when we run our pipelines' jobs or even when we run scripts in .py files we don't have problems
    j
    j
    y
    • 4
    • 47
  • j

    juanlu

    04/05/2022, 10:36 AM
    <!channel> Check out Data Overload Vol. 8, the latest edition of our monthly newsletter! ⚡ :kubernetes: Orchest on Kubernetes now a reality! 📂 New file manager 🐛 JupyterLab debugger 🤏 Panning and pinching on the pipeline editor ...and lots more! Read the full post online here. Do you want to receive the next edition directly in your inbox? Subscribe here!
    😮rchest: 3
  • a

    Abid

    04/05/2022, 10:39 AM
    😅
  • c

    C Shorten

    04/05/2022, 3:05 PM
    Hey Orchest community! Here is our Weaviate Podcast with Rick Lamers presenting many ideas around Orchest! I am having so much fun learning about this exciting tool for Data Science, and I really hope you all enjoy the podcast with Rick!

    https://www.youtube.com/watch?v=QlhTJ2n_Kog▾

    😮rchest: 1
    ❤️ 2
    j
    • 2
    • 1
  • g

    GitHub

    04/06/2022, 10:07 AM
    Release - v2022.04.0 New release published by yannickperrenet What's Changed Improvements 👷 • Enable panning and pinching on Pipeline Editor by @iannbing in #842 • Fix the error when moving a folder while its sub folders or files are also selected by @iannbing in #847 • Fix: FilePicker should have access to /data folder by @iannbing in #836 • Enable creating or uploading files or folders in sub folders within
    Project files
    and
    /data
    by @iannbing in #833 • Add development mode (internal use) by @fruttasecca in #832 • Set
    DEBIAN_FRONTEND=noninteractive
    for
    sudo
    in environments by @yannickperrenet in #846 • Redirect to Pipelines if user deleted the orchest file of the current pipeline. by @iannbing in #861 Full Changelog: v2022.03.10...v2022.04.0 orchest/orchest
  • r

    Rick Malembeti

    04/06/2022, 12:44 PM
    👋 Bonjour à tous !
    👋 4
    🖖 1
    👋🏼 1
    j
    • 2
    • 1
  • c

    C Shorten

    04/07/2022, 1:40 PM
    Hey everyone! We've published @Rick Lamers's demo on using Weaviate + Orchest + Streamlit to search through a dutch tech blog. Thank you so much for this Rick, this is such a cool hands-on demo and this application is super exciting!

    https://www.youtube.com/watch?v=ZzojafqsVA0▾

    🙌🏼 1
    🙌 1
    r
    • 2
    • 1
  • e

    Edu P

    04/10/2022, 3:34 AM
    Hi, quick question. Does someone know if it is posible to capture the exit of a pipeline? For example, a pipeline step that fails or exit with some response
    y
    r
    • 3
    • 7
  • j

    juanlu

    04/22/2022, 7:52 AM
    it's Friday! what did you use Orchest for this week? I'm all eyes 👀😮rchest:
    • 1
    • 1
  • g

    GitHub

    04/22/2022, 8:52 AM
    Release - v2022.04.1 New release published by yannickperrenet What's Changed Improvements 👷 • Speedup environment image and jupyter builds by using
    buildah
    for image builds by @fruttasecca in #837 • Merge the functionality of the
    Pipelines
    view into PipelineEditor by @iannbing in #869 • Automatically delete unused custom Jupyter server images from nodes and registry by @fruttasecca in #873 • Automatically delete unused Orchest images from nodes by @fruttasecca in #875 • Automatically delete unused environment images from nodes and registry by @fruttasecca in #872 • Fix session not auto-started when changing pipeline in PipelineEditor by @iannbing in #882 Full Changelog: v2022.04.0...v2022.04.1 orchest/orchest
  • g

    GitHub

    04/22/2022, 9:55 AM
    Release - v2022.04.2 New release published by yannickperrenet What's Changed Improvements 👷 • Fix broken
    update-sidecar
    dependencies by @fruttasecca in #886 Full Changelog: v2022.04.1...v2022.04.2 orchest/orchest
  • g

    GitHub

    04/22/2022, 2:33 PM
    Release - v2022.04.3 New release published by yannickperrenet Full Changelog: v2022.04.2...v2022.04.3 orchest/orchest
  • g

    GitHub

    04/26/2022, 8:10 AM
    Release - v2022.04.4 New release published by yannickperrenet orchest/orchest
  • g

    GitHub

    04/26/2022, 1:00 PM
    Release - v2022.04.5 New release published by yannickperrenet What's Changed Improvements 👷 • Fix Configure Jupyter Lab view not loading issue by @iannbing in #898 Full Changelog: v2022.04.4...v2022.04.5 orchest/orchest
  • s

    Sam

    04/27/2022, 1:02 PM
    👋 Hi everyone!
    🙌 3
    j
    r
    • 3
    • 2
  • j

    juanlu

    04/29/2022, 1:20 PM
    hi folks! we have been discussing internally how to offer a better experience for Orchest users writing their own ETL/EL(T) data pipelines. I posted some thoughts here, feel free to weigh in or tell us about your experiences so far doing this sort of thing with Orchest. feedback greatly appreciated!
    👀 1
  • j

    juanlu

    05/02/2022, 3:31 PM
    📣 Check out our latest blog post: "Out-of-core processing with Vaex" https://www.orchest.io/blog/the-great-python-dataframe-showdown-part-2-out-of-core-processing-with-vaex If you have ever heard of Vaex but never actually tried it, this post clarifies how it operates, gives some tips and tricks, and compares it with pandas 🌌 let me know what you think about it!
    😮rchest: 2
    🤓 1
    🌌 1
Powered by Linen
Title
j

juanlu

05/02/2022, 3:31 PM
📣 Check out our latest blog post: "Out-of-core processing with Vaex" https://www.orchest.io/blog/the-great-python-dataframe-showdown-part-2-out-of-core-processing-with-vaex If you have ever heard of Vaex but never actually tried it, this post clarifies how it operates, gives some tips and tricks, and compares it with pandas 🌌 let me know what you think about it!
😮rchest: 2
🤓 1
🌌 1
View count: 1