https://www.orchest.io/ logo
Docs
Join the conversationJoin Slack
Channels
announcements
be-shameless
hacktoberfest-22
introduce-yourself
random
tech-support
welcome
Powered by Linen
announcements
  • a

    Alice Miller

    09/29/2022, 6:32 AM
    @Alice Miller has joined the channel
  • e

    Eric Hansander

    09/29/2022, 7:38 AM
    @Eric Hansander has joined the channel
  • t

    Thierry

    09/29/2022, 10:28 AM
    @Thierry has joined the channel
  • g

    GitHub

    09/29/2022, 12:26 PM
    Release - v2022.09.9 New release published by yannickperrenet Full Changelog: v2022.09.8...v2022.09.9 orchest/orchest
  • m

    Marco Bianco

    09/30/2022, 5:14 AM
    @Marco Bianco has joined the channel
  • j

    Jerome Montino

    09/30/2022, 8:37 AM
    @Jerome Montino has joined the channel
  • j

    Jerome Montino

    09/30/2022, 8:44 AM
    Hi, everyone. Hope you're doing well. I just found Orchest via @Rick Lamers' post on LinkedIn. Currently working as a one-man DE team in my current company so I had some questions. Currently, our Django app uses a Postgres RDS instance hosted in AWS. Every day, I move the data to Redshift and S3 via Glue, very straightforward. I then use dbt Cloud to transform the data to fact tables and so on for the tables in Redshift, no issues here. However, the final part of my workflow is running some notebooks, the output of which I have to dump back into Redshift/S3 then run some dbt Cloud jobs again. This is where I hope Orchest can do two (2) things. 1. Integrate with dbt Cloud to remove the manual part of running these notebooks in between dbt Cloud runs. 2. Ideally be able to have Orchest speak to our Redshift instance that runs behind a VPC. Point (1), I'm exploring thanks to some docs Rick shared in LinkedIn. My problem is Point (2). I believe I need to add an inbound rule for Orchest to be allowed to communicate with Redshift. Thing is, I don't think I've seen Orchest's IP address in the docs. Anyone with any thoughts on Point (2)?
    r
    • 2
    • 3
  • g

    GitHub

    09/30/2022, 1:42 PM
    Release - v2022.09.10 New release published by yannickperrenet Full Changelog: v2022.09.9...v2022.09.10 orchest/orchest
  • n

    Nathan Sweet

    09/30/2022, 3:51 PM
    @Nathan Sweet has joined the channel
  • u

    uki

    09/30/2022, 5:09 PM
    @uki has joined the channel
  • a

    AJ Elliott

    09/30/2022, 7:15 PM
    @AJ Elliott has joined the channel
  • z

    zross

    10/01/2022, 8:46 AM
    @zross has joined the channel
  • g

    GitHub

    10/01/2022, 10:29 AM
    Release - v2022.09.11 New release published by yannickperrenet What's Changed Improvements 👷 • ORC-908: Background color for chips in run table by @mausworks in #1321 Full Changelog: v2022.09.10...v2022.09.11 orchest/orchest
  • s

    Sriram Sivakumar

    10/01/2022, 10:57 AM
    @Sriram Sivakumar has joined the channel
  • r

    Ruben Bosch

    10/01/2022, 2:30 PM
    @Ruben Bosch has joined the channel
  • s

    Sean Birchall

    10/02/2022, 1:27 AM
    Has anyone had any luck installing the package
    RPostgreSQL
    in their R environment? Keep getting the same error message in the screenshot, even if I install Postgres first.
    sudo apt-get install libpq-dev
    sudo sh -c 'echo "deb <http://apt.postgresql.org/pub/repos/apt> $(lsb_release -cs)-pgdg main" > /etc/apt/sources.list.d/pgdg.list'
    wget --quiet -O - <https://www.postgresql.org/media/keys/ACCC4CF8.asc> | sudo apt-key add -
    sudo apt-get update
    sudo apt-get -y install postgresql
    Rscript -e 'install.packages("RPostgreSQL", dependencies=TRUE, repos="<http://cran.rstudio.com/>")'
    👀 1
    j
    • 2
    • 3
  • v

    viresh dhawan

    10/02/2022, 5:48 AM
    @viresh dhawan has joined the channel
  • v

    viresh dhawan

    10/02/2022, 5:58 AM
    Is anyone using orchest for a realtime messaging kind of a system? How is the parallelization achieved here?
    r
    • 2
    • 5
  • s

    Serhii

    10/02/2022, 3:21 PM
    Seems auto-migration didnt work and no clue what to do next in orchest cloud
    j
    • 2
    • 15
  • l

    Luca Scimone

    10/03/2022, 8:43 AM
    @Luca Scimone has joined the channel
  • l

    Linh-quan HA

    10/03/2022, 8:54 AM
    @Linh-quan HA has joined the channel
  • g

    GitHub

    10/03/2022, 3:24 PM
    Release - v2022.10.0 New release published by yannickperrenet What's Changed Improvements 👷 • Sticky header shadows and unify layout components by @mausworks in #1320 Full Changelog: v2022.09.11...v2022.10.0 orchest/orchest
    😮rchest: 1
  • l

    Lex Avstreikh

    10/03/2022, 3:57 PM
    @Lex Avstreikh has joined the channel
  • j

    juanlu

    10/03/2022, 4:34 PM
    hi everyone! it is 🎃 Hacktoberfest ✨ season, which means that if you contribute 4 valid pull requests before the end of the month you can have a tree planted in your name 🌳 or the Hacktoberfest 2022 t-shirt! 👕 Orchest is participating, so this is how you can contribute to the project: 1️⃣ Send a bug fix or new code feature. We have labeled the easier issues with "hacktoberfest" so you know where to start https://github.com/orchest/orchest/issues?q=is%3Aopen+is%3Aissue+label%3Ahacktoberfest but all meaningful contributions are welcome! Just drop as a message before starting the work to make sure we're aligned. In particular, why not adding a dark mode to Orchest? :ninja:🏼 https://github.com/orchest/orchest/issues/1331 2️⃣ Improve our documentation. Yes! this year Hacktoberfest allows low-code and no-code contributions. Just make sure that they're in the form of a pull request (and that they're not just minor typo edits!) 3️⃣ Give a talk or write a blog post about Orchest. Again, to make sure you meet the eligibility requirements, ping us in advance and we'll be happy to have a chat over it. Happy hacking! https://github.com/orchest/orchest/
  • m

    Marc H. Guirand

    10/05/2022, 5:35 AM
    @Marc H. Guirand has joined the channel
  • a

    Alexsander Pereira

    10/05/2022, 3:01 PM
    I updated to the latest version using EKS and orchest is showing this error in the controller:
    Failed to create pod sandbox: rpc error: code = Unknown desc = [failed to set up sandbox container "dbc00419165f73b0ba32733416e822c3c5c42a30787782f78475670ac50171fe" network for pod "orchest-controller-85df7b958b-9kn4c": networkPlugin cni failed to set up pod "orchest-controller-85df7b958b-9kn4c_orchest" network: add cmd: Error received from AddNetwork gRPC call: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:50051: connect: connection refused", failed to clean up sandbox container "dbc00419165f73b0ba32733416e822c3c5c42a30787782f78475670ac50171fe" network for pod "orchest-controller-85df7b958b-9kn4c": networkPlugin cni failed to teardown pod "orchest-controller-85df7b958b-9kn4c_orchest" network: del cmd: error received from DelNetwork gRPC call: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:50051: connect: connection refused"]
    Can someone help me? It's a production cluster.
    👀 2
    y
    n
    j
    • 4
    • 26
  • a

    Alexsander Pereira

    10/05/2022, 5:47 PM
    What would this error be?
    [W 2022-10-05 17:45:33.160 ServerApp] HTTP 500: Internal Server Error (Error attempting to connect to Gateway server url '<http://jupyter-eg-e4fd61e1-cfee-426a0bee97bf-8b41-4d2e:8888/jupyter-server-e4fd61e1-cfee-426a0bee97bf-8b41-4d2e>'.  Ensure gateway url is valid and the Gateway instance is running.)
    r
    y
    n
    • 4
    • 45
  • g

    GitHub

    10/05/2022, 6:14 PM
    Release - v2022.10.1 New release published by yannickperrenet What's Changed Improvements 👷 • Fix: add missing "back to settings" buttons by @iannbing in #1332 • Fix: incorrect warning after saving a recurring Job. by @iannbing in #1327 • Improve step selector performance by @mausworks in #1322 • Fix race condition between job scheduler and job cancellation by @fruttasecca in #1333 Full Changelog: v2022.10.0...v2022.10.1 orchest/orchest
  • a

    Allan Sene

    10/06/2022, 12:09 AM
    Hi, Guys! I was wandering: does make sense to use Spark inside Orchest? I mean, not just connect a Spark Session and submit jobs to other cluster, but to have an infrastructure of containers inside the same k8s and highly coupled with Orchest administration
    y
    • 2
    • 3
  • g

    GitHub

    10/07/2022, 11:32 AM
    Release - v2022.10.2 New release published by yannickperrenet What's Changed Improvements 👷 • Move log-streamer to its own container in webserver pod by @fruttasecca in #1337 • Fix
    node-agent
    image pushing and pulling for k8s for docker for desktop by @fruttasecca in #1328 • Use
    -exec ... +
    notation for
    find
    to copy build context by @yannickperrenet in #1335 • Don't concurrently push or pull images by @fruttasecca in #1341 • Right align ellipsis menu in projects table by @mausworks in #1344 • Change copy to "import complete" instead of "upload complete" by @mausworks in #1345 • Fix: Environment build logs sometimes are failed to render. by @iannbing in #1342 • Tweak CPU resource requests by @yannickperrenet in #1346 • Support scrolling horizontally in the pipeline editor when holding Shift by @mausworks in #1334 Full Changelog: v2022.10.1...v2022.10.2 orchest/orchest
Powered by Linen
Title
g

GitHub

10/07/2022, 11:32 AM
Release - v2022.10.2 New release published by yannickperrenet What's Changed Improvements 👷 • Move log-streamer to its own container in webserver pod by @fruttasecca in #1337 • Fix
node-agent
image pushing and pulling for k8s for docker for desktop by @fruttasecca in #1328 • Use
-exec ... +
notation for
find
to copy build context by @yannickperrenet in #1335 • Don't concurrently push or pull images by @fruttasecca in #1341 • Right align ellipsis menu in projects table by @mausworks in #1344 • Change copy to "import complete" instead of "upload complete" by @mausworks in #1345 • Fix: Environment build logs sometimes are failed to render. by @iannbing in #1342 • Tweak CPU resource requests by @yannickperrenet in #1346 • Support scrolling horizontally in the pipeline editor when holding Shift by @mausworks in #1334 Full Changelog: v2022.10.1...v2022.10.2 orchest/orchest
View count: 1