Hi everyone I ve increased the `MAX JOB RUNS PARALLELISM =3`

Question

Hi everyone I ve increased the `MAX JOB RUNS PARALLELISM =3` but i cannot run parallel pipelines using web tool yet There s another configuration i should do

Yannick · Answer

Hi there If with parallel pipelines you meaning running multiple pipelines in parallel in the pipeline editor then this is indeed not possible right now We are looking to enable this any time soon <https github com orchest orchest issues 501|applicable GitHub issue> Do note that increasing `MAX JOB RUNS PARALLELISM` requires a restart of Orchest ` orchest restart`

Rick Lamers · Answer

Just to clarify that setting controls how many pipelines run in parallel in jobs If you have three jobs they can each run their pipeline simultaneously

Rick Lamers · Answer

If a single job had multiple pipeline runs through parameterization they will also run in parallel

Rick Lamers · Answer

If you d like an example I can record a video for you raised hands skin tone 2

Altieris Peixoto · Answer

thanks guys my issue was about running two separate project pipelines Actually if i try to run from one project the another one stays with pending status

Altieris Peixoto · Answer

this is from the first project

Altieris Peixoto · Answer

image png

Altieris Peixoto · Answer

this is from second one

Rick Lamers · Answer

If you run both pipelines as a job e g scheduled to run once and you have the configuration of MAX JOB RUNS PARALLELISM on 2 or higher under global Orchest Settings they will execute in parallel We re working on MAX INTERACTIVE RUN PARALLELISM which would solve the situation you re describing

Rick Lamers · Answer

You can track progress on the interactive run parallelism in this GH issue <https github com orchest orchest issues 501|https github com orchest orchest issues 501>

Yannick · Answer

Hi < Altieris Peixoto> I ve picked this issue up today so it will be included in the next release raised hands hopefully tomorrow we will release `v2021 11 0`

Altieris Peixoto · Answer

That s great < Yannick>

Yannick · Answer

I ended up making some larger changes around how we handle changes for Orchest the is pretty much finished Just requires a final review trumpet