https://www.orchest.io/ logo
t

Tarun Singh

08/09/2021, 1:38 PM
Hey guys, Im trying to run orchest on AWS i did docker installation and everything seems to be fine but can't start orchest for some reason
j

Jacopo

08/09/2021, 1:40 PM
Hey there Tarun! Thanks for getting in touch to give us some feedback, I'll take a look, give me a few minutes.
👍 2
Before we dive deeper into this, could you run a quick
docker image ls
? I once had this happen when the disk got full and not all required images were downloaded
And about the "Could not find the configuration file", any chance that Orchest was installed as another user, maybe ubuntu? I see you are running as root, the config file Orchest is looking for should be in
~/.config/orchest/config.json
by default
t

Tarun Singh

08/09/2021, 1:49 PM
here's the result for docker image ls, I cloned it for root as well
y

Yannick

08/09/2021, 1:50 PM
Copy code
# Installed images
"orchest/session-sidecar:latest",
"orchest/update-server:latest",
"orchest/orchest-api:latest",
"orchest/celery-worker:latest",
"orchest/file-manager:latest",
"orchest/nginx-proxy:latest",

# Additional images that do not seem to be installed
"orchest/jupyter-enterprise-gateway:latest",
"orchest/jupyter-server:latest",
"orchest/memory-server:latest",
"orchest/orchest-webserver:latest",
"orchest/auth-server:latest",
"rabbitmq:3",
"postgres:13.1",
I once had this happen when the disk got full and not all required images were downloaded
This could very well be the case here.
"Could not find the configuration file"
This could be the case because the
orchest-webserver
is not installed @Jacopo Didn't want to interrupt here, just wanted to quickly drop my thoughts :)
👍 1
j

Jacopo

08/09/2021, 1:51 PM
Yep it looks like not all images have been installed, @Tarun Singh could you check if your disk is full?
t

Tarun Singh

08/09/2021, 1:54 PM
no i dont think so, so far have used only 49%
j

Jacopo

08/09/2021, 1:55 PM
The disk is not full but I think it could very well be the case that the disk size is not enough to install Orchest. It requires about 15GBs (@Yannick do correct me if you have a better estimate)
y

Yannick

08/09/2021, 1:58 PM
Yes, it is probably related to disk size. We depend on the Jupyter Docker stacks, which includes images with a size of ~4GB. Explaining why Orchest could not install successfully.
@Yannick do correct me if you have a better estimate
I would guess closer to 9GB given that
orchest install
only gets you the bare minimal set of images.
t

Tarun Singh

08/09/2021, 2:00 PM
ah ok ill increase the size of the disk and will keep you guys updated, thanks for the help 🙂
👍 1
j

Jacopo

08/09/2021, 2:02 PM
👍 thank you Tarun, feel free to get in touch if you need any help or have any feedback, we appreciate all of it 🙂
y

Yannick

08/09/2021, 2:04 PM
ah ok ill increase the size of the disk
If you want to be on the safer side I would suggest going for a disk size of 50GB given that as part of Orchest you can build custom environments (which are actually Docker containers) and that you probably want to some disk space left for files etc.
t

Tarun Singh

08/09/2021, 7:30 PM
@Yannick @Jacopo I increased my memory but got this
y

Yannick

08/10/2021, 7:38 AM
Just so that I understand what you are getting at. Do you mean the
Could not find the configuration file.
message? If this message only popped up the very first time you successfully managed to start Orchest, then you can ignore this message (I made a small change yesterday so this message no longer pops up, but the commit is not yet included in a new release) . To check whether the configuration file is actually created you can check whether the file
$HOME/.config/orchest/config.json
exists. Hope that helps. Is Orchest running correctly now?
t

Tarun Singh

08/10/2021, 8:39 AM
yes its working
what are the min requirements (RAM/CPU) for orchest
since im using AWS instance ill scale it accordingly
j

Jacopo

08/10/2021, 8:43 AM
Hi Tarun, we have been using
t2.large
instances with success on AWS. Smaller instances can still accommodate Orchest, it depends on what are you preferences in terms of spending vs performance.
Be aware that depending on the instance type and disk IOPS performance the very first pipeline run might be noticeably slower.
Generally speaking, my advice would be to not go below 2VCPUs and 8GBs of RAM.
t

Tarun Singh

08/10/2021, 8:47 AM
Thanks!
👍 2