https://www.orchest.io/ logo
c

Camilo Valenzuela

09/07/2021, 4:00 PM
Hi! I'm trying to run the quickstart example, and i'm getting a
PermissionError
when the
get-data.py
step is downloading the data.
y

Yannick

09/07/2021, 4:18 PM
Hi @Camilo Valenzuela, this of course should not happen ;) The
get-data.py
step downloads some data and stores it in the mounted
/data
directory, which is actually the
userdir/data
directory from your host. Could you run
ls -al userdir
and post the output here?
c

Camilo Valenzuela

09/07/2021, 4:38 PM
I think that's the issue, the
userdir
folder is owned by my current user
Copy code
total 32
drwxr-sr-x  6 cvalenzu cvalenzu 4096 Sep  7 13:45 .
drwxr-xr-x 11 cvalenzu cvalenzu 4096 Sep  7 13:45 ..
-rw-r--r--  1 cvalenzu cvalenzu   23 Sep  7 13:45 .gitignore
drwxr-sr-x  6 cvalenzu cvalenzu 4096 Sep  7 15:04 .orchest
-rw-r--r--  1 cvalenzu cvalenzu  101 Sep  7 13:45 README.md
drwxr-sr-x  2 cvalenzu cvalenzu 4096 Sep  7 15:52 data
drwxr-sr-x  2 cvalenzu cvalenzu 4096 Sep  7 13:45 jobs
drwxr-sr-x  3 cvalenzu cvalenzu 4096 Sep  7 15:08 projects
r

Rick Lamers

09/07/2021, 4:47 PM
@Camilo Valenzuela what is your OS setup? Where are you running Orchest?
c

Camilo Valenzuela

09/07/2021, 5:01 PM
Im running it on a GCP VM with the Container Optimized OS
r

Rick Lamers

09/07/2021, 5:04 PM
I see, thanks for sharing. We'll try to reproduce in GCP and get back to you with some steps on how get the permissions fixed. 👍
y

Yannick

09/07/2021, 5:48 PM
I have not tested anything on GCP yet, but I found the following (link to the docs) on Container Optimized OS:
Root partition, which is mounted as read-only.
Stateful partitions, which are writable and stateful.
Stateless partitions, which are writable but the contents do not persist across reboots.
When using Container-Optimized OS, be aware of the partitioning if you run your own services that have certain expectations about the file system layout outside of containers.
So it could very well be that the root partition is mounted into the container, and thus nothing can be written to the mounted
/data
directory as it is read-only.
c

Camilo Valenzuela

09/07/2021, 6:00 PM
I'll try on another OS, I think that will be smoother. Thanks for the help!
r

Rick Lamers

09/07/2021, 7:11 PM
I can confirm what @Yannick is saying. The Container-Optimized OS doesn't allow you to have a read-write-execute partition unless you mount an extra disk under
/mnt/disks
for this specifically. See https://cloud.google.com/container-optimized-os/docs/concepts/disks-and-filesystem#mounting_and_formatting_disks for more details. The easiest would be to use the Ubuntu Server or Debian system images and install the Docker CLI on them.
y

Yannick

09/08/2021, 6:27 PM
@Camilo Valenzuela Any luck so far?
c

Camilo Valenzuela

09/08/2021, 6:29 PM
Sorry, haven't had time to test it out, but i'll reply when I try it
👍 1
y

Yannick

09/08/2021, 6:37 PM
No worries. Just wanted to be sure you got it working. We are here if you have any questions or run into any other issues 🕵️‍♂️