https://www.orchest.io/ logo
Powered by
Title
a

Arnzok

10/25/2021, 8:34 AM
hi, i'm trying to use orchest on windows but i have multiple problems. Docker & wsl 2 are well working, it has to do with the "orchest" file to install & start : ā€¢ when launching orchest install, i had an error (wrong folder used) so i changed the orchest file with //var/run instead of /var/run (i'm on win10 pro 64 bits) ā€¢ after that the installation worked, but when i use orchest start i get the following error : "FileNotFoundError: [Errno 2] No such file or directory: '/orchest-host/orchest'" any idea on how to solve this please ?
j

Jacopo

10/25/2021, 8:51 AM
Hi @Arnzok, thanks for reporting the issue. Could you run 
ls -la
in the 
orchest
directory and report the result here?
a

Arnzok

10/25/2021, 8:51 AM
hi thanks for your help
Lambert@DESKTOP-1K50E6H MINGW64 /c/workspaces/orchest (master)
$ ls -la
total 293
drwxr-xr-x 1 Lambert 197121      0 oct.  25 09:34 ./
drwxr-xr-x 1 Lambert 197121      0 oct.  25 10:27 ../
-rw-r--r-- 1 Lambert 197121    236 oct.  25 09:28 .dockerignore
-rw-r--r-- 1 Lambert 197121    493 oct.  25 09:28 .flake8
drwxr-xr-x 1 Lambert 197121      0 oct.  25 09:33 .git/
-rw-r--r-- 1 Lambert 197121     14 oct.  25 09:28 .gitattributes
drwxr-xr-x 1 Lambert 197121      0 oct.  25 09:28 .github/
-rw-r--r-- 1 Lambert 197121   2486 oct.  25 09:28 .gitignore
-rw-r--r-- 1 Lambert 197121      7 oct.  25 09:28 .nvmrc
-rw-r--r-- 1 Lambert 197121   1032 oct.  25 09:28 .pre-commit-config.yaml
-rw-r--r-- 1 Lambert 197121     56 oct.  25 09:28 .prettierignore
-rw-r--r-- 1 Lambert 197121    268 oct.  25 09:28 .readthedocs.yaml
drwxr-xr-x 1 Lambert 197121      0 oct.  25 09:28 cypress/
drwxr-xr-x 1 Lambert 197121      0 oct.  25 09:28 docs/
drwxr-xr-x 1 Lambert 197121      0 oct.  25 09:28 lib/
-rw-r--r-- 1 Lambert 197121  35184 oct.  25 09:28 LICENSE
-rwxr-xr-x 1 Lambert 197121   2627 oct.  25 10:31 orchest*
drwxr-xr-x 1 Lambert 197121      0 oct.  25 09:28 orchest-sdk/
-rw-r--r-- 1 Lambert 197121    896 oct.  25 09:28 package.json
-rw-r--r-- 1 Lambert 197121 188372 oct.  25 09:28 pnpm-lock.yaml
-rw-r--r-- 1 Lambert 197121    152 oct.  25 09:28 pnpm-workspace.yaml
-rw-r--r-- 1 Lambert 197121    482 oct.  25 09:28 pyproject.toml
-rw-r--r-- 1 Lambert 197121   7029 oct.  25 09:28 README.md
drwxr-xr-x 1 Lambert 197121      0 oct.  25 09:28 scripts/
drwxr-xr-x 1 Lambert 197121      0 oct.  25 09:28 services/
-rw-r--r-- 1 Lambert 197121    424 oct.  25 09:28 tsconfig.json
drwxr-xr-x 1 Lambert 197121      0 oct.  25 09:28 userdir/
šŸ‘€ 1
for my previous bug, adding //var the solution comes from here : https://tomgregory.com/running-docker-in-docker-on-windows/#All_about_varrundockersock my error was "can't mkdir C:/Program Files/Git/var" (because i launched with git bash. I created manually the var folder then got the error for run folder and finally an error talking about docker.sock, hence the solution
šŸ‘€ 1
j

Jacopo

10/25/2021, 9:03 AM
I see, thank you. Could you tell me what version of Orchest you are using? (
orchest version
or 
orchest version --ext
) Moreover, are you launching Orchest with sudo? Just looking for nitpicks at the user or permissions level
a

Arnzok

10/25/2021, 9:11 AM
Orchest version: v2021.10.1
i launched git bash as administrator
and installation is successful according to the command (if i try to install again it says "Installation is already complete. Did you mean to run: orchest update"
j

Jacopo

10/25/2021, 9:15 AM
I see. I am inclined to think that launching as administrator might have something to do with it. Is it possible for you to avoid launching git bash as administrator?
If that does not work I would like to see the output of 
./orchest debug --compress --ext
. It will write a debug named 
debug-dump.tar.gz
that does a number of checks to helps us troubleshoot. It might very well be that said command will give you an error because of the issue you are facing, either case we will get some more information.
a

Arnzok

10/25/2021, 9:20 AM
yes but i get the same error
Generating debug data: configuration.
        Error during generation of debug data: configuration.
Generating debug data: containers version.
Generating debug data: containers logs.
Generating debug data: running containers.
Generating debug data: health check.
Generating debug data: database.
Generating debug data: celery.
Generating debug data: webserver.
cp: cannot create regular file '/orchest-host/debug-dump.tar.gz': No such file or directory
Complete! Wrote debug dump to: ./debug-dump.tar.gz
where is supposed to be the orchest-host folder ?
y

Yannick

10/25/2021, 9:23 AM
Could you try adding quotation marks to your change to the 
orchest
file, like this: 
-v "//var/run/docker.sock:/var/run/docker.sock"
where is supposed to be the orchest-host folder ?
The 
orchest-host
get's mounted inside the 
orchest
file when starting the CLI
j

Jacopo

10/25/2021, 9:23 AM
Orchest mounts the current 
orchest
directory as 
orchest-host
, the error is pretty much telling me that Orchest is failing to mount the directory
šŸ‘€ 1
a

Arnzok

10/25/2021, 9:29 AM
Generating debug data: configuration.
        Error during generation of debug data: configuration.
Generating debug data: containers version.
Generating debug data: containers logs.
Generating debug data: running containers.
Generating debug data: health check.
Generating debug data: database.
Generating debug data: celery.
Generating debug data: webserver.
cp: cannot create regular file '/orchest-host/debug-dump.tar.gz': No such file or directory
Complete! Wrote debug dump to: ./debug-dump.tar.gz
by the way my docker
j

Jacopo

10/25/2021, 9:34 AM
A bit of a note to everyone involved, the 
Error during generation of debug data: configuration.
error tells us that the config directory mount is either ā€¢ failing ā€¢ the directory of the wrong user is being mounted, i.e. one that does not contain the config file @Arnzok what do you get from 
echo "${XDG_CONFIG_HOME:-$HOME/.config}/orchest"
? Is the config file actually there?
@Rick Lamers might be needed here as he is the one with more knowledge of 
wsl2
y

Yannick

10/25/2021, 9:41 AM
https://orchest.slack.com/archives/C018A6TGJR3/p1628694042009400?thread_ts=1628693639.009000&cid=C018A6TGJR3 Just wanted to link a previous issue with WSL2. I am sure Rick can help
a

Arnzok

10/25/2021, 9:42 AM
Lambert@DESKTOP-1K50E6H MINGW64 /c/workspaces/orchest (master)
$ ./orchest debug --compress --ext
/c/workspaces/orchest
/c/Users/Lambert/.config/orchest
/c/workspaces/orchest/userdir
linux
/c/Users/Lambert/.config/orchest
for : echo $DIR
echo $HOST_CONFIG_DIR
echo $HOST_USER_DIR
echo $HOST_OS
echo "${XDG_CONFIG_HOME:-$HOME/.config}/orchest"
j

Jacopo

10/25/2021, 9:42 AM
thank you
a

Arnzok

10/25/2021, 9:42 AM
the folder is empty
and i have this folder created : orchest;C
orchest folder.JPG
šŸ‘€ 1
j

Jacopo

10/25/2021, 9:44 AM
I think we are getting closer to the issue, it might very well be that what @Yannick has linked is the solution
šŸ‘ 1
a

Arnzok

10/25/2021, 10:01 AM
i've disabled ipv6 and rebooted my computer (not just linux in windows)
i still get the same error $ ./orchest start
Traceback (most recent call last):
  File "/usr/local/bin/orchest", line 8, in <module>
    sys.exit(__entrypoint())
  File "/usr/local/lib/python3.8/site-packages/app/cli/main.py", line 84, in __entrypoint
    typer_app()
  File "/usr/local/lib/python3.8/site-packages/typer/main.py", line 214, in __call__
    return get_command(self)(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1637, in invoke
    super().invoke(ctx)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/typer/main.py", line 500, in wrapper
    return callback(**use_params)  # type: ignore
  File "/usr/local/lib/python3.8/site-packages/app/cli/start.py", line 50, in _default
    reg(port, log_level, cloud, dev)
  File "/usr/local/lib/python3.8/site-packages/app/cli/start.py", line 93, in reg
    container_config = get_container_config(port, cloud, dev, log_level)
  File "/usr/local/lib/python3.8/site-packages/app/spec.py", line 131, in get_container_config
    config = get_reg_container_config(port, env)
  File "/usr/local/lib/python3.8/site-packages/app/spec.py", line 168, in get_reg_container_config
    env = utils.get_env()
  File "/usr/local/lib/python3.8/site-packages/app/utils.py", line 50, in get_env
    env["ORCHEST_HOST_GID"] = str(os.stat("/orchest-host/orchest").st_gid)
FileNotFoundError: [Errno 2] No such file or directory: '/orchest-host/orchest'
here is my docker desktop config btw
j

Jacopo

10/25/2021, 10:06 AM
I see, I think we need to call in the cavalry when it comes to WSL, @Rick Lamers.
šŸ˜„ 1
a

Arnzok

10/25/2021, 10:13 AM
i wonder if the problem is not in the script, because i get a strange folder created orchest;C as if some path given in the script was wrong
šŸ‘€ 1
j

Jacopo

10/25/2021, 10:18 AM
Indeed, it looks like that. My best bet is some unexpected interaction between WSL and docker when it comes to the file system, which ends up providing the wrong path to mount.
r

Rick Lamers

10/25/2021, 10:39 AM
@Arnzok sorry for being late to the party! My guess is that while you have WSL2 installed. You're actually trying to run Orchest from Git Bash, which is not supported. The easiest way to get Orchest running on Windows is to make sure you have WSL2 installed and use a Ubuntu distribution for WSL2 (just open Windows Store, search for Ubuntu) and if you have WSL2 working you should get a prompt (see image) that is actually running inside the Ubuntu environment. Here you should 
git clone <https://github.com/orchest/orchest>
and run your 
./orchest ...
commands.
Inside WSL2 it looks something like this:
a

Arnzok

10/25/2021, 10:47 AM
right it works ! however since orchest is launched in ubuntu, i can't access my python virtual environments
šŸ’Æ 1
i guess it has to be built with docker so i must add all my dependencies in Environments -> Build ?
r

Rick Lamers

10/25/2021, 10:54 AM
Python environments are managed by Environments indeed! They're fully integrated in Orchest itself You can still use requirements files and the likes. Just put: 
pip install -r requirements.txt
in the environment build script and have a requirements.txt in the root of the project (File Manager > projects > <your project> > requirements.txt). You can also add this file in the JupyterLab editor.
āœ… 1
a

Arnzok

10/25/2021, 10:55 AM
ok thank you very much šŸ™‚ i would have prefered to directly link to a virtual env prepared on my windows env, but it will do !
šŸ‘ 1
j

Jacopo

10/25/2021, 10:55 AM
glad to hear it works, we will make the docs more clear on this
šŸ™Œ 1
#announcementsJoin Slack
Powered by