Michael Duncan
01/29/2021, 6:40 PM./orchest install
./orchest update
and ./orchest start
. When I try to create a project nothing shows up in the UI and I can't select the default Project
. The projects are being made and put into the userdir/projects
directory but I can't interact with them.
Any tips would be greatly appreciatedYannick
./orchest version --ext
shows v0.6.1
for every container?Rick Lamers
docker logs orchest-webserver
docker logs orchest-api
Could contain errors that are useful. Are you able to share those?Michael Duncan
01/29/2021, 8:09 PMorchest-api
[2021-01-29 20:05:44 +0000] [1] [INFO] Starting gunicorn 20.0.4
[2021-01-29 20:05:44 +0000] [1] [INFO] Listening at: <http://0.0.0.0:80> (1)
[2021-01-29 20:05:44 +0000] [1] [INFO] Using worker: eventlet
[2021-01-29 20:05:44 +0000] [8] [INFO] Booting worker with pid: 8
INFO:apscheduler.scheduler:base.py - [29/Jan/2021 20:05:47] - Scheduler started
INFO:apscheduler.scheduler:base.py - [29/Jan/2021 20:05:47] - Added job "Scheduler.check_for_jobs_to_be_scheduled" to job store "default"
INFO:app:main.py - [29/Jan/2021 20:05:47] - Running orchest-api as root
INFO:app:main.py - [29/Jan/2021 20:05:47] - Running orchest-api as root
INFO:apscheduler.executors.default:base.py - [29/Jan/2021 20:05:57] - Running job "Scheduler.check_for_jobs_to_be_scheduled (trigger: interval[0:00:10], next run at: 2021-01-29 20:05:57 UTC)" (scheduled at 2021-01-29 20:05:57.909404+00:00)
INFO:job-scheduler:scheduler.py - [29/Jan/2021 20:05:57] - found 0 jobs to run
INFO:job-scheduler:scheduler.py - [29/Jan/2021 20:05:57] - found 0 jobs to run
INFO:apscheduler.executors.default:base.py - [29/Jan/2021 20:05:57] - Job "Scheduler.check_for_jobs_to_be_scheduled (trigger: interval[0:00:10], next run at: 2021-01-29 20:06:07 UTC)" executed successfully
INFO:apscheduler.executors.default:base.py - [29/Jan/2021 20:06:07] - Running job "Scheduler.check_for_jobs_to_be_scheduled (trigger: interval[0:00:10], next run at: 2021-01-29 20:06:17 UTC)" (scheduled at 2021-01-29 20:06:07.909404+00:00)
INFO:job-scheduler:scheduler.py - [29/Jan/2021 20:06:07] - found 0 jobs to run
INFO:job-scheduler:scheduler.py - [29/Jan/2021 20:06:07] - found 0 jobs to run
INFO:apscheduler.executors.default:base.py - [29/Jan/2021 20:06:07] - Job "Scheduler.check_for_jobs_to_be_scheduled (trigger: interval[0:00:10], next run at: 2021-01-29 20:06:17 UTC)" executed successfully
INFO:apscheduler.executors.default:base.py - [29/Jan/2021 20:06:17] - Running job "Scheduler.check_for_jobs_to_be_scheduled (trigger: interval[0:00:10], next run at: 2021-01-29 20:06:27 UTC)" (scheduled at 2021-01-29 20:06:17.909404+00:00)
INFO:job-scheduler:scheduler.py - [29/Jan/2021 20:06:17] - found 0 jobs to run
INFO:job-scheduler:scheduler.py - [29/Jan/2021 20:06:17] - found 0 jobs to run
INFO:apscheduler.executors.default:base.py - [29/Jan/2021 20:06:17] - Job "Scheduler.check_for_jobs_to_be_scheduled (trigger: interval[0:00:10], next run at: 2021-01-29 20:06:27 UTC)" executed successfully
INFO:apscheduler.executors.default:base.py - [29/Jan/2021 20:06:27] - Running job "Scheduler.check_for_jobs_to_be_scheduled (trigger: interval[0:00:10], next run at: 2021-01-29 20:06:37 UTC)" (scheduled at 2021-01-29 20:06:27.909404+00:00)
INFO:job-scheduler:scheduler.py - [29/Jan/2021 20:06:27] - found 0 jobs to run
INFO:job-scheduler:scheduler.py - [29/Jan/2021 20:06:27] - found 0 jobs to run
orchest-webserver
[2021-01-29 20:05:44 +0000] [1] [INFO] Starting gunicorn 20.0.4
[2021-01-29 20:05:44 +0000] [1] [INFO] Listening at: <http://0.0.0.0:80> (1)
[2021-01-29 20:05:44 +0000] [1] [INFO] Using worker: eventlet
[2021-01-29 20:05:44 +0000] [8] [INFO] Booting worker with pid: 8
INFO:apscheduler.scheduler:base.py - [29/Jan/2021 20:05:47] - Scheduler started
INFO:app:__init__.py - [29/Jan/2021 20:05:47] - Flask CONFIG: <Config {'ENV': 'production',...}>
INFO:apscheduler.scheduler:base.py - [29/Jan/2021 20:05:47] - Added job "analytics_ping" to job store "default"
INFO:app:__init__.py - [29/Jan/2021 20:05:48] - Started log_streamer.py
INFO:app:__init__.py - [29/Jan/2021 20:05:48] - Started log_streamer.py
INFO:app:main.py - [29/Jan/2021 20:05:48] - Running orchest-webserver as root
INFO:app:main.py - [29/Jan/2021 20:05:48] - Running orchest-webserver as root
INFO:app:main.py - [29/Jan/2021 20:05:48] - Running from Gunicorn
INFO:app:main.py - [29/Jan/2021 20:05:48] - Running from Gunicorn
INFO:root:log_streamer started
INFO:gunicorn.access:glogging.py - [29/Jan/2021 20:05:48] - 127.0.0.1 - - [29/Jan/2021:20:05:48 +0000] "GET /socket.io/?transport=polling&EIO=3&t=1611950748.2921224 HTTP/1.1" 200 119 "-" "python-requests/2.25.0"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 20:05:48] - 127.0.0.1 - - [29/Jan/2021:20:05:48 +0000] "GET /socket.io/?transport=polling&EIO=3&t=1611950748.2921224 HTTP/1.1" 200 119 "-" "python-requests/2.25.0"
INFO:socketio.client:<http://Engine.IO|Engine.IO> connection established
INFO:socketio.client:Namespace / is connected
INFO:root:Entered file_reader_loop
INFO:app:socketio_server.py - [29/Jan/2021 20:05:48] - <http://socket.io|socket.io> client connected on /pty
INFO:app:socketio_server.py - [29/Jan/2021 20:05:48] - <http://socket.io|socket.io> client connected on /pty
INFO:socketio.client:Namespace /pty is connected
INFO:root:SocketIO connection established on namespace /pty
INFO:gunicorn.access:glogging.py - [29/Jan/2021 20:06:33] - 192.168.176.9 - - [29/Jan/2021:20:06:33 +0000] "GET / HTTP/1.1" 200 4746 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 20:06:33] - 192.168.176.9 - - [29/Jan/2021:20:06:33 +0000] "GET / HTTP/1.1" 200 4746 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 20:06:33] - 192.168.176.9 - - [29/Jan/2021:20:06:33 +0000] "POST /analytics HTTP/1.1" 200 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 20:06:33] - 192.168.176.9 - - [29/Jan/2021:20:06:33 +0000] "POST /analytics HTTP/1.1" 200 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 20:06:34] - 192.168.176.9 - - [29/Jan/2021:20:06:34 +0000] "GET /async/projects HTTP/1.1" 200 3 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 20:06:34] - 192.168.176.9 - - [29/Jan/2021:20:06:34 +0000] "GET /async/projects HTTP/1.1" 200 3 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
Yannick
scripts/clean_userdir.sh
? This cleans your userdir (assuming you have not been able yet to use Orchest and so don't have any files that you want to keep).Michael Duncan
01/29/2021, 8:24 PMRick Lamers
Michael Duncan
01/29/2021, 8:28 PMRick Lamers
scripts/clean_userdir.sh
?docker logs orchest-database
can be informative.docker stats
could also help to find if there is potentially a resource (e.g. RAM) issue.
But I’m still curious about a ./orchest stop
followed by a scripts/clean_userdir.sh
and ./orchest start
Michael Duncan
01/29/2021, 8:55 PMscripts/clean_userdir.sh
before stopping but the UI still doesn't work for me after running a ./orchest stop
followed by a scripts/clean_userdir.sh
and ./orchest start
Rick Lamers
docker exec -it --user postgres orchest-database psql --db orchest_webserver
and query SELECT * FROM projects;
?Michael Duncan
01/29/2021, 9:03 PMRick Lamers
./orchest stop
, scripts/clean_userdir.sh
, ./orchest start
, create a single new project, check docker logs orchest-webserver
.
It should log the exception that occurs on project creation.Michael Duncan
01/29/2021, 9:21 PMINFO:gunicorn.access:glogging.py - [29/Jan/2021 21:17:58] - 192.168.176.3 - - [29/Jan/2021:21:17:58 +0000] "POST /async/projects/import-git HTTP/1.1" 200 156 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:17:58] - 192.168.176.3 - - [29/Jan/2021:21:17:58 +0000] "POST /async/projects/import-git HTTP/1.1" 200 156 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:17:59] - 127.0.0.1 - - [29/Jan/2021:21:17:59 +0000] "PUT /async/background-tasks/44fdc9ce-5ea9-4411-8926-0571d02cbe9b HTTP/1.1" 200 156 "-" "python-requests/2.25.0"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:17:59] - 127.0.0.1 - - [29/Jan/2021:21:17:59 +0000] "PUT /async/background-tasks/44fdc9ce-5ea9-4411-8926-0571d02cbe9b HTTP/1.1" 200 156 "-" "python-requests/2.25.0"
Cloning into 'quickstart'...
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:17:59] - 192.168.176.3 - - [29/Jan/2021:21:17:59 +0000] "GET /async/background-tasks/44fdc9ce-5ea9-4411-8926-0571d02cbe9b HTTP/1.1" 200 156 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:17:59] - 192.168.176.3 - - [29/Jan/2021:21:17:59 +0000] "GET /async/background-tasks/44fdc9ce-5ea9-4411-8926-0571d02cbe9b HTTP/1.1" 200 156 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:18:00] - 127.0.0.1 - - [29/Jan/2021:21:18:00 +0000] "PUT /async/background-tasks/44fdc9ce-5ea9-4411-8926-0571d02cbe9b HTTP/1.1" 200 172 "-" "python-requests/2.25.0"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:18:00] - 127.0.0.1 - - [29/Jan/2021:21:18:00 +0000] "PUT /async/background-tasks/44fdc9ce-5ea9-4411-8926-0571d02cbe9b HTTP/1.1" 200 172 "-" "python-requests/2.25.0"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:18:00] - 192.168.176.3 - - [29/Jan/2021:21:18:00 +0000] "GET /async/background-tasks/44fdc9ce-5ea9-4411-8926-0571d02cbe9b HTTP/1.1" 200 172 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:18:00] - 192.168.176.3 - - [29/Jan/2021:21:18:00 +0000] "GET /async/background-tasks/44fdc9ce-5ea9-4411-8926-0571d02cbe9b HTTP/1.1" 200 172 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:18:51] - 192.168.176.3 - - [29/Jan/2021:21:18:51 +0000] "POST /analytics HTTP/1.1" 200 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:18:51] - 192.168.176.3 - - [29/Jan/2021:21:18:51 +0000] "POST /analytics HTTP/1.1" 200 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:18:51] - 192.168.176.3 - - [29/Jan/2021:21:18:51 +0000] "GET /store/datasources?show_internal=false HTTP/1.1" 200 3 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:18:51] - 192.168.176.3 - - [29/Jan/2021:21:18:51 +0000] "GET /store/datasources?show_internal=false HTTP/1.1" 200 3 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:18:52] - 192.168.176.3 - - [29/Jan/2021:21:18:52 +0000] "POST /analytics HTTP/1.1" 200 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:18:52] - 192.168.176.3 - - [29/Jan/2021:21:18:52 +0000] "POST /analytics HTTP/1.1" 200 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:19:02] - 192.168.176.3 - - [29/Jan/2021:21:19:02 +0000] "POST /analytics HTTP/1.1" 200 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:19:02] - 192.168.176.3 - - [29/Jan/2021:21:19:02 +0000] "POST /analytics HTTP/1.1" 200 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:19:02] - 192.168.176.3 - - [29/Jan/2021:21:19:02 +0000] "GET /async/projects HTTP/1.1" 200 3 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:19:02] - 192.168.176.3 - - [29/Jan/2021:21:19:02 +0000] "GET /async/projects HTTP/1.1" 200 3 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:19:05] - 192.168.176.3 - - [29/Jan/2021:21:19:05 +0000] "GET / HTTP/1.1" 200 4746 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:19:05] - 192.168.176.3 - - [29/Jan/2021:21:19:05 +0000] "GET / HTTP/1.1" 200 4746 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:19:05] - 192.168.176.3 - - [29/Jan/2021:21:19:05 +0000] "POST /analytics HTTP/1.1" 200 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:19:05] - 192.168.176.3 - - [29/Jan/2021:21:19:05 +0000] "POST /analytics HTTP/1.1" 200 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:19:05] - 192.168.176.3 - - [29/Jan/2021:21:19:05 +0000] "GET /async/projects HTTP/1.1" 200 3 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:19:05] - 192.168.176.3 - - [29/Jan/2021:21:19:05 +0000] "GET /async/projects HTTP/1.1" 200 3 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:19:05] - 192.168.176.3 - - [29/Jan/2021:21:19:05 +0000] "GET /public/image/favicon.png HTTP/1.1" 200 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
INFO:gunicorn.access:glogging.py - [29/Jan/2021 21:19:05] - 192.168.176.3 - - [29/Jan/2021:21:19:05 +0000] "GET /public/image/favicon.png HTTP/1.1" 200 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36"
Rick Lamers
docker exec -it --user postgres orchest-database psql --db orchest_webserver
and query SELECT * FROM projects;
Is probably also giving the STATUS of INITIALIZING for quickstart?Michael Duncan
01/29/2021, 9:23 PMRick Lamers
orchest-api
. Can you print those logs? (docker logs orchest-api
)Michael Duncan
01/29/2021, 9:28 PMRick Lamers
orchest-api
should be queried. The job scheduler is a bit verbose, but is not showing anything out of the ordinary.docker logs orchest-api 2>&1 | grep gunicorn
does this give you any lines?Michael Duncan
01/29/2021, 9:35 PMRick Lamers
orchest-webserver
are able to reach orchest-api
.
Can you share the output of docker network inspect orchest
?Michael Duncan
01/29/2021, 9:39 PMdocker network inspect orchest
[
{
"Name": "orchest",
"Id": "60385328c83eaf17c08dc155cd23626941c326a6f0010c4bf0b159cb50f6084a",
"Created": "2021-01-29T154947.9434325Z",
"Scope": "local",
"Driver": "bridge",
"EnableIPv6": false,
"IPAM": {
"Driver": "default",
"Options": null,
"Config": [
{
"Subnet": "192.168.176.0/20",
"Gateway": "192.168.176.1"
}
]
},
"Internal": false,
"Attachable": false,
"Ingress": false,
"ConfigFrom": {
"Network": ""
},
"ConfigOnly": false,
"Containers": {
"06df22f2c8902be119bb0328bade2fee2e9f9e197eaee8587947c1ddef1c0749": {
"Name": "orchest-api",
"EndpointID": "cf7b337386780901d89d2f34a9c23e88fd9ea63d4637cb7c721594b0beea23c7",
"MacAddress": "0242c0a8b0:06",
"IPv4Address": "192.168.176.6/20",
"IPv6Address": ""
},
"2504e44f635650db61da5821b2263e0c1fb9b1d13a50f2ee8a6e3615ca3ad710": {
"Name": "orchest-database",
"EndpointID": "12f1c3c9c505bee738e6c8e1bb32feb9947e234f55889803456eb0904a46ef99",
"MacAddress": "0242c0a8b0:04",
"IPv4Address": "192.168.176.4/20",
"IPv6Address": ""
},
"7aadad5bbe6ed788f8c2b535d5c84d1a7692fc8dc315840c49d4a3b56d2897a4": {
"Name": "orchest-webserver",
"EndpointID": "1cb1a1f4dd17dc223a296b2c154e0822001a60915a13821c7507ee1e9fae2534",
"MacAddress": "0242c0a8b0:08",
"IPv4Address": "192.168.176.8/20",
"IPv6Address": ""
},
"877be01eab881153faa186a319d869a665e3091a01bb8bb89ec14adafbf15683": {
"Name": "nginx-proxy",
"EndpointID": "3cf6cfd8bae999c50317c9890b2180cdf8d148e93d41e650e4f5025ff11e2981",
"MacAddress": "0242c0a8b0:03",
"IPv4Address": "192.168.176.3/20",
"IPv6Address": ""
},
"8cbe0fc33e43965604c37fc8649ff5936bc3b1a8bde20fd954a52dfb2ecae406": {
"Name": "celery-worker",
"EndpointID": "07e2e6eb7def37537a71aa7625ae9774c2ed64fb216e3005c9f592dcfd685548",
"MacAddress": "0242c0a8b0:05",
"IPv4Address": "192.168.176.5/20",
"IPv6Address": ""
},
"ac26d7e44ea6a6a98a8410b38382b31b0f06cdb0d2eb75c3c0382eb5ef6e4476": {
"Name": "auth-server",
"EndpointID": "0e19e145a925be7bb01dad539a524d5fb4d8e9b9db1c7eed3ca8e5ff9b07508e",
"MacAddress": "0242c0a8b0:07",
"IPv4Address": "192.168.176.7/20",
"IPv6Address": ""
},
"d720300853fc9e5f8236f6aba6b7b9cab4443066ed44866dcfd045120a9931bd": {
"Name": "file-manager",
"EndpointID": "6c8807c936cf3eeb199b3fe29f34022c9469cf5258b2b29b66d6a5ccf3270c4f",
"MacAddress": "0242c0a8b0:02",
"IPv4Address": "192.168.176.2/20",
"IPv6Address": ""
}
},
"Options": {},
"Labels": {}
}
]Rick Lamers
docker exec orchest-webserver bash -c 'wget <http://orchest-api/api/>'
would be helpful, this will establish whether they are connected in the Docker network.Michael Duncan
01/29/2021, 9:47 PMdocker exec orchest-webserver bash -c 'wget <http://orchest-api/api/>'
--2021-01-29 214740-- http://orchest-api/api/
Resolving orchest-api (orchest-api)... 192.168.176.6
Connecting to orchest-api (orchest-api)|192.168.176.6|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 3835 (3.7K) [text/html]
Saving to: ‘index.html’
0K ... 100% 468M=0s
2021-01-29 214741 (468 MB/s) - ‘index.html’ saved [3835/3835]Rick Lamers
ls -la orchest/userdir/.orchest/kernels
ls -la orchest/userdir/projects/<your_project_name>/.orchest/environments
Michael Duncan
01/29/2021, 9:56 PMls -la userdir/.orchest/kernels
total 8
drwxr-sr-x 4 michaelduncan staff 128 Jan 29 14:18 .
drwxr-sr-x 7 michaelduncan staff 224 Jan 29 14:17 ..
-rw-r--r-- 1 michaelduncan staff 13 Jan 29 14:13 .gitignore
drwxr-xr-x 4 michaelduncan staff 128 Jan 29 14:18 fb23951b-e612-408f-9d8c-c9334cae5265ls -la userdir/projects/quickstart/.orchest/environments
total 0
drwxrwxr-x@ 3 michaelduncan staff 96 Jan 29 14:18 .
drwxrwxr-x@ 4 michaelduncan staff 128 Jan 29 14:18 ..
drwxrwxr-x@ 4 michaelduncan staff 128 Jan 29 14:18 c56ab762-539c-4cce-9b1e-c4b00300ec6fRick Lamers
<http://127.0.0.1:8000/catch/api-proxy/api/runs/>
return?Michael Duncan
01/29/2021, 10:04 PM{
"runs": []
}
Rick Lamers
curl '<http://127.0.0.1:8000/catch/api-proxy/api/environment-builds>' \
-H 'Connection: keep-alive' \
-H 'Pragma: no-cache' \
-H 'Cache-Control: no-cache, must-revalidate, post-check=0, pre-check=0' \
-H 'sec-ch-ua: "Chromium";v="88", "Google Chrome";v="88", ";Not A Brand";v="99"' \
-H 'sec-ch-ua-mobile: ?0' \
-H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 11_1_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.96 Safari/537.36' \
-H 'Content-Type: application/json;charset=UTF-8' \
-H 'Accept: */*' \
-H 'Origin: <http://127.0.0.1:8000>' \
-H 'Sec-Fetch-Site: same-origin' \
-H 'Sec-Fetch-Mode: cors' \
-H 'Sec-Fetch-Dest: empty' \
-H 'Referer: <http://127.0.0.1:8000/>' \
-H 'Accept-Language: en-US,en;q=0.9,nl;q=0.8,und;q=0.7,mt;q=0.6,fy;q=0.5,pt;q=0.4,de;q=0.3,fr;q=0.2,la;q=0.1' \
-H 'Cookie: email=admin; _ga=GA1.1.1962276334.1575881370; token=JKypplwOubCGHbBTXzLNhpMaaGROhVtm; session_uuid=db98cdc9-456d-4929-9c3b-3cc7a7346da2; csrftoken=uCcgpprIizYljYHzxgg88hT7d3cn3Mh4yKoSXJzyJV6bR2MOy78etBNCjQLquosn' \
--data-raw '{"environment_build_requests":[{"environment_uuid":"c56ab762-539c-4cce-9b1e-c4b00300ec6f","project_uuid":"fb23951b-e612-408f-9d8c-c9334cae5265"}]}' \
--compressed
Could you test the above? (I’m assuming you haven’t yet enabled authentication on the Orchest instance, otherwise the token would mess thing up in the above command).
It will attempt to trigger the build of an environment which happens on project creation.Michael Duncan
01/29/2021, 10:16 PMRick Lamers
orchest-api
is not logging web requests.
Is docker logs orchest-api 2>&1 | grep gunicorn
still only showing Starting Gunicorn…
after a call to http://127.0.0.1:8000/catch/api-proxy/api/runs/?Michael Duncan
01/29/2021, 10:21 PMcurl
command is just hangingRick Lamers
Michael Duncan
01/29/2021, 10:24 PMRick Lamers
docker exec celery-worker cat celery_env_builds.log
could help (and: docker logs rabbitmq-server
)Michael Duncan
01/29/2021, 10:28 PMRick Lamers
docker logs celery-worker
?Michael Duncan
01/29/2021, 10:29 PMRick Lamers
./orchest install
.Jacopo
01/29/2021, 10:56 PMMichael Duncan
02/01/2021, 3:20 PMYannick
Jacopo
02/01/2021, 3:26 PM