howie hu
01/16/2021, 2:23 PMRick Lamers
howie hu
01/16/2021, 2:35 PMRUN conda install --quiet --yes python=3.6
directly to the DockerfileRick Lamers
The current implementation must rely on orchest code. Is there a more convenient way, such as plug-ins?What do you mean must rely on Orchest code?
howie hu
01/16/2021, 2:39 PM# Ubuntu 18.04.1 LTS Bionic
FROM elyra/kernel-py:2.3.0
USER root
# enable sudo for the NB_USER by default
RUN passwd -d $NB_USER && echo "$NB_USER ALL=(ALL) NOPASSWD:ALL" | tee /etc/sudoers.d/$NB_USER
WORKDIR /
COPY ./base-kernel-py/*.sh /
RUN conda install --quiet --yes python=3.6
# Run augment script
RUN ./augment-root.sh
# Install our internal libraries
COPY ./lib/python /orchest/lib/python
COPY ./orchest-sdk /orchest/orchest-sdk
COPY ./runnable-shared/runner /orchest/services/base-images/runnable-shared/runner
WORKDIR /orchest/services/base-images/runnable-shared/runner
RUN pip install -r requirements.txt
COPY ./runnable-shared/bootscript.sh /orchest/bootscript.sh
USER $NB_USER
ENV HOME=/home/$NB_USER
ARG ORCHEST_VERSION
ENV ORCHEST_VERSION=${ORCHEST_VERSION}
CMD [ "/orchest/bootscript.sh" ]
this is my DockerfileRick Lamers
howie hu
01/16/2021, 3:10 PMRick Lamers
docker build -t my-custom-base .
and enter 'my-custom-base:latest' in the environment, you should get Python 3.6 in both Python scripts and Python notebooks in your pipeline.
Let me know if you have any questions.
As I said earlier, custom images aren't fully worked out so docs on making them isn't done yet.
Hope this helps!howie hu
01/17/2021, 3:15 AMfromisoformat
is not available in Python versions older than 3.7.
Maybe you need to make orchest-sdk support python3.6
My current solution is to import a third-party compatibility patch
from backports.datetime_fromisoformat import MonkeyPatch
MonkeyPatch.patch_fromisoformat()
Then it can run normally, but I’m not sure if there are any other hidden problems.Rick Lamers
pandas
. The custom image could be modified to install all the Python/conda packages the Jupyter Stacks image comes with. But I didn’t know whether you’d want the image bloated like that.
We will look at making orchest-sdk
Python 3.6 compatible, since it’s used in user code we want it to be as easy to import as possible. We’ll give it a pass and make sure it works with Python 3.6+.
Thanks for pointing out the missing validation on the environment name. It should not accept empty input.
I’ll let you know when we’ve refactored the orchest-sdk
so that you can drop the patch.howie hu
01/18/2021, 3:03 AMImport failed: undefined error. Please try again.
orchest-webserver's log:
fatal: could not read Username for '<https://gitlab>.***.cc': No such device or address
How can i solve this problem?Rick Lamers
git
at the moment the easiest way is to use a terminal and clone the project in orchest/userdir/projects/. It should automatically detect the new folder when you view projects.
Would that be an option?howie hu
01/18/2021, 1:50 PMRick Lamers
Yannick
Maybe you need to make orchest-sdk support python3.6Python3.6 is now supported! Happy coding :)