Eshwaran Venkat
06/05/2022, 5:06 PMRick Lamers
pip install pandas
or similar in the environment?juanlu
Yannick
conda
environment.
could you share your setup scriptThis would indeed be a great start for us to debug your problem :)
Eshwaran Venkat
06/06/2022, 7:26 AM#!/bin/bash
sudo apt-get update
sudo apt-get upgrade -y
sudo apt-get install -y git
pip install orchest
pip install git+https://{ACCESS_KEY}@github.com/dotlas/swarm.git -q
pip install geoalchemy2
Yannick
Eshwaran Venkat
06/06/2022, 8:07 AMjuanlu
/settings
page, there should be something like this:Eshwaran Venkat
06/06/2022, 8:18 AMjuanlu
Eshwaran Venkat
06/06/2022, 8:20 AMjuanlu
#!/bin/bash
sudo apt-get update
sudo apt-get upgrade -y
sudo apt-get install -y git
pip install orchest
# pip install git+https://{ACCESS_KEY}@github.com/dotlas/swarm.git -q
pip install geoalchemy2
and everything seems to work fine on JupyterLab βοΈ , interactive pipeline runs βοΈ , and one-off jobs βοΈ
the only explanation is that some dependency of swarm
is causing some disruption. let's take this privately.Eshwaran Venkat
06/06/2022, 8:26 AMjuanlu
#!/bin/bash
sudo apt-get update
sudo apt-get upgrade -y
sudo apt-get install -y git
pip install orchest
pip install "ipython==8.2.0" "ipykernel==6.12.1" "jupyter-client==7.2.1" "numpy==1.22.3" "SQLAlchemy==1.4.34"
pip install geoalchemy2
pre-commit
, mkdocs
and such) so maybe you can tweak swarm
package metadata to use extras to avoid pulling all thesepip install "ipykernel==6.12.1"
Yannick
nbformat
(which we use to execute Notebooks in pipeline runs) has an incompatibility with that specific ipykernel
version?juanlu
Eshwaran Venkat
06/06/2022, 9:43 AMjuanlu
python -m ipykernel install --sys-prefix
at the end fixes the problem, in case you want to try it out (if you have already simplified the dependencies and have a working solution, no need to do anything then)