Hi, guys! We've being trying Orchest k8s version here, but we want to migrate the work that we built on top a previous version

v2021.12.0

(deployed using docker-compose). Do you have a guide for this migration? Is there a script to do this? Or can we just suppose that if we migrate all the files - including those

.orchest

everything will work fine?

Hi @Allan Sene :) That is a great question. @Jacopo is actually working on a script for our Cloud instances to migrate from an "Orchest Docker version" to an "Orchest Kubernetes version". The caveat however, is that a full migration (in the sense that after running the script everything is ported and fully runs, e.g. jobs) is not possible due to some architectural changes. Luckily, migrating all files should work just fine! Including the

.orchest

files. Once we have all the details we will write up a guide to do such a migration yourself and will add it to our docs here. The rough details of the guide will be: • Copy over your project files • Use these lines of code to create new draft jobs with the same configurations as your existing jobs.

Hi @Allan Sene, to add to what @Yannick said, if you need to migrate now a migration to k8s Orchest that only includes the content of the

/data

and

/projects

directory can be done by copying their content into the right places, then projects, pipelines, environments etc. will be picked up. However you will need to rebuild environments, reset environment variables, recreate and reconfigure jobs etc. For example, if you plan to run k8s Orchest on minikube with the docker driver you could copy the content of the data and projects directories of pre-k8s Orchest into the host file-system paths that docker is using as volumes, e.g.: •

/var/lib/docker/volumes/minikube/_data/hostpath-provisioner/orchest/userdir-pvc/projects

•

/var/lib/docker/volumes/minikube/_data/hostpath-provisioner/orchest/userdir-pvc/data

Other k8s-flavor independent solutions might include doing an rsync or scp into the

orchest-webserver

pod since it has access to the

projects

and

data

directories

@Allan Sene let me know if you want to jump on a call to discuss any of these details 🙂 Just send a DM

Great, guys! We will try to come up with some scripting to do this. If it works, we will share with you and contribute with this piece of docs. Thanks!