https://www.orchest.io/ logo
Title
e

Esraa Madi

12/17/2022, 3:05 PM
i have been working on Orchest for 2 months now (on cloud) , i always get storage issue after working on an instance after while, and it's not related to the number of created files or pipelines and even when i deleted all the files still i can not see significant change in the free storage size, any advice about how i can use storage better? (attached image for instance has 5 files only and 4 environment , 1 pipeline)
n

Nick Post

12/18/2022, 8:12 AM
Does it have many recurring jobs? Each job run takes a project snapshot which will take up space. You can mitigate this by turning on auto clean-up next time you create a job.
r

Rick Lamers

12/18/2022, 8:42 AM
We’re also working on better storage management tools. Allowing you to quickly see how the storage is being used and easily free up resources.
that would be useful, what i am doing now is working on instance until it got out of storage then download the files and start over with new instance creating the environments and services from beginning , is there another approach would be easier from what i am doing? i feel the storage got full when i keep running the pipeline while developing https://orchest.slack.com/archives/C045TCTCMAP/p1671352969378329?thread_ts=1671289505.578549&cid=C045TCTCMAP
j

Jacopo

12/19/2022, 8:03 AM
Hi @Esraa Madi, this is likely something worth investigating on our side, we'll keep you posted if we find anything
🙏 1
I've found one of the issues involved (https://github.com/orchest/orchest/pull/1480), I'm taking a look for ways to improve our cache cleanup mechanism, I'll likely make a release today so that you can make use of the aforementioned fix edit: See https://github.com/orchest/orchest/releases/tag/v2022.12.6 We have more improvements related to cache cleanups down the road, but it's not something which will come soon
👍 2