Vivan
12/16/2020, 9:04 AMRick Lamers
Vivan
12/16/2020, 9:07 AMVivan
12/16/2020, 9:07 AMVivan
12/16/2020, 9:07 AMMédéric Descazeaux
12/17/2020, 3:24 PMorchest.output({'df': df}, name="current")
And for "Process data":
orchest.output({'df': df,
'processedlist': processedlist,
'ignoredlist': ignoredlist,
'messageslist': messageslist},
name='processed')
I get the following error:
---------------------------------------------------------------------------
ValueError Traceback (most recent call last)
<ipython-input-3-b9a2b7cd25cd> in <module>
5 print("Getting current and pending logs from Orchest pipeline...", end=" ")
6
----> 7 data = orchest.get_inputs()
8
9 display(data)
/orchest/orchest-sdk/python/orchest/transfer.py in get_inputs(ignore_failure, verbose)
859 parent_uuid = parent.properties["uuid"]
860 get_output_method, args, kwargs, metadata = _resolve(
--> 861 parent_uuid, consumer=step_uuid
862 )
863
/orchest/orchest-sdk/python/orchest/transfer.py in _resolve(step_uuid, consumer)
753 method_info = method(step_uuid, consumer=consumer)
754 else:
--> 755 method_info = method(step_uuid)
756
757 except OutputNotFoundError:
/orchest/orchest-sdk/python/orchest/transfer.py in _resolve_disk(step_uuid)
349 with open(head_file, "r") as f:
350 timestamp, serialization, name = f.read().split(
--> 351 Config.__METADATA_SEPARATOR__
352 )
353
ValueError: not enough values to unpack (expected 3, got 1)
ValueError: not enough values to unpack (expected 3, got 1)
The error only happens if the "Load current logs" block is connected to the "Merge logs" one.Vivan
12/17/2020, 3:29 PMJames Read
12/22/2020, 12:26 PMRick Lamers
James Read
12/22/2020, 12:40 PMRick Lamers
docker
group is sufficient. Alternatively, the user can invoke ./orchest <command>
commands where sudo
is used when we detect the user has no access to the Docker .sock
.
We're very open to improving this to be more compatible with e.g. Fedora Linux and security features like SELinux. Would gladly pick your brain sometime if you see any particular areas for improvement.James Read
12/22/2020, 12:45 PMJames Read
12/22/2020, 12:46 PMRick Lamers
James Read
12/22/2020, 12:54 PMRick Lamers
userdir/
- massive increase in performance (no more daemon ).
• Individual SQLite databases merged into central Postgres service - improved concurrency across services.
• Introduced migrations for schema changes to improve updating experience.
• Improved Orchest SDK robustness in error handling.
• Various small fixes and changes.
Update to v0.4.1
Because of the changes, some of you might experience permission issues with the userdir/. To fix them please run the following command (from the orchest/
repo directory):
sudo chown -R $USER:$USER userdir/
sudo chmod -R g+rwxs userdir/
Happy holidays everyone! 🎄Rick Lamers
Foren Power
01/13/2021, 10:12 PMRick Lamers
Rick Lamers
Rick Lamers
howie hu
01/15/2021, 12:51 AMhowie hu
01/15/2021, 12:51 AMhowie hu
01/15/2021, 1:05 AMhowie hu
01/16/2021, 2:19 PMhowie hu
01/16/2021, 2:23 PMForen Power
01/20/2021, 12:50 AMVivan
01/22/2021, 6:34 AMMichael Duncan
01/29/2021, 6:40 PM./orchest install
./orchest update
and ./orchest start
. When I try to create a project nothing shows up in the UI and I can't select the default Project
. The projects are being made and put into the userdir/projects
directory but I can't interact with them.
Any tips would be greatly appreciatedRick Lamers
This release brings some great quality of life 💎 features!
For those of you that prefer configuring your IDEs to your liking (🕶️ dark mode anyone?) - with this release we make JupyterLab configuration persistent. In addition to user config (settings you modify in the JupyterLab Settings pane) we also make client side JupyterLab extensions persistent. Support for server side extensions will be added later.
@howie6879 pointed out that it would be nice to have pipeline parameters. It would alleviate the need to repeat yourself in pipeline steps for global pipeline level parameterization. Hence, you can now configure pipeline parameters 🥳. Thanks @howie6879! Pipeline parameters can also be overridden for scheduled jobs.
In addition, some minor logging, performance, and UI improvements were made.https://github.com/orchest/orchest/releases/tag/v0.7.0