Altieris Peixoto
10/08/2021, 6:04 PMMAX_JOB_RUNS_PARALLELISM =3
but i cannot run parallel pipelines using web tool yet. There's another configuration i should do?juanlu
Richard Pelgrim
10/15/2021, 2:54 PMAbid
10/19/2021, 2:02 PMAbid
10/19/2021, 2:03 PMPruthvi Shetty
10/21/2021, 11:30 PMMaicon Faria
10/22/2021, 6:04 PMFelix Becker
10/22/2021, 9:46 PM---------------------------------------------------------------------------
AttributeError Traceback (most recent call last)
/usr/local/bin/kernel-launchers/python/scripts/launch_ipykernel.py in <module>
1 import orchest
----> 2 data = orchest.get_inputs()
3 predictions_df_all = data['predictions']
/orchest/orchest-sdk/python/orchest/transfer.py in get_inputs(ignore_failure, verbose)
1016 # continue with other steps.
1017 try:
-> 1018 incoming_step_data = get_output_method(*args, **kwargs)
1019 except error.OutputNotFoundError as e:
1020 if not ignore_failure:
/orchest/orchest-sdk/python/orchest/transfer.py in _get_output_memory(step_uuid, consumer)
727 obj_id = _convert_uuid_to_object_id(step_uuid)
728 try:
--> 729 obj = _deserialize_output_memory(obj_id, client)
730
731 except error.ObjectNotFoundError:
/orchest/orchest-sdk/python/orchest/transfer.py in _deserialize_output_memory(obj_id, client)
696 # Can load the buffer directly because its a bytes-like-object:
697 # <https://docs.python.org/3/library/pickle.html#pickle.loads>
--> 698 return pickle.loads(buffer)
699 else:
700 raise ValueError("Object was serialized with an unsupported serialization")
AttributeError: Can't get attribute 'new_block' on <module 'pandas.core.internals.blocks' from '/opt/conda/lib/python3.7/site-packages/pandas/core/internals/blocks.py'>
I already reloaded the session + sent "abcdef" from one step to another.
There must be somethign in the dataframe that messes up the transfer.
The problem is between my pipeline step:
Inf_MakePrediction -> Inf_sendToFB
Thank you guys in advance and keep up the great work!Arnzok
10/25/2021, 8:34 AMArnzok
10/25/2021, 8:35 AMTraceback (most recent call last):
File "/usr/local/bin/orchest", line 8, in <module>
sys.exit(__entrypoint())
File "/usr/local/lib/python3.8/site-packages/app/cli/main.py", line 84, in __entrypoint
typer_app()
File "/usr/local/lib/python3.8/site-packages/typer/main.py", line 214, in __call__
return get_command(self)(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1128, in __call__
return self.main(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1053, in main
rv = self.invoke(ctx)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1659, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1637, in invoke
super().invoke(ctx)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1395, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 754, in invoke
return __callback(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/typer/main.py", line 500, in wrapper
return callback(**use_params) # type: ignore
File "/usr/local/lib/python3.8/site-packages/app/cli/start.py", line 50, in _default
reg(port, log_level, cloud, dev)
File "/usr/local/lib/python3.8/site-packages/app/cli/start.py", line 93, in reg
container_config = get_container_config(port, cloud, dev, log_level)
File "/usr/local/lib/python3.8/site-packages/app/spec.py", line 131, in get_container_config
config = get_reg_container_config(port, env)
File "/usr/local/lib/python3.8/site-packages/app/spec.py", line 168, in get_reg_container_config
env = utils.get_env()
File "/usr/local/lib/python3.8/site-packages/app/utils.py", line 50, in get_env
env["ORCHEST_HOST_GID"] = str(os.stat("/orchest-host/orchest").st_gid)
FileNotFoundError: [Errno 2] No such file or directory: '/orchest-host/orchest'
Eliezer de Souza da Silva
10/25/2021, 8:46 AM-
in the name, although in theory it should accept that as well)Eliezer de Souza da Silva
10/25/2021, 12:37 PMRick Lamers
Rick Lamers
pandas
code, give https://github.com/modin-project/modin a shot!
# import pandas as pd
import modin.pandas as pd
Serhii
10/29/2021, 12:17 PMSerhii
10/29/2021, 1:43 PMSerhii
11/01/2021, 9:27 AMSerhii
11/01/2021, 10:23 AMRick Lamers
Serhii
11/03/2021, 8:13 AMSerhii
11/04/2021, 8:48 AMSerhii
11/04/2021, 12:52 PMRick Lamers
Serhii
11/10/2021, 8:52 AMSerhii
11/12/2021, 12:33 PMSerhii
11/13/2021, 8:42 AMAbid
11/16/2021, 6:55 PMSerhii
11/23/2021, 7:49 AMAbid
11/25/2021, 11:44 AMSerhii
11/30/2021, 8:57 AM