[
https://issues.apache.org/jira/browse/ARROW-16211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17613130#comment-17613130
]
Weston Pace commented on ARROW-16211:
-------------------------------------
I think both use cases are probably useful and don't think either one precludes
the other. For reference, when referring to UDFs, [~rtpsw] is (I'm pretty
sure) referring to "embedded UDFs". In other words, UDFs whose code is
embedded in a query plan (e.g. pickled python code). In these cases the UDF
only really makes sense in the context of a single plan execution.
There is another case, where some set of UDFs are predefined and then
referenced (e.g. by name) in incoming plans. In that scenario I think a nested
registry is considerably less useful and the ability to unregister or override
would be helpful.
> How do such things work? Does C++ automatically search the parent registry as
> well (that part is not really clear to me)?
Yes, that is the current implementation.
> [C++][Python] Unregister compute functions
> ------------------------------------------
>
> Key: ARROW-16211
> URL: https://issues.apache.org/jira/browse/ARROW-16211
> Project: Apache Arrow
> Issue Type: Sub-task
> Components: C++, Python
> Reporter: Vibhatha Lakmal Abeykoon
> Assignee: Vibhatha Lakmal Abeykoon
> Priority: Major
>
> In general, when using UDFs, the user defines a function expecting a
> particular outcome. When building the program, there needs to be a way to
> update existing function kernels if it expands beyond what is planned before.
> In such situations, there should be a way to remove the existing definition
> and add a new definition. To enable this, the unregister functionality has to
> be included.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
