[
https://issues.apache.org/jira/browse/FLINK-40471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18127322#comment-18127322
]
Liu Liu commented on FLINK-40471:
---------------------------------
Hi [~chenzhuo], sorry for the late response and thanks for working on this. I
took some time to study your PR. It overlaps significantly with another PR I
already have in progress, and there are some significant differences in the
design and implementation that would need to be reconciled:
[https://github.com/apache/flink/pull/29048|https://github.com/apache/flink/pull/29048]
If you don't mind, would you be OK with me continuing this issue through my
existing PR? I'll make sure to consider and incorporate relevant parts from
your implementation. Would that work for you?
> Add per-UDF concurrency and batch size support to DataFrame API
> ---------------------------------------------------------------
>
> Key: FLINK-40471
> URL: https://issues.apache.org/jira/browse/FLINK-40471
> Project: Flink
> Issue Type: Sub-task
> Reporter: Liu Liu
> Assignee: ChenZhuo
> Priority: Major
> Labels: pull-request-available
>
> Support specifying per-UDF concurrency and batch size in UDF creation:
> {code:java}
> def udf(
> func=None,
> *,
> return_dtype: DataType = None,
> deterministic: bool = True,
> name: str = None,
> concurrency: Optional[int] = None, // per-UDF concurrency
> batch_size: Optional[int] = None, // per-UDF batch size
> ) -> DataFrameUDFWrapper {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
