[
https://issues.apache.org/jira/browse/BEAM-14044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Ye updated BEAM-14044:
---------------------------
Description:
Hook into the batching DoFn APIs to the base RunInference interface.
We should also investigate what defaults we should set for batching, and
perhaps make that part of the API.
See
[s.apache.org/batched-dofns|https://www.google.com/url?q=http://s.apache.org/batched-dofns&sa=D&source=docs&ust=1646063987404027&usg=AOvVaw1VO9QgWlbAhx0Rh2Bzl1nw]
for more details.
was:
Hook into the batching DoFn APIs to the base RunInference interface.
We should also investigate what defaults we should set for batching, and
perhaps make that part of the API.
> Hook In Batching DoFn Apis to RunInference
> ------------------------------------------
>
> Key: BEAM-14044
> URL: https://issues.apache.org/jira/browse/BEAM-14044
> Project: Beam
> Issue Type: Sub-task
> Components: sdk-py-core
> Reporter: Ryan Thompson
> Priority: P2
>
> Hook into the batching DoFn APIs to the base RunInference interface.
> We should also investigate what defaults we should set for batching, and
> perhaps make that part of the API.
> See
> [s.apache.org/batched-dofns|https://www.google.com/url?q=http://s.apache.org/batched-dofns&sa=D&source=docs&ust=1646063987404027&usg=AOvVaw1VO9QgWlbAhx0Rh2Bzl1nw]
> for more details.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
