[
https://issues.apache.org/jira/browse/BEAM-9546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17072816#comment-17072816
]
Brian Hulette commented on BEAM-9546:
-------------------------------------
No I was planning on just using python's BatchElements transform for the
batching part, so the entire batch would still look like logically one element,
which will be consistent with what [~robertwb] has implemented so far. I am
very interested in batching in the Fn API and using Arrow for serialization
though.
> Support for batching a schema-aware PCollection and processing as a Dataframe
> -----------------------------------------------------------------------------
>
> Key: BEAM-9546
> URL: https://issues.apache.org/jira/browse/BEAM-9546
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
> Reporter: Brian Hulette
> Assignee: Brian Hulette
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
