I guess it was already discussed a while ago [1] and the conclusion was that Flink Async I/O is a specific Flink operator and it can’t be used directly from Beam since Beam should provide a unified model and its implementation for all supported runners.
Did a proposed workaround, based on GroupIntoBatches [2], work for you? [1] https://lists.apache.org/thread.html/rc1e087a15036c18564d3147c3570c7d80c4963ff7d48cf8eaf180758%40%3Cuser.beam.apache.org%3E [2] https://beam.apache.org/documentation/transforms/java/aggregation/groupintobatches/ > On 26 Jan 2021, at 22:09, Boyuan Zhang <boyu...@google.com> wrote: > > +dev <mailto:d...@beam.apache.org> > > On Tue, Jan 26, 2021 at 1:07 PM Eleanore Jin <eleanore....@gmail.com > <mailto:eleanore....@gmail.com>> wrote: > Hi community, > > Does Beam support Flink Async I/O operator? if so, can you please share the > doc, and if not, is there any workaround to achieve the same in Beam > semantics? > > https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/asyncio.html > > <https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/asyncio.html> > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65870673 > <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65870673> > > Thanks a lot! > Eleanore
