Re: Can AsyncFunction be applied to connected streams

2017-07-12 Thread Aljoscha Krettek
I think this would not necessarily be a problem. If the async operation is directly after the enrichment operation the enriched operations will be directly forwarded to the async operation. (With a copy step, that can be disabled by enabling object reuse at the StreamExecutionEnvironment) Best,

Re: Can AsyncFunction be applied to connected streams

2017-07-07 Thread PedroMrChaves
Hello, I wanted to keep the data locally, if I associate the fetched metadata with eachevent (in an enrichment phase) it would considerably increase their size since the metadata that I need to process the event in the async I/O is to large. Regards, Pedro. - Best Regards, Pedro Chaves --

Re: Can AsyncFunction be applied to connected streams

2017-07-07 Thread Aljoscha Krettek
Hi, While it’s not possible to directly apply an Async I/O operator to a connected stream you can use a two-stage approach: - Have a CoFlatMap that enriches the elements from the first stream based on the second stream - Use an Async I/O operator right after that, on the enriched stream Would