Hi, DataSet API Flink 1.1.3
I have an application where I'd like to perform some mapping before batching the results and passing them to the sink. I'm performing a 'composite' key selection to group the items by their natural key as well as a batch (itemCount / batchSize). When I reduce the batches and pass them to the sink, the whole flow is waiting for all reduces to complete before passing them to sink. Is there some way that the results of a single group reduce can be passed to the sink before all reduces are complete? Hope that makes sense, Regards, Paul
