Re: coordination of sinks

2020-08-17 Thread Fabian Hueske
Hi Marco, You cannot really synchronize data that is being emitted via different streams (without bringing them together in an operator). I see two options: 1) emit the event to create the partition and the data to be written into the partition to the same stream. Flink guarantees that records d

coordination of sinks

2020-08-14 Thread Marco Villalobos
Given a source that goes into a tumbling window with a process function that yields two side outputs, in addition to the main data stream, is it possible to coordinate the order of completion of sink 1, sink 2, and sink 3 as data leaves the tumbling window? source -> tumbling window -> process fun