Given a source that goes into a tumbling window with a process function
that yields two side outputs, in addition to the main data stream, is it
possible to coordinate the order of completion
of sink 1, sink 2, and sink 3 as data leaves the tumbling window?

source -> tumbling window -> process function -> side output tag 1 -> sink
1                                               \-> side output tag 2 ->
sink 2
                                             \-> main stream -> sink 3


sink 1 will create partitions in PostgreSQL for me.
sink 2 will insert data into the partitioned table
sink 3 can happen in any order
but all of them need to finish before the next window fires.

Any advice will help.

Reply via email to