Re: Watermark advancement in late side output

2020-09-21 Thread orips
Great, thanks -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Watermark advancement in late side output

2020-09-21 Thread Timo Walther
Hi Ori, first of all, watermarks are sent to all side outputs (this is tested here [1]). Thus, operators in the side output branch of the pipeline will work similar to operators in the main branch. When calling `assignTimestampsAndWatermarks`, the inserted operator will erase incoming waterm

Watermark advancement in late side output

2020-09-21 Thread Ori Popowski
Let's say I have an event-time stream with a window and a side output for late data, and in the side output of the late data, I further assign timestamps and do windowing - what is the watermark situation here? The main stream has its own watermark advancement but the side output has its own. Do t