Re: add() method of AggregateFunction not called even though new watermark is emitted

2019-10-15 Thread Vijay Balakrishnan
toringGroupingWindowStream1. Is ist maybe filtering out >> all events? Or is not even the filter function itself called? (Due to your >> comments suggesting it). >> >> Best regards >> Theo >> >> ------------------ >> *Von: *"Vijay Balak

Re: add() method of AggregateFunction not called even though new watermark is emitted

2019-10-15 Thread Vijay Balakrishnan
> *Gesendet: *Dienstag, 15. Oktober 2019 02:01:05 > *Betreff: *Re: add() method of AggregateFunction not called even though > new watermark is emitted > > Hi, > Thx for the replies - Congxian & Dawdi. > Watermarks are advancing.Not sure how to check every new generated &

Re: add() method of AggregateFunction not called even though new watermark is emitted

2019-10-15 Thread Theo Diefenthal
events? Or is not even the filter function itself called? (Due to your comments suggesting it). Best regards Theo Von: "Vijay Balakrishnan" An: "Dawid Wysakowicz" CC: "user" Gesendet: Dienstag, 15. Oktober 2019 02:01:05 Betreff: Re: add() method of Aggr

Re: add() method of AggregateFunction not called even though new watermark is emitted

2019-10-14 Thread Vijay Balakrishnan
Hi, Thx for the replies - Congxian & Dawdi. Watermarks are advancing.Not sure how to check every new generated watermark is reaching end of the window I did check the Flink UI for the currentInputWatermark and it is increasing monotonically. Narrowed down the problem to not calling the windo

Re: add() method of AggregateFunction not called even though new watermark is emitted

2019-10-14 Thread Dawid Wysakowicz
Hi Vijay, Could you check if the Watermark for the aggregate operator advances? You should be able to check that in the Flink WebUI. Could it be that the Watermark does not advance for all of the upstream operators? The watermark for a particular operator is a minimum of watermarks received from a

Re: add() method of AggregateFunction not called even though new watermark is emitted

2019-10-13 Thread Congxian Qiu
Hi Do you mean `*windowStream.aggregate`* do not work for all records or just some records. If for some records, can you try to confirm that the assigned watermark is monotonic increase. If for all records, can you confirm that the watermark has reached the end of the window? In another word, cou