Re: One large WindowFunction vs. several smaller ones

2017-08-14 Thread Nico Kruber
Hi Maarten, If the Count-WF is counting the number of events per window and the Diff-WF is just comparing this number to the output of the previous window, then you do not need a WindowFunction for the Diff-WF afterall: Just use your Count-WF and plug in a stateful map (also see [1]) afterwards

One large WindowFunction vs. several smaller ones

2017-08-12 Thread Maarten Hamal
Hi I'm pretty new to Flink and stream processing in general but I'm writing a thesis about it and I have a small question regarding WindowFunctions (WF). I have one large WF that does essentially two things: counting how much events there are in a window and calculating the difference between this