Re: Apache Flink - Question about TriggerResult.FIRE

2017-11-27 Thread M Singh
Thanks Aljoscha. On Sunday, November 26, 2017 11:21 PM, Aljoscha Krettek wrote: Hi, Yes, after the watermark (or processing-time) pass "end-of-window + allowed-lateness" everything that is stored for a window is deleted. Best,Aljoscha On 25. Nov 2017, at 18:07, M Singh wrote: Hi: An

Re: Apache Flink - Question about TriggerResult.FIRE

2017-11-26 Thread Aljoscha Krettek
Hi, Yes, after the watermark (or processing-time) pass "end-of-window + allowed-lateness" everything that is stored for a window is deleted. Best, Aljoscha > On 25. Nov 2017, at 18:07, M Singh wrote: > > Hi: > > Another question - what happens if the trigger never calls PURGE or > FIRE_AND_

Re: Apache Flink - Question about TriggerResult.FIRE

2017-11-25 Thread M Singh
Hi: Another question - what happens if the trigger never calls PURGE or FIRE_AND_PURGE and only calls FIRE ?  Are the window and it's contents removed after the end time + lateness are exceeded ? Thanks On Monday, November 20, 2017 2:18 AM, Stefan Richter wrote: Hi, "In the first ca

Re: Apache Flink - Question about TriggerResult.FIRE

2017-11-20 Thread Aljoscha Krettek
Hi Mans, For understanding the difference between FIRE and FIRE_AND_PURGE it's helpful to look at the cases where it really makes a difference. In my opinion this only makes a difference when you have event-time windowing and when you have multiple firing for the same window (i.e. multiple firi

Re: Apache Flink - Question about TriggerResult.FIRE

2017-11-20 Thread Stefan Richter
Hi, > > "In the first case, it is a new window without the previous elements, in the > second case the window reflects the old contents plus all changes since the > last trigger." > > I am assuming the first case is FIRE and second case is FIRE_AND_PURGE - I > was thinking that in the first c

Re: Apache Flink - Question about TriggerResult.FIRE

2017-11-17 Thread M Singh
Also, Stefan - You mentioned  "In the first case, it is a new window without the previous elements, in the second case the window reflects the old contents plus all changes since the last trigger." I am assuming the first case is FIRE and second case is FIRE_AND_PURGE - I was thinking that in th

Re: Apache Flink - Question about TriggerResult.FIRE

2017-11-17 Thread M Singh
Thanks Stefan and Aljoscha for your responses. Stefan - When I mentioned "new window" - I meant the next window being created.  Eg:  if the event was in w1 based processing time and the trigger returned FIRE - then after the window function is computed, what happens to the events in that window (

Re: Apache Flink - Question about TriggerResult.FIRE

2017-11-16 Thread Aljoscha Krettek
Yes, all of this is correct. Sliding windows in fact look like completely separate windows to the windowing system. Best, Aljoscha > On 16. Nov 2017, at 10:15, Stefan Richter wrote: > > Hi, > > I think the effect is pretty straight forward, the elements in a window are > not purged if the tr

Re: Apache Flink - Question about TriggerResult.FIRE

2017-11-16 Thread Stefan Richter
Hi, I think the effect is pretty straight forward, the elements in a window are not purged if the trigger is only FIRE and not FIRE_AND_PURGE. Unfortunately, your question is a bit unclear about what exactly you mean by „new window“: a truly „new“ window or another triggering of the previous (n

Re: Apache Flink - Question about TriggerResult.FIRE

2017-11-15 Thread M Singh
Hi Guys Is there any insight into this ? Thanks Mans On Monday, November 13, 2017 11:19 AM, M Singh wrote: Hi Flink Users I have a few questions about triggers: If a trigger returns TriggerResult.FIRE from say the onProcessingTime method - the window computation is triggered but element

Apache Flink - Question about TriggerResult.FIRE

2017-11-13 Thread M Singh
Hi Flink Users I have a few questions about triggers: If a trigger returns TriggerResult.FIRE from say the onProcessingTime method - the window computation is triggered but elements are kept in the window.  If there a second invocation of the onProcessingTime method will the elements from the pr