Re: implementing a continuous time window

2016-04-22 Thread Jonathan Yom-Tov
Thanks for taking the time. That seems like it would complicated without good knowledge of the overall architecture. I might give it a shot anyway. On Fri, Apr 22, 2016 at 4:22 PM, Fabian Hueske wrote: > Hi Jonathan, > > I thought about your use case again. I'm afraid, the approach I proposed >

Re: implementing a continuous time window

2016-04-22 Thread Fabian Hueske
Hi Jonathan, I thought about your use case again. I'm afraid, the approach I proposed is not working due to limitations of the Evictor interface. The only way that I see to implement you use case is to implement a custom stream operator by extending AbstractStreamOperator and implementing the OneI

Re: implementing a continuous time window

2016-04-21 Thread Jonathan Yom-Tov
Thanks. Any pointers on how to do that? Or code examples which do similar things? On Thu, Apr 21, 2016 at 10:30 PM, Fabian Hueske wrote: > Yes, sliding windows are different. > You want to evaluate the window whenever a new element arrives or an > element leaves because 5 secs passed since it en

Re: implementing a continuous time window

2016-04-21 Thread Fabian Hueske
Yes, sliding windows are different. You want to evaluate the window whenever a new element arrives or an element leaves because 5 secs passed since it entered the window, right? I think that should be possible with a GlobalWindow, a custom Trigger which holds state about the time when each element

Re: implementing a continuous time window

2016-04-21 Thread Jonathan Yom-Tov
I think sliding windows are different. In the example in the blog post a window is computed every 30 seconds (so at fixed time intervals). What I want is for a window to be computed every time an event comes in and then once again when the event leaves the window. On Thu, Apr 21, 2016 at 10:14 PM,

Re: implementing a continuous time window

2016-04-21 Thread John Sherwood
You are looking for sliding windows: https://flink.apache.org/news/2015/12/04/Introducing-windows.html Here you would do .timeWindow(Time.seconds(5), Time.seconds(1)) On Thu, Apr 21, 2016 at 12:06 PM, Jonathan Yom-Tov wrote: > hi, > > Is it possible to implement a continuous time window with f

implementing a continuous time window

2016-04-21 Thread Jonathan Yom-Tov
hi, Is it possible to implement a continuous time window with flink? Here's an example. Say I want to count events within a window. The window length is 5 seconds and I get events at t = 1, 2, 7, 8 seconds. I would then expect to get events with a count at t = 1 (count = 1), t = 2 (count = 2), t =