Re: Which window function to use to start a window at anytime

2017-08-25 Thread Bowen Li
Hi Aljoscha, Thank you very much! We imagined it's going to be very expensive to achieve that, and your answer verified our understanding of how Flink works. Regards, Bowen On Fri, Aug 25, 2017 at 8:18 AM, Aljoscha Krettek wrote: > Hi, > > I'm afraid this is not possible right now because it

Re: Which window function to use to start a window at anytime

2017-08-25 Thread Aljoscha Krettek
Hi, I'm afraid this is not possible right now because it would require keeping state in the WindowAssigner (per key) about what the start timestamp for a specific key is. I think you could emulate that behaviour by having a stateful FlatMap that keeps track of all keys and their respective tim

Which window function to use to start a window at anytime

2017-08-15 Thread Bowen Li
Hi guys, We are trying use Flink to count millions of keyed items of an hour window hourly as `time(SlidingEventTimeWindows.of(1hour, 1hour))`. According to the sliding window doc , all windows are aligne