Re: Sliding Event Time Window Processing: Window Function inconsistent behavior

2017-01-12 Thread Aljoscha Krettek
Great! Thanks for letting us know. On Wed, 11 Jan 2017 at 12:44 Sujit Sakre wrote: > Hi Aljoscha, > > I have realized that the output stream is not defined separately in the > code below, and hence the input values are getting in the sink. After > defining a separate output stream it works. > >

Re: Sliding Event Time Window Processing: Window Function inconsistent behavior

2017-01-11 Thread Sujit Sakre
Hi Aljoscha, I have realized that the output stream is not defined separately in the code below, and hence the input values are getting in the sink. After defining a separate output stream it works. We have now confirmed that the windows are processed separately as per the groupings. Thanks. *

Re: Sliding Event Time Window Processing: Window Function inconsistent behavior

2017-01-10 Thread Sujit Sakre
Hi Aljoscha, Thanks. I have used the following code for testing: main keyedStream.keyBy(4) .window(SlidingEventTimeWindows.of(Time.minutes6), Time.minutes(2))) // 6 min window with 2 min sliding window .apply(new CustomSlidingWindowFunction()); keyedStream.addSink(new SinkFunction>() { /** *

Re: Sliding Event Time Window Processing: Window Function inconsistent behavior

2017-01-10 Thread Aljoscha Krettek
Hi, instead of writing to files, could you please simply output a value using the Collector and then write the result stream of the window operation to a sink (such as a file sink) to see how many windows are being processed. Having side effects (especially output) in user functions can lead to pro

Re: Sliding Event Time Window Processing: Window Function inconsistent behavior

2017-01-10 Thread Sujit Sakre
Hi, In the link ( http://stackoverflow.com/questions/41143518/sliding-processing-time-window-computes-inconsistent-results), Fabian has mentioned that if Event Time is used, consistent results are possible. However, that's not the case with us. We are getting very random results. Please suggest.

Sliding Event Time Window Processing: Window Function inconsistent behavior

2017-01-09 Thread Sujit Sakre
Hi, We are using Sliding Event Time Window with Kafka Consumer. The window size is 6 minutes, and slide is 2 minutes. We have written a window function to select a particular window out of multiple windows for a keyed stream, e.g. we select about 16 windows out of multiple windows for the keyed st

Sliding Event Time Window Processing: Window Function inconsistent behavior

2017-01-09 Thread Sujit Sakre
Hi, We are using Sliding Event Time Window with Kafka Consumer. The window size is 6 minutes, and slide is 2 minutes. We have written a window function to select a particular window out of multiple windows for a keyed stream, e.g. we select about 16 windows out of multiple windows for the keyed st