Re: CEP and slightly out of order elements

2016-10-11 Thread Sameer W
Thanks Till - This is helpful to know. Sameer On Tue, Oct 11, 2016 at 12:20 PM, Till Rohrmann wrote: > Hi Sameer, > > the CEP operator will take care of ordering the elements. > > Internally what happens is that the elements are buffered before being > applied to the state machine. The operator

Re: CEP and slightly out of order elements

2016-10-11 Thread Till Rohrmann
Hi Sameer, the CEP operator will take care of ordering the elements. Internally what happens is that the elements are buffered before being applied to the state machine. The operator only applies the elements after it has seen a watermark which is greater than the timestamps of the elements being

CEP and slightly out of order elements

2016-10-11 Thread Sameer W
Hi, If using CEP with event-time I have events which can be slightly out of order and I want to sort them by timestamp within their time-windows before applying CEP- For example, if using 5 second windows and I use the following ds2 = ds.keyBy.window(TumblingWindow(10 seconds).apply(/*Sort by Ti