Re: Query regarding tumbling event time windows with ingestion time

2016-11-30 Thread Kostas Kloudas
No problem! Kostas > On Nov 30, 2016, at 7:08 PM, Janardhan Reddy > wrote: > > That makes it clear. > > Thanks > > On Wed, Nov 30, 2016 at 10:15 PM, Kostas Kloudas > wrote: > Hello, > > If you have events: > > A@10m, B@14m, Watermark@15m > C@16m D@25m

Re: Query regarding tumbling event time windows with ingestion time

2016-11-30 Thread Janardhan Reddy
That makes it clear. Thanks On Wed, Nov 30, 2016 at 10:15 PM, Kostas Kloudas < k.klou...@data-artisans.com> wrote: > Hello, > > If you have events: > > A@10m, B@14m, Watermark@15m > C@16m D@25m, Watermark@30m > > then the result will be: > > [A,B]@14.59 > [C,D]@29.59 > > This means that for the

Re: Query regarding tumbling event time windows with ingestion time

2016-11-30 Thread Kostas Kloudas
Hello, If you have events: A@10m, B@14m, Watermark@15m C@16m D@25m, Watermark@30m then the result will be: [A,B]@14.59 [C,D]@29.59 This means that for the next windowing, you will have the elements [A,B]@14.59 and [C,D]@29.59 to window in windows of 5min. Given that they are 15min apart, t

Re: Query regarding tumbling event time windows with ingestion time

2016-11-30 Thread Janardhan Reddy
HI i didn't get it , can you please clarify with an example in case each of operation A and B emit multiple elements. On Wed, Nov 30, 2016 at 3:34 PM, Kostas Kloudas wrote: > Hi Janardhan, > > After the first windowing operation, the timestamp of the emitted element > for each window > will be t

Re: Query regarding tumbling event time windows with ingestion time

2016-11-30 Thread Kostas Kloudas
Hi Janardhan, After the first windowing operation, the timestamp of the emitted element for each window will be the (endOfWindow - 1). So in your case, in the second windowing operation (window by 5) there will be at most one element per window. I hope this answers your question. Kostas > O

Query regarding tumbling event time windows with ingestion time

2016-11-29 Thread Janardhan Reddy
Hi, Suppose we have a stream like this. someStream.timeWindow(Time.minutes(15)).apply { operation A }.keyby("").window(TumblingEventTimeWindows.ofseconds(5)).apply { operation B }.keyby("").window(TumblingEventTimeWindows.ofseconds(5)).apply { operation C } Say operation A emits som