Re: Regarding ordering of events

2017-01-09 Thread Abdul Salam Shaikh
Thanks a lot Aljoshca, this was a perfect answer to my vague question. On 09-Jan-2017 4:52 pm, "Aljoscha Krettek" wrote: Hi, to clarify what Kostas said. A "single window" in this case is a window for a given key and time period so the window for "key1" in time t1 to t2 can be processed on a dif

Re: Regarding ordering of events

2017-01-09 Thread Aljoscha Krettek
Hi, to clarify what Kostas said. A "single window" in this case is a window for a given key and time period so the window for "key1" in time t1 to t2 can be processed on a different machine from the window for "key2" in time t1 to t2. Cheers, Aljoscha On Thu, 5 Jan 2017 at 21:56 Kostas Kloudas w

Re: Regarding ordering of events

2017-01-05 Thread Kostas Kloudas
Hi Abdul, Every window is handled by a single machine, if this is what you mean by “partition”. Kostas > On Jan 5, 2017, at 9:21 PM, Abdul Salam Shaikh > wrote: > > Thanks Fabian and Kostas, > > How can I put to use the power of flink as a distributed system ? > > In cases where we have

Re: Regarding ordering of events

2017-01-05 Thread Abdul Salam Shaikh
Thanks Fabian and Kostas, How can I put to use the power of flink as a distributed system ? In cases where we have multiple windows, is one single window handled by one partition entirely or is it spread across several partitions ? On Thu, Jan 5, 2017 at 12:25 PM, Fabian Hueske wrote: > Flink

Re: Regarding ordering of events

2017-01-05 Thread Fabian Hueske
Flink is a distributed system and does not preserve order across partitions. The number prefix (e.g., 1>, 2>, ...) tells you the parallel instance of the printing operator. You can set the parallelism to 1 to have the stream in order. Fabian 2017-01-05 12:16 GMT+01:00 Kostas Kloudas : > Hi Abdu

Re: Regarding ordering of events

2017-01-05 Thread Kostas Kloudas
Hi Abdul, Flink provides no ordering guarantees on the elements within a window. The only “order” it guarantees is that the results referring to window-1 are going to be emitted before those of window-2 (assuming that window-1 precedes window-2). Thanks, Kostas > On Jan 5, 2017, at 11:57 AM, Ab

Regarding ordering of events

2017-01-05 Thread Abdul Salam Shaikh
Hi, I am using a JSON file as the source for the streaming (in the ascending order of the field Umlaufsekunde)which has events as follows: {"event":[{"*Umlaufsekunde*":115}]} {"event":[{"*Umlaufsekunde*":135}]} {"event":[{"*Umlaufsekunde*":135}]} {"event":[{"*Umlaufsekunde*":145}]} {"event":[{"*U