Re: Custom Partitioning and windowing questions/concerns

2017-01-25 Thread Fabian Hueske
s, > > Department of Computer Science > > University of Pittsburgh > > > > *From:* Fabian Hueske [mailto:fhue...@gmail.com] > *Sent:* Wednesday, January 25, 2017 12:28 PM > > *To:* user@flink.apache.org > *Subject:* Re: Custom Partitioning and windowing questi

RE: Custom Partitioning and windowing questions/concerns

2017-01-25 Thread Katsipoulakis, Nikolaos Romanos
. Katsipoulakis, Department of Computer Science University of Pittsburgh From: Fabian Hueske [mailto:fhue...@gmail.com] Sent: Wednesday, January 25, 2017 12:28 PM To: user@flink.apache.org Subject: Re: Custom Partitioning and windowing questions/concerns Hi Nikos, you are of course right. I forgot that

Re: Custom Partitioning and windowing questions/concerns

2017-01-25 Thread Fabian Hueske
hat the intentions for my use-case were not > quite clear. Please, do not hesitate to ask me for any clarifications. > > > > Again, thank you very much for your interest and your time. > > > > Kind Regards, > > > > Nikos R. Katsipoulakis, > > Department of Co

RE: Custom Partitioning and windowing questions/concerns

2017-01-24 Thread Katsipoulakis, Nikolaos Romanos
From: Fabian Hueske [mailto:fhue...@gmail.com] Sent: Tuesday, January 24, 2017 5:15 AM To: user@flink.apache.org Subject: Re: Custom Partitioning and windowing questions/concerns Hi Nikos, Flink's windows require a KeyedStream because they use the keys to manage their internal state (each in-pr

Re: Custom Partitioning and windowing questions/concerns

2017-01-24 Thread Fabian Hueske
Hi Nikos, Flink's windows require a KeyedStream because they use the keys to manage their internal state (each in-progress window has some state that needs to be persisted and checkpointed). Moreover, Flink's event-time window operators return a deterministic result. In your use-case, the result o