Re: window-like use case

2016-11-07 Thread Aljoscha Krettek
Thanks for the update! Let us know if you need anything. On Fri, 4 Nov 2016 at 20:43 Maciek Próchniak wrote: > Hi Aljoscha, > > I know it's tricky... > > Few weeks ago we decided to implement it without windows, using just > stateful operator and some queues/map per key as state - so yeah, we tr

Re: window-like use case

2016-11-04 Thread Maciek Próchniak
Hi Aljoscha, I know it's tricky... Few weeks ago we decided to implement it without windows, using just stateful operator and some queues/map per key as state - so yeah, we tried to imagine how to do this in plain java and one stream ;) We also process watermarks to evict old events. Fortuna

Re: window-like use case

2016-10-25 Thread Aljoscha Krettek
Hi Maciek, cases like this, where you essentially want to evict elements that are older than a certain threshold while keeping a count of those elements that are not older than that threshold tend to be quite tricky. In order to start thinking about this, how would you implement this case in a non