Hi Rico! We have finished the first part of the Window API reworks. You can find the code here: https://github.com/apache/flink/pull/1175
It should fix the issues and offer vastly improved performance (up to 50x faster). For now, it supports time windows, but we will support the other cases in the next days. I'll ping you once it is merged, I'd be curious if it fixes your issue. Sorry that you ran into this problem... Greetings, Stephan On Mon, Sep 7, 2015 at 12:00 PM, Rico Bergmann <i...@ricobergmann.de> wrote: > Hi! > > While working with grouping and windowing I encountered a strange > behavior. I'm doing: > > dataStream.groupBy(KeySelector).window(Time.of(x, > TimeUnit.SECONDS)).mapWindow(toString).flatten() > > > When I run the program containing this snippet it initially outputs data > at a rate around 150 events per sec. (That is roughly the input rate for > the program). After about 10-30 minutes the rate drops down below 5 events > per sec. This leads to event delivery offsets getting bigger and bigger ... > > Any explanation for this? I know you are reworking the streaming API. But > it would be useful to know, why this happens ... > > Cheers. Rico. >
