Re: AllWindowed vs Windowed with 1 key

2017-05-09 Thread Stefan Richter
That is interesting, because already in Flink 1.1.x, windowAll() is implemented as input.keyBy(new DummyKeySelector()).window(). Are you using event time or processing or event time, and most important, do the execution graphs in the web frontend look different in both variants? > Am 08.05.2017

Re: AllWindowed vs Windowed with 1 key

2017-05-08 Thread Adrienne Kole
Hi, Thanks for the reply. So I have 2 cases: 1. timeWindowAll (length, slide).reduce (...) (with parallelism = 1) 2. groupby(someField).timeWindow(length, slide). reduce(...) Lets say case-1 global window, case-2 partitioned window. If I have only one key (for case-2) and I set parallelism=1 fo

Re: AllWindowed vs Windowed with 1 key

2017-05-08 Thread Stefan Richter
Hi, to answer this question, we would first need to know what you mean by „global windows“: using „windowAll()“ or „GlobalWindows“? Also, the answer might depend on the Flink version that you are using. Best, Stefan > Am 07.05.2017 um 23:23 schrieb Adrienne Kole : > > Hi, > > I am doing simp

AllWindowed vs Windowed with 1 key

2017-05-07 Thread Adrienne Kole
Hi, I am doing simple aggregation with a keyed and global windows in flink. When I compare the keyed window aggregation with 1 key and global window (which has parallelism 1) I would expect that both of them would have similar performance. However, keyed stream with 1 key performs with 2x more th