Re: How & Where does flink stores data for aggregations.

2017-11-24 Thread Piotr Nowojski
Hi, Flink will have to maintain state of the defined aggregations per each window and key (the more names you have, the bigger the state). Flink’s state backend will be used for that (for example memory or rocksdb). However in most cases state will be small and not dependent on the length of t

How & Where does flink stores data for aggregations.

2017-11-23 Thread Shivam Sharma
Hi All, I have a small question regarding where does Flink stores data for doing window aggregations. Lets say I am running following query on Flink table: SELECT name, count(*) FROM testTable GROUP BY TUMBLE(rowtime, INTERVAL '1' MINUTE), name So, If I understand above query properly so it must