Hi Congzian,
My understanding is that if I use AggregateFunction and have Million of
unique elements coming in for the duration of 24hour, then the state of
AggregateFunction will grow huge with those million entries and the
checkpointing would take longer and longer. I thought if i could use
MapS
Hi Ahmad
AFAIK, Flink currently does not support stores incoming elements to a
MapState, maybe the window function[1] can be help
[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/stream/operators/windows.html#window-functions
Best,
Congxian
Ahmad Hassan 于2019年7月25日周四 下午5:58写
Hi,
We have SlidingProcessingTimeWindows running with AggregateFunction and
Window Function. How we use MapState within AggregateFunction to keep
storing incoming elements as we receive Millions of elements over 24
running sliding windows ?
If we don't do that then AggregateFunction state grows b
