Hi, I'm trying to implement the most efficient way to incrementally put incoming DataStream elements in my (map)state, while removing old elements (older that x) from that same state. I then want to output the state every y seconds. I've looked into using the ProcessFunction with onTimer, or building my own Trigger for a window function, but I struggle with putting all this together in a logical and efficient way. Since the state is very big I don't want to duplicate it over multiple (sliding)windows. Does anybody know the best way to achieve this? Some pseudo code would be very helpful.
Thanks! -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/