Re: Best approach to aggregate state with idle timeout and periodic output

2025-05-12 Thread Sigalit Eliazov
hi, we have a similar use case, and from my experience it is not simple (if at all) to implement your logic when using a session window. Eventually we used the state + timers approach and we have full control of the cleanup and merge logic. Thanks Sigalit On Mon, May 12, 2025 at 1:35 PM Sachin

Re: Best approach to aggregate state with idle timeout and periodic output

2025-05-12 Thread Sachin Mittal
Second approach is good to try out. I am also solving for a similar problem using this approach only. Thanks Sachin On Mon, 12 May 2025 at 3:52 PM, Ehud Lev wrote: > Hi Flink community, > > We're building a Flink topology that aggregates events by key. When a key > is seen for the first time,

Best approach to aggregate state with idle timeout and periodic output

2025-05-12 Thread Ehud Lev
Hi Flink community, We're building a Flink topology that aggregates events by key. When a key is seen for the first time, we load its base state from an external store. After performing some calculations, we emit the result to Kafka, and another process is responsible for writing it back to the st