Hi Fabian,
> On 4 Jul 2018, at 11:39, Fabian Hueske <fhue...@gmail.com> wrote: > > - Pre-aggregate records in a 5 minute Tumbling window. However, > pre-aggregation does not work for FoldFunctions. > - Implement the window as a custom ProcessFunction that maintains a state of > 288 events and aggregates and retracts the pre-aggregated records. > > Best, Fabian We are finally implementing processFunction to replace Flink Sliding Window. Please can you elaborate how can we implement the sliding window as processfunction like you explained above. I am struggling to understand how will I keep track of what events belong to which window. We have 24hr running sliding window with 5 min slide (288 windows). How do I emulate 288 windows in processfunction with 5 min slide? 288 sliding windows cause flink checkpoints to hang and never finish even in an hour even with MapState RocksDB. So we decide to get rid of sliding window and use process function to implement sliding window logic. Best,
