Hi Irakli, If you see the watermarks tab on the operator do you see being propagated? If for example your source has multiple splits (like Kafka partitions) if one is idle or stays behind the watermark won’t be propagated as it is the minimum from all inputs (partitions/splits)
Best On Fri, 20 Oct 2023 at 6:11 PM, irakli.keshel...@sony.com < irakli.keshel...@sony.com> wrote: > Hello, > > I have a Flink application that is consuming events from the Kafka topic > and builds sessions from them. I'm using the Keyed stream. The application > runs fine initially, but after some time it is getting "stuck". I can see > that the "processElement" function is processing the incoming events, but > the onTimer function is never called. I can also see that the Watermark is > getting stale (I guess that's why the onTimer is not called). My window > duration is 1 minute, and the logic lives in onTimer function. Every minute > I delete the old timer and create a new one (again with one minute > duration). If certain logic is fulfilled, then I don't create a new timer > anymore and clear the state. > > The same application is running fine in another environment (this one just > gets more data), because of this I believe the windowing logic has no > flows. I can't find any anomalies in CPU/Memory consumption and the > checkpoints are completed successfully as well. > > Does anyone have similar issues? > > Best, > Irakli >
