Hi all,

I am using beam 2.23 (java), and flink 1.10.2, my pipeline is quite simple
read from a kafka topic and write to another kafka topic.

When I enabled checkpoint, I see the memory usage of the flink job manager
keeps on growing
[image: image.png]

The Flink cluster is running on kubernetes, with 1 job manager, and 12 task
managers each with 4 slots, kafka input topic has 96 partitions. The
checkpoint is stored in azure blob storage.

Checkpoint happens every 3 seconds, with timeout 10 seconds, with minimum
pause of 1 second.

Any ideas why this happens?
Thanks a lot!
Eleanore

Reply via email to