Hi all, I am using beam 2.23 (java), and flink 1.10.2, my pipeline is quite simple read from a kafka topic and write to another kafka topic.
When I enabled checkpoint, I see the memory usage of the flink job manager keeps on growing [image: image.png] The Flink cluster is running on kubernetes, with 1 job manager, and 12 task managers each with 4 slots, kafka input topic has 96 partitions. The checkpoint is stored in azure blob storage. Checkpoint happens every 3 seconds, with timeout 10 seconds, with minimum pause of 1 second. Any ideas why this happens? Thanks a lot! Eleanore