Hi Team, I have two flink Streaming Jobs 1) Flink streaming from KAFKA and writing to s3 2) Fling Streaming from KINESIS (KDS) and writing to s3
Both Jobs have similar checkpoint duration. Job #1 (KAFKA) checkpoint size is only 85KB Job #2 (KINESIS) checkpoint size is 18MB There are no checkpoint failures. But I want to understand why Kinesis streaming has such a huge checkpoint size, is there a way to handle it differently? and reduce the size. Thanks, Vijay