Re: Flink High Availability Data Cleanup

2025-02-06 Thread Zhanghao Chen
: Chen Yang Sent: Thursday, February 6, 2025 6:55 To: Zhanghao Chen Cc: user@flink.apache.org ; Vignesh Chandramohan ; Allison Cheng Subject: Re: Flink High Availability Data Cleanup Hi Zhanghao, Thanks for the quick response! My current restart strategy type is fixed-delay with 10 seconds

Re: Flink High Availability Data Cleanup

2025-02-05 Thread Chen Yang via user
Hi Zhanghao, Thanks for the quick response! My current restart strategy type is fixed-delay with 10 seconds delay as follows. I used the default restart strategy exponential-delaybefore, but see high pressure in the Kafka cluster during incidents. Do you know how long Flink will retain the HA meta

Re: Flink High Availability Data Cleanup

2025-02-04 Thread Zhanghao Chen
Hi Yang, When the job failed temporarily, e.g. due to single machine failure, Flink will retain the HA metadata and try to recover. However, when the job has already reached the terminal failed status (controlled by the restart strategy [1]), Flink will delete all metadata and exit. In your cas