Hi team,

We want to know if Flink has some dynamic configuration of the checkpoint
interval. Our use case has a cold start phase where the entire dataset is
replayed from the beginning until the most recent ones.

In the cold start phase, the resources are fully utilized and the
backpressure is high for all upstream operators, causing the checkpoint
timeout constantly. The real production traffic is far less than that and
the current provisioned resource is capable of handling it.

We're thinking if Flink can support the dynamic checkpoint config to bypass
the checkpoint operation or make it less frequent on the cold start phase
to speed up the process, while making the checkpoint normal again once the
cold start is completed.

-- 
*Best wishes,*
*- Kai*

Reply via email to