Fu Kai created FLINK-22805:
------------------------------

             Summary: Dynamic configuration of Flink checkpoint interval
                 Key: FLINK-22805
                 URL: https://issues.apache.org/jira/browse/FLINK-22805
             Project: Flink
          Issue Type: New Feature
          Components: Runtime / Checkpointing
    Affects Versions: 1.13.1
            Reporter: Fu Kai
             Fix For: 1.14.0


Flink currently does not support dynamic configuration of checkpoint interval 
on the fly. It's useful for use cases like backfill/cold-start from a stream 
containing whole history.

 
In the cold-start phase, resources are fully utilized and the back-pressure is 
high for all upstream operators, causing the checkpoint timeout constantly. The 
real production traffic is far less than that and the provisioned resource is 
capable of handling it. 
 
With the dynamic checkpoint interval configuration, the cold-start process can 
be speeded up with less frequent checkpoint interval or even turned off. After 
the process is completed, the checkpoint interval can be updated to normal.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to