Roman Khachatryan created FLINK-21504:
-----------------------------------------
Summary: Enrich checkpoint barriers with information previous
checkpoint(s)
Key: FLINK-21504
URL: https://issues.apache.org/jira/browse/FLINK-21504
Project: Flink
Issue Type: Improvement
Components: Runtime / Checkpointing
Reporter: Roman Khachatryan
Assignee: Roman Khachatryan
As discussed in
[https://lists.apache.org/thread.html/r0b90330094ef356997399e4b657e42e6b09fdd731d3069d8bb9841d9%40%3Cdev.flink.apache.org%3E]
FLIP-151 and FLIP-158 would benefit from adding latest confirmed checkpoint id
to the checkpoint barriers and RPC.
More specifically, knowing the latest confirmed checkpoint at the time of
performing a new one would allow to:
* avoid otherwise unnecessary re-uploading of state changes
* cleanup state changes uploaded to DFS and sent to JM but not used by the JM
Adding earliest non-subsumed checkpoint ID would be another way to prevent
FLINK-21351.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
