[
https://issues.apache.org/jira/browse/FLINK-23139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roman Khachatryan updated FLINK-23139:
--------------------------------------
Summary: State ownership: track and discard private state (changelog)
(was: State ownership: track and discard private state)
> State ownership: track and discard private state (changelog)
> ------------------------------------------------------------
>
> Key: FLINK-23139
> URL: https://issues.apache.org/jira/browse/FLINK-23139
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / State Backends
> Reporter: Roman Khachatryan
> Priority: Major
> Fix For: 1.14.0
>
>
> (materialized and non-materialized, only changelog backend)
>
> TM should own changelog backend state to prevent re-uploading state on
> checkpoint abortion (or missing confirmation). A simpler solution to only own
> aborted state is less maintanable in the long run.
> For that, on TM state should be tracked and discarded (on
> subsumption+materialization; on shutdown). Both materialized and
> non-materialized.
> See [state ownership design
> doc|https://docs.google.com/document/d/1NJJQ30P27BmUvD7oa4FChvkYxMEgjRPTVdO1dHLl_9I/edit?usp=sharing],
> in particular [Tracking private
> state|https://docs.google.com/document/d/1NJJQ30P27BmUvD7oa4FChvkYxMEgjRPTVdO1dHLl_9I/edit#heading=h.osle3oyzw0bx].
>
> Rescaling not supported until shared state management implemented.
>
> Externalized checkpoints and savepoints should be supported (or please create
> a separate ticket).
>
> Retained checkpoints is a separated ticket: FLINK-23251
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
