Zhanghao Chen created FLINK-29615:
-------------------------------------

             Summary: MetricStore does not remove metrics of nonexistent 
subtasks when adaptive scheduler lowers job parallelism
                 Key: FLINK-29615
                 URL: https://issues.apache.org/jira/browse/FLINK-29615
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Metrics, Runtime / REST
    Affects Versions: 1.15.0, 1.16.0
            Reporter: Zhanghao Chen
             Fix For: 1.17.0


*Problem*

MetricStore does not remove metrics of nonexistent subtasks when adaptive 
scheduler lowers job parallelism and users will see metrics of nonexistent 
subtasks on Web UI (e.g. the task backpressure page) or REST API response.

 

*Proposed Solution*

Thanks to [FLINK-29132] SubtaskMetricStore causes memory leak. - ASF JIRA 
(apache.org) & [FLINK-28588] Enhance REST API for Speculative Execution - ASF 
JIRA (apache.org),  Flink will now update current execution attempts when 
updating metrics. Since the active subtask info is included in the current 
execution attempt info, we are able to retain active subtasks using the current 
execution attempt info.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to