Zhanghao Chen created FLINK-29615: ------------------------------------- Summary: MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism Key: FLINK-29615 URL: https://issues.apache.org/jira/browse/FLINK-29615 Project: Flink Issue Type: Bug Components: Runtime / Metrics, Runtime / REST Affects Versions: 1.15.0, 1.16.0 Reporter: Zhanghao Chen Fix For: 1.17.0
*Problem* MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism and users will see metrics of nonexistent subtasks on Web UI (e.g. the task backpressure page) or REST API response. *Proposed Solution* Thanks to [FLINK-29132] SubtaskMetricStore causes memory leak. - ASF JIRA (apache.org) & [FLINK-28588] Enhance REST API for Speculative Execution - ASF JIRA (apache.org), Flink will now update current execution attempts when updating metrics. Since the active subtask info is included in the current execution attempt info, we are able to retain active subtasks using the current execution attempt info. -- This message was sent by Atlassian Jira (v8.20.10#820010)