Mickael Maison created KAFKA-9175: ------------------------------------- Summary: MirrorMaker 2 emits invalid topic partition metrics Key: KAFKA-9175 URL: https://issues.apache.org/jira/browse/KAFKA-9175 Project: Kafka Issue Type: Bug Components: KafkaConnect Affects Versions: 2.4.0 Reporter: Mickael Maison Assignee: Mickael Maison Attachments: image-2019-11-12-17-42-45-773.png
While looking at MirrorMaker 2 metrics with [~ecomar], we noticed the topic partition metrics were invalid. !image-2019-11-12-17-42-45-773.png! The topic spp.hello is not receiving any records but its metrics are constantly updating. The issue is in MirrorMetrics.PartitionMetrics. In the constructor, Sensors are built using metrics.sensor() with a name that does not include the topic partition. metrics.sensor() does not always create a new Sensor but can return an existing Sensor if one exists for the specified name. So in practice, if a Task is handling many topic partitions, they all share the same Sensors! This renders the topic partition metrics unusable and really prevents monitoring MirrorMaker 2. -- This message was sent by Atlassian Jira (v8.3.4#803005)