Pradyumna created KAFKA-10441:
---------------------------------
Summary: Connect consumers are missing the fetch metrics
Key: KAFKA-10441
URL: https://issues.apache.org/jira/browse/KAFKA-10441
Project: Kafka
Issue Type: Bug
Components: consumer, KafkaConnect
Affects Versions: 2.3.0
Reporter: Pradyumna
Kafka connect workers create KafkaConsumers and consume from Kafka topics.
However, unlike regular KafkaConsumers which have a good set of metrics in the
group consumer-fetch-manager-metrics (such as records-lag,
records-consumed-total etc), these KafkaConsumers created by Kafka Connect do
not have any of these consumer metrics.
I took a heap dump and saw that the "sensors" field in the metrics field of the
KafkaConsumer objects created by Kafka Connect had only the connect metrics,
and not the consumer fetch metrics.
I tried briefly to find out where in the Kafka code is the metrics object being
reset or the sensors field of the metrics object overridden by kafka connect,
but I could not locate anything yet.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
