[ 
https://issues.apache.org/jira/browse/KAFKA-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185907#comment-17185907
 ] 

Pradyumna edited comment on KAFKA-10441 at 8/27/20, 3:12 PM:
-------------------------------------------------------------

Do we need to copy the CommonClientConfigs.METRIC_REPORTER_CLASSES_CONFIG from 
the WorkerConfig to the consumer properties map in this method here?

 

[https://github.com/apache/kafka/blob/2.3/connect/runtime/src/main/java/org/apache/kafka/connect/runtime/Worker.java#L579]

 

so that it get passed into the KafkaConsumer constructor here 
[https://github.com/apache/kafka/blob/2.3/connect/runtime/src/main/java/org/apache/kafka/connect/runtime/Worker.java#L530]


was (Author: pradyumna):
Do we need to copy the CommonClientConfigs.METRIC_REPORTER_CLASSES_CONFIG from 
the WorkerConfig to the consumer properties map in this method here?

 

[https://github.com/apache/kafka/blob/2.3/connect/runtime/src/main/java/org/apache/kafka/connect/runtime/Worker.java#L579]

> Connect consumers are missing the fetch metrics
> -----------------------------------------------
>
>                 Key: KAFKA-10441
>                 URL: https://issues.apache.org/jira/browse/KAFKA-10441
>             Project: Kafka
>          Issue Type: Bug
>          Components: consumer, KafkaConnect
>    Affects Versions: 2.3.0
>            Reporter: Pradyumna
>            Priority: Minor
>
> Kafka connect workers create KafkaConsumers and consume from Kafka topics.
>  
> However, unlike regular KafkaConsumers which have a good set of metrics in 
> the group consumer-fetch-manager-metrics (such as records-lag, 
> records-consumed-total etc), these KafkaConsumers created by Kafka Connect do 
> not have any of these consumer metrics.
>  
> I took a heap dump and saw that the "sensors" field in the metrics field of 
> the KafkaConsumer objects created by Kafka Connect had only the connect 
> metrics, and not the consumer fetch metrics.
>  
> I tried briefly to find out where in the Kafka code is the metrics object 
> being reset or the sensors field of the metrics object overridden by kafka 
> connect, but I could not locate anything yet.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to