Nicolas Guyomar created KAFKA-13408:
---------------------------------------

             Summary: Add a new metric to track invalid task provided offset
                 Key: KAFKA-13408
                 URL: https://issues.apache.org/jira/browse/KAFKA-13408
             Project: Kafka
          Issue Type: Improvement
          Components: KafkaConnect
            Reporter: Nicolas Guyomar


Hi team,

Whenever a task provide invalid offset back to the framework, we log a warn 
message but we do not track yet a dedicated metric for those

In some situations where the Sink connector task implements the precommit 
method and has a bug in the way it tracks assigned topic/partition this could 
lead to a task not reporting offset at all thus no offset is being tracked on 
the consumer group in Kafka and can go undetected if we rely on the existing 
JMX beans for offset commit

This improvement Jira is to add a dedicated JMX Metric to be able to alert if 
such invalid offset are provided too often or for too long

 

Thank you



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to