A. Sophie Blee-Goldman created KAFKA-12595:
----------------------------------------------
Summary: New Consumer metric for records/bytes committed
Key: KAFKA-12595
URL: https://issues.apache.org/jira/browse/KAFKA-12595
Project: Kafka
Issue Type: New Feature
Components: consumer
Reporter: A. Sophie Blee-Goldman
The current {records/bytes}-consumed-rate metrics are useful to determine the
actual rate of consumption, but I've seen these be misinterpreted to mean the
number/size of records actually _processed_ -- in general these should be the
same but if a consumer drops out of the group, a consumed record will not be
committed and upon rejoin this same record will be re-consumed. This means the
actual rate of processing will be lower than the X-consumed-rate metric.
We should consider adding a records-committed-rate and bytes-committed-rate
metric for users who are interested in the actual processing rate, eg as an
indication of "real" throughput
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
