Hi All,
I am thinking about to start a KIP to report "REAL" broker/consumer
fetch latency. Before that, I like to collect any idea or suggestions. I
created https://issues.apache.org/jira/browse/KAFKA-12713.
The fetch latency is an important metric to monitor for the cluster
performance. With ACK=ALL, the produce latency is affected primarily by
broker fetch latency. However, currently the reported fetch latency didn't
reflect the true fetch latency because it sometimes needs to stay in
purgatory and wait for replica.fetch.wait.max.ms when data is not
available. This greatly affects the real P50, P99 etc.
I like to propose a KIP to be able track the real fetch latency for both
broker follower and consumer.
Ming
