Jeff Kim created KAFKA-18610: -------------------------------- Summary: Add flush metrics to runtime Key: KAFKA-18610 URL: https://issues.apache.org/jira/browse/KAFKA-18610 Project: Kafka Issue Type: Sub-task Reporter: Jeff Kim Assignee: Jeff Kim
Add 3 metrics # flush-interval-ms-\{max, p99, p999}: track how long it takes from when a batch is first created, to right before writing to disk. The bulk of the time will represent the time spent in the timer, waiting to execute the task. # records-size-bytes-\{max, p99, p999}: Write events generate records in the runtime. Most of the time, the generated records have to be appended atomically into the same batch. If any atomic records exceed __consumer_offset's `max.message.bytes`, the runtime throws RecordTooLargeException. # flush-batch-size-\{max, p99, p999}: Track the size of the batch that is flushed. Note that multiple atomic records can be batched together. This helps identify how large batches become before they are written, or whether they hit the max bytes. -- This message was sent by Atlassian Jira (v8.20.10#820010)