Re: Metrics for Log Compaction

2016-04-15 Thread Manikumar Reddy
Hi, log compaction related JMX metric object names are given below. kafka.log:type=LogCleaner,name=cleaner-recopy-percent kafka.log:type=LogCleaner,name=max-buffer-utilization-percent kafka.log:type=LogCleaner,name=max-clean-time-secs kafka.log:type=LogCleanerManager,name=max-dirty-percent Afte

Re: Metrics for Log Compaction

2016-04-15 Thread Manikumar Reddy
Hi, kafka.log:type=LogCleaner,name=cleaner-recopy-percent kafka.log:type=LogCleanerManager,name=max-dirty-percent kafka.log:type=LogCleaner,name=max-clean-time-secs After every compaction cycle, we also print some useful statistics to logs/log-cleaner.log file. On Wed, Apr 13, 2016 at 7:16

Metrics for Log Compaction

2016-04-13 Thread Kasim Doctor
Hi everyone, We are starting to use log compaction for one of our topics and I was wondering if there are any specific metrics exposed to monitor how often compaction took place and/or how many records (with some metadata related to partition) were deleted ? I looked at JMX metrics that Kafka