Re: Method to check if the log-cleaner of a Kafka broker is running or not

2019-04-15 Thread Vincent Maurin
Hi There is a couple of metrics and log produced by the log cleaner https://github.com/apache/kafka/blob/1.0/core/src/main/scala/kafka/log/LogCleaner.scala You can try to monitor that (metrics could be fetched with JMX and for the log you can tweak the log4j properties) Don't forget that the log

Method to check if the log-cleaner of a Kafka broker is running or not

2019-04-12 Thread Karthik Yadav
I have a few brokers which take care of the data of a few applications. I have the log-cleaner for all the brokers enabled with thecleanup.policy as delete. There was an issue a few weeks back where the log-cleaner stopped working in one of the brokers and this led complete disk usage, and it wasn'