Re: Debugging high log flush latency on a broker.

2015-09-22 Thread Rajiv Kurian
Thanks Steve. I followed your suggestion to get the topics. What is weird is that the bad broker does not get any more traffic (messages or bytes) when this happens. Also I have more than 2 G (out of 28G) free memory according to collectd and running vmstat on the box, so I hope that things don't

Re: Debugging high log flush latency on a broker.

2015-09-22 Thread Steve Miller
There may be more elegant ways to do this, but I'd think that you could just ls all the directories specified in log.dirs in your server.properties file for Kafka. You should see directories for each topicname-partitionnumber there. Offhand it sounds to me like maybe something's evicting