Re: How to delete defunct topics

2015-02-08 Thread Jagbir Hooda
Hi Joel, The mbean approach depends upon storing traffic stats over a period of time, so is doable but complex. I am thinking about another approach to check logfiles time-stamp (to check producer activity) in conjunction with the mtime for topic offsets (consumers activity). So if both timestamp

Re: How to delete defunct topics

2015-02-05 Thread Joel Koshy
There are mbeans (http://kafka.apache.org/documentation.html#monitoring) that you can poke for incoming message rate - if you look at those over a period of time you can figure out which of those are likely to be defunct and then delete those topics. On Thu, Feb 05, 2015 at 02:38:27PM -0800, Jagbi

How to delete defunct topics

2015-02-05 Thread Jagbir Hooda
First I would like to take this opportunity to thank this group for releasing 0.8.2.0. It's a major milestone with a rich set of features. Kudos to all the contributors! We are still running 0.8.1.2 and are planning to upgrade to 0.8.2.0. While planning this upgrade we discovered many topics that a