Cool! At WMF, we use jmxtrans to do this: https://github.com/jmxtrans/jmxtrans
And, if you use puppet, here's a nice little module to help generate jmxtrans json files, and an example of metrics we were sending to Ganglia from Kafka 0.7.2. https://github.com/wikimedia/puppet-jmxtrans#kafka-broker-with-jmxtrans-ganglia-output On Aug 22, 2013, at 11:42 AM, Maxime Brugidou <maxime.brugi...@gmail.com> wrote: > Hi all, > > Since I couldn't find any other way to publish kafka metrics to ganglia > from kafka 0.8 (beta), I just published on github a super-simple ganglia > metrics reporter for Kafka. It is configurable through the kafka config > file and you can use it on the broker side and on your consumers/producers. > There is also a feature to exclude some metrics with a regex (useful if you > have many topics/partions). > > Here it is on github: https://github.com/criteo/kafka-ganglia > > Let me know if you have issues/questions. This is using metrics-ganglia > 2.2.0 directly so it is not a ganglia plugin but rather a kafka "add-on". > > I don't know the proper way to distribute this yet for installation on > brokers, it could also be part of some contrib kafka code. > > Cheers, > Maxime
