Hi Maxime, I'm using this at the Wikimedia Foundation to send Kafka Broker metrics to Ganglia. However, we use Ganglia in multicast mode. This mostly seems to work with your code, but the ttl on the multicast packets gets set at 1. We have sometimes have multiple levels of ganglia aggregators, and with ttl=1, the multicast packets don't make it to the proper aggregators.
I'm looking into either forking or rewriting this library using Codahale Metrics v 3.0.1, and supporting multicast more explicitly. Is this something you could do better/faster than me, or should I proceed? :) -Andrew Otto (Thanks for writing this, btw!) On Aug 22, 2013, at 11:42 AM, Maxime Brugidou <maxime.brugi...@gmail.com> wrote: > Hi all, > > Since I couldn't find any other way to publish kafka metrics to ganglia > from kafka 0.8 (beta), I just published on github a super-simple ganglia > metrics reporter for Kafka. It is configurable through the kafka config > file and you can use it on the broker side and on your consumers/producers. > There is also a feature to exclude some metrics with a regex (useful if you > have many topics/partions). > > Here it is on github: https://github.com/criteo/kafka-ganglia > > Let me know if you have issues/questions. This is using metrics-ganglia > 2.2.0 directly so it is not a ganglia plugin but rather a kafka "add-on". > > I don't know the proper way to distribute this yet for installation on > brokers, it could also be part of some contrib kafka code. > > Cheers, > Maxime
