Re: Ganglia Metrics Reporter

2013-11-01 Thread Andrew Otto
Hmm, It looks as though adding multicast support is more an issue with the Metrics code rather than with kafka-ganglia. The only way I could see to tell GangliaReporter to use multicast when sending messages was to pass it a GangliaMessageBuilder that constructed GangliaMessages using a proper

Re: Ganglia Metrics Reporter

2013-10-29 Thread Maxime Brugidou
Hi Andrew, how do you plan to use metrics 3.0.1? The current Kafka 0.8 version uses 2.2 AFAIK so this is going to require a new Kafka version. I don't really use multicast TTL muself but you are right that this should be configurable and I'll definitely accept pull request going in that direction.

Re: Ganglia Metrics Reporter

2013-10-29 Thread Andrew Otto
Hi Maxime, I'm using this at the Wikimedia Foundation to send Kafka Broker metrics to Ganglia. However, we use Ganglia in multicast mode. This mostly seems to work with your code, but the ttl on the multicast packets gets set at 1. We have sometimes have multiple levels of ganglia aggregator

Re: Ganglia Metrics Reporter

2013-08-25 Thread Andrew Headrick
FYI.. We wrote a library that is essentially the exact same thing as metrics. The only reason we didn't use metrics was because it didn't exist yet. There is a graphite reporter which could be purposed for metrics. https://github.com/ticketfly/pillage https://github.com/Ticketfly/pillage/blob/mas

Re: Ganglia Metrics Reporter

2013-08-23 Thread Jun Rao
That would be great. Thanks, Jun On Fri, Aug 23, 2013 at 7:04 AM, Andrew Otto wrote: > Jun, > > Note that the puppet module README I liked to isn't a full jmxtrans > example JSON query. It is a jmxtrans puppet module usage example. So, > using that in puppet will generate a .json file contai

Re: Ganglia Metrics Reporter

2013-08-23 Thread Andrew Otto
Jun, Note that the puppet module README I liked to isn't a full jmxtrans example JSON query. It is a jmxtrans puppet module usage example. So, using that in puppet will generate a .json file containing the query. We'll be moving to 0.8 in the next coming months, and I'll try to get some real

Re: Ganglia Metrics Reporter

2013-08-22 Thread Jun Rao
I added a JMX reporter wiki page: https://cwiki.apache.org/confluence/display/KAFKA/JMX+Reporters , which is linked from our main wiki page. Could you add a short description (including the supported version) and a link there? Thanks, Jun On Thu, Aug 22, 2013 at 8:42 AM, Maxime Brugidou wrote:

Re: Ganglia Metrics Reporter

2013-08-22 Thread Andrew Otto
Cool! At WMF, we use jmxtrans to do this: https://github.com/jmxtrans/jmxtrans And, if you use puppet, here's a nice little module to help generate jmxtrans json files, and an example of metrics we were sending to Ganglia from Kafka 0.7.2. https://github.com/wikimedia/puppet-jmxtrans#kafka-bro