dumping JMX data

You can do the following on the kafka server itself after setting up jmxremote for port -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port= kafka-run-class.sh kafka.tools.JmxToo

Re: dumping JMX data

If I'm not mistaken jmxtrans does not let you take All metrics beans or just a group of them using wildcard. You are forced to specify the exact bean name which this email shows how cumbersome this is. Also jmxtrans issue an rpc call per bean while using Jolokia you do one post request to get all t

Re: dumping JMX data

Yah +1.. i was considering making it an option. And wrapping it with https://github.com/fabric8io/agent-bond if you want to run it alongside other agents. On Thu, Mar 31, 2016 at 9:21 PM, Gerard Klijs wrote: > Don't know if adding it to Kafka is a good thing. I assume you need some > java opts

Re: dumping JMX data

Why not use tools like jmxtrans and send your metrics to Graphite/OpenTsdb.etc? Why do serialization/de-serialization twice? On Fri, Apr 1, 2016 at 9:51 AM, Gerard Klijs wrote: > Don't know if adding it to Kafka is a good thing. I assume you need some

Re: dumping JMX data

Don't know if adding it to Kafka is a good thing. I assume you need some java opts settings for it to work, and with other solutions these would be different. It could be enabled with an option off course, then it's not in the way if you use something else. We use zabbix, this is a single tool whic

Re: dumping JMX data

Another +1 for Jolokia. We've got a pretty cool setup here that deploys Jolokia alongside Kafka, and we wrote a small Sensu plugin to grab all the stats from Jolokia's JSON API and reformat them for Graphite. On Thu, Mar 31, 2016 at 4:36 PM, craig w wrote: > Including jolokia would be great, I'v

Re: dumping JMX data

Including jolokia would be great, I've used for kafka and it worked well. On Mar 31, 2016 6:54 PM, "Christian Posta" wrote: > What if we added something like this to Kafka? https://jolokia.org > I've added a JIRA to do that, just haven't gotten to it yet. Will soon > though, especially if it'd be

Re: dumping JMX data

What if we added something like this to Kafka? https://jolokia.org I've added a JIRA to do that, just haven't gotten to it yet. Will soon though, especially if it'd be useful for others. https://issues.apache.org/jira/browse/KAFKA-3377 On Thu, Mar 31, 2016 at 2:55 PM, David Sidlo wrote: > The K

Re: dumping JMX data

The Kafka JmxTool works fine although it is not user friendly, in that you cannot perform a query of the Kafka Server mbeans to determine content and to determine the path-string that you need to place into the -object-name option. Here's how I solved the problem... First, make sure that Kafka

Re: dumping JMX data

Just had a quick look at this and it turns out the object name you are passing is incorrect. I had to change it to: ./kafka-run-class.sh kafka.tools.JmxTool --object-name 'kafka.server:name=UnderReplicadPartitions,type=ReplicaManager' --jmx-url service:jmx:rmi:///jndi/rmi://localhost:/jmxr

Re: dumping JMX data

Hi Scott, A quick look at the JmxTool code suggests that it probably isn't able to find the attribute for that MBean, although that MBean does seem to have 1 attribute named Value (I used jconsole to check that). The output you are seeing is merely the date (without any format) being printed o

Re: dumping JMX data

So, related question. If I query for a specific object name, I always seem to get UNIX time: ./bin/kafka-run-class.sh kafka.tools.JmxTool --object-name '"kafka.server":name="UnderReplicatedPartitions",type="ReplicaManager"' --jmx-url service:jmx:rmi:///jndi/rmi://localhost:/jmxrmi always retu

Re: dumping JMX data

Thanks, that second one might be material. I find that if I run without any arguments I get no output and it just keeps running. *sigh* On Sat Jan 17 2015 at 7:58:52 PM Manikumar Reddy wrote: > JIRAs related to the issue are > > https://issues.apache.org/jira/browse/KAFKA-1680 > https://issues.a

Re: dumping JMX data

JIRAs related to the issue are https://issues.apache.org/jira/browse/KAFKA-1680 https://issues.apache.org/jira/browse/KAFKA-1679 On Sun, Jan 18, 2015 at 3:12 AM, Scott Chapman wrote: > While I appreciate all the suggestions on other JMX related tools, my > question is really about the JMXTool i

Re: dumping JMX data

While I appreciate all the suggestions on other JMX related tools, my question is really about the JMXTool included in and documented in Kafka and how to use it to dump all the JMX data. I can get it to dump some mbeans, so i know my config is working. But what I can't seem to do (which is describe

Re: dumping JMX data

On Fri, Jan 16, 2015 at 5:52 PM, Joe Stein wrote: > Here are some more tools for that > https://cwiki.apache.org/confluence/display/KAFKA/JMX+Reporters depending > on what you have in place and what you are trying todo different options > exist. > > A lot of folks like JMX Trans. We tried JMX Tra

Re: dumping JMX data

Hi Scott, http://sematext.com/spm is one of the services Joe was referring to. Jmxc is a command line tool that will dump JMX, see Sematext github account. Otis > On Jan 16, 2015, at 21:00, Scott Chapman wrote: > > Thanks, I actually ran into those already. I was hoping just to be able to

Re: dumping JMX data

Thanks, I actually ran into those already. I was hoping just to be able to dump the JMX data plain and simple. I can consume it with other tools but I am mostly just trying to get the metrics in some format... any format. I have some limitations on what I can build/run, so hoping I can just levera

Re: dumping JMX data

Here are some more tools for that https://cwiki.apache.org/confluence/display/KAFKA/JMX+Reporters depending on what you have in place and what you are trying todo different options exist. A lot of folks like JMX Trans. My favorite quick out of the box is using https://github.com/airbnb/kafka-stat

dumping JMX data

I appologize in advance for a noob question, just getting started with kafka, and trying to get JMX data from it. So, I had thought that running the JXMTool with no arguments would dump all the data, but it doesn't seem to return. I do know I can query for a specific Mbean name seems to work. But