It is but everyone has different systems to-do that with (Cacti, Graphite, Ganglia, Riemann, Etc) there are reporters available for them even as a service like from Sematext, Boundary and DataDog too. More of the ecosystem https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem or maybe if you describe your existing environment you can find out what is available for that from the list.
In the performance test https://cwiki.apache.org/confluence/display/KAFKA/Performance+testing there is a built in CSV reporter which you can use this R script https://issues.apache.org/jira/browse/KAFKA-1190 to plot with... you can use Excel to sum/group/filter the CSV has you need too. On Thu, Feb 27, 2014 at 11:58 PM, Dan Hoffman <hoffman...@gmail.com> wrote: > I'm surprised that doesn't already exist - I would think that would be a > common requirement? > > -----Original Message----- > From: Neha Narkhede [mailto:neha.narkh...@gmail.com] > Sent: Thursday, February 27, 2014 11:41 PM > To: users@kafka.apache.org > Subject: Re: How does one measure performance of an existing Kafka cluster? > > The jmx beans will expose the metrics per broker. You would need some > utility to aggregate across all brokers in a cluster. > > Thanks, > Neha > > > On Thu, Feb 27, 2014 at 8:31 PM, Dan Hoffman <hoffman...@gmail.com> wrote: > > > Are the numbers for the entire cluster or just the broker connected to? > > (I'm interested in the former) > > > > > > On Thu, Feb 27, 2014 at 11:26 PM, Jun Rao <jun...@gmail.com> wrote: > > > > > You can take a look at the jmx in > > > http://kafka.apache.org/documentation.html#monitoring > > > > > > Thanks, > > > > > > Jun > > > > > > > > > On Thu, Feb 27, 2014 at 7:50 PM, Dan Hoffman <hoffman...@gmail.com> > > wrote: > > > > > > > Let's say I have a running cluster and users/apps are pounding > > > > away at > > > it. > > > > Is there a quick and easy way to measure its current throughput? I > > > know > > > > there are utilities for generating volume to get stats, but I'd > > > > like to simply get some stats about its current operation. Is > > > > there a good way > > > to > > > > do this? > > > > > > > > > > >
