Re: Issues with metrics collection

2014-07-31 Thread Joel Koshy
On Thu, Jul 31, 2014 at 11:09:03AM -0700, Kiran Nagasubramanian wrote: > Thanks for the response Jun and Otis. > > Jun, you're right. Only the leaders are reporting. One of the brokers is > not a leader for any of the partitions. Found the following info on the > documentation page: > > leader i

Re: Issues with metrics collection

2014-07-31 Thread Kiran Nagasubramanian
Thanks for the response Jun and Otis. Jun, you're right. Only the leaders are reporting. One of the brokers is not a leader for any of the partitions. Found the following info on the documentation page: leader is the node responsible for all reads and writes for the given partition. Each node wil

Re: Issues with metrics collection

2014-07-31 Thread Otis Gospodnetic
Hi, May also want to share version of Kafka. We have SPM agents for Kafka 0.7.x and 0.8.x and we haven't seen that. Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/ On Wed, Jul 30, 2014 at 10:12 PM, Kiran Nagasubramanian wr

Re: Issues with metrics collection

2014-07-30 Thread Jun Rao
(1) Those metrics are only reported on brokers that are the leader of some partitions. (2) Which jmx collector are you using? Thanks, Jun On Wed, Jul 30, 2014 at 1:12 PM, Kiran Nagasubramanian wrote: > Hello, > > We're collecting the JMX metrics from the Kafka brokers. We're seeing a > coupl

Issues with metrics collection

2014-07-30 Thread Kiran Nagasubramanian
Hello, We're collecting the JMX metrics from the Kafka brokers. We're seeing a couple of issues. Could someone please throw some light if you've come across something similar? 1) We have a 3 broker Kafka cluster and when we're trying to collect the metrics like messages in per sec, bytes in per s