Re: Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX

2013-10-22 Thread Monika Garg
Thanks a lot Joel. On Tue, Oct 22, 2013 at 11:27 PM, Joel Koshy wrote: > > > (1)"kafka.network":type="RequestChannel",name="Processor-0-ResponseQueueSize", > > > "kafka.network":type="RequestChannel",name="Processor-1-ResponseQueueSize", > > > "kafka.network":type="RequestChannel",name="Proc

Re: Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX

2013-10-22 Thread Joel Koshy
> (1)"kafka.network":type="RequestChannel",name="Processor-0-ResponseQueueSize", > "kafka.network":type="RequestChannel",name="Processor-1-ResponseQueueSize", > "kafka.network":type="RequestChannel",name="Processor-2-ResponseQueueSize" > Im not getting what these Processor in (1) are actually for?

Re: Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX

2013-10-22 Thread Monika Garg
Hi, I am getting some more Mbeans which are not mentioned here- http://kafka.apache.org/documentation.html#monitoring These are: (1)"kafka.network":type="RequestChannel",name="Processor-0-ResponseQueueSize", "kafka.network":type="RequestChannel",name="Processor-1-ResponseQueueSize", "kafka.network

Re: Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX

2013-10-22 Thread Monika Garg
Thanks Jun. On Tue, Oct 22, 2013 at 8:51 PM, Jun Rao wrote: > When a broker goes down, we have an optimization in the controller that > proactively shrinks ISR. The ISR shrink rate only measures the rate that > the leader shrinks ISR and doesn't reflect the shrinking by the controller. > In g

Re: Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX

2013-10-22 Thread Jun Rao
When a broker goes down, we have an optimization in the controller that proactively shrinks ISR. The ISR shrink rate only measures the rate that the leader shrinks ISR and doesn't reflect the shrinking by the controller. In general, having ISR shrink rate stay at 0 is a good thing since it means th

Re: Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX

2013-10-22 Thread Monika Garg
Thanks a lot Jun. Now im getting the values in ISR expansion rate,whenever broker goes down and then up. But still ISR shrink rate is always having value 0. what I have done is: I made 3 node cluster.Than created 5 partitions with replica=3. partitions got distributed on 1,2,3 brokers with isr=

Re: Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX

2013-10-22 Thread Monika Garg
Thanks a lot Jun. Now im getting the values in ISR expansion rate,whenever broker goes down and then up. But still ISR shrink rate is always having value 0. what I have done is: I made 3 node cluster.Than created 5 partitions with replica=3. partitions got distributed on 1,2,3 brokers with isr=

Re: Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX

2013-10-21 Thread Jun Rao
Updated the description in http://kafka.apache.org/documentation.html#monitoring. Does that help make things clearer? Thanks, Jun On Mon, Oct 21, 2013 at 9:43 AM, Monika Garg wrote: > Thanks for replying Neha.It helped me a lot in getting the things more > clear. > I just have some doubts for

Re: Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX

2013-10-21 Thread Monika Garg
Thanks for replying Neha.It helped me a lot in getting the things more clear. I just have some doubts for the value of below Mbeans,please have a look: (1)ISR expansion rate::"kafka.server":name="ISRShrinksPerSec",type="ReplicaManager" ,non-zero only during broker startup. Does the property (1) mea

Re: Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX

2013-10-21 Thread Neha Narkhede
You may find this useful - http://kafka.apache.org/documentation.html#monitoring Let us know how we can improve the documentation further. Thanks, Neha On Mon, Oct 21, 2013 at 5:42 AM, Monika Garg wrote: > Hi, > > I am getting so many Mbeans from My JMX like kafka.server,kafka.network > etc.

Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX

2013-10-21 Thread Monika Garg
Hi, I am getting so many Mbeans from My JMX like kafka.server,kafka.network etc. There are of different types and have a lot of attributes. I am trying to get when the attribute value for any Mbean is getting changed. But no helpful docs I am getting for it on google. Even the terms used like