Re: Monitoring of consumer group lag

2015-03-17 Thread Robin Yamaguchi
Hi Mathias, We call bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker via NRPE, and alert through Nagios. -Robin On Tue, Mar 17, 2015 at 2:46 AM, Kasper Mackenhauer Jacobsen < kas...@falconsocial.com> wrote: > Hi Mathias, > > We're currently using a custom solution that queries kafka and

Changing replication factor for an existing topic

2015-06-10 Thread Robin Yamaguchi
Greetings, With Kafka 0.8.2.1, is there a way to either raise or lower the replication factor of an existing topic? Searching through this list, there was mention that the tool has yet to be developed. It doesn't seem possible still looking at the replication tools wiki, nor with yahoo's kafka m

Re: Changing replication factor for an existing topic

2015-06-12 Thread Robin Yamaguchi
10, 2015, at 4:20 PM, Aditya Auradkar > wrote: > > > > The replica list that you specify can be used to increment/decrement the > replication factor. > > > http://kafka.apache.org/documentation.html#basic_ops_increase_replication_factor > > > > Aditya > > >

Can't find certain mbeans

2014-04-28 Thread Robin Yamaguchi
Greetings, I'm working with Kafka 0.8.1. and setting up monitoring / metrics trending. I've been exploring mbeans on my kafka broker, and unable to find the following based on this documentation: http://kafka.apache.org/081/documentation.html#monitoring 1.) "kafka.log":name="LogFlushRateAndTimeM

Re: Can't find certain mbeans

2014-04-29 Thread Robin Yamaguchi
do you have a topic with at least 2 replicas? The metrics will only > show up if the broker has a follower replica following the leader replica > on another broker. > > For 1), was the flush interval reached? > > Thanks, > > Jun > > > On Mon, Apr 28, 2014 at 4:4

Re: Controller to broker connection timing out through load balancer

2014-05-15 Thread Robin Yamaguchi
0.8.1.1 On Tue, May 13, 2014 at 9:02 PM, Jun Rao wrote: > Which version of Kafka are you using? > > Thanks, > > Jun > > > On Tue, May 13, 2014 at 5:56 PM, Robin Yamaguchi >wrote: > > > It seems like this mailing list wasn't updating through the web ar

Re: Controller to broker connection timing out through load balancer

2014-05-15 Thread Robin Yamaguchi
7:45,841 - INFO [kafka-scheduler-3:Logging$class@68] - Partition [Test1,6] on broker 0: Cached zkVersion [6] not equal to that in zookeeper, skip updating ISR On Thu, May 8, 2014 at 2:19 PM, Robin Yamaguchi wrote: > Greetings, > > I'm looking for some feedback with using adverti

Controller to broker connection timing out through load balancer

2014-05-16 Thread Robin Yamaguchi
Greetings, I'm looking for some feedback with using advertised.host.name and advertised.port on kafka 0.8.1.1 through a load balancer. The brokers are fronted with haproxy to support our cluster mirroring configuration. The setup has been working as expected, where producers, consumers, and brok

Re: Controller to broker connection timing out through load balancer

2014-05-16 Thread Robin Yamaguchi
13 Test2-15 Test2-3 Test2-5 Test2-7 Test2-9 Test3-1 Test3-11 Test3-13 Test3-15 Test3-3 Test3-5 Test3-7 Test3-9 On Wed, May 14, 2014 at 7:57 AM, Jun Rao wrote: > Any error in the controller and state-change log? > > Thanks, > > Jun > > > On Tue, May 13, 2014 at