Re: circuit breaker for producer

2015-05-11 Thread mete
t; > On Wed, May 6, 2015 at 3:02 AM, mete wrote: > > > Hey Guozhang, > > > > I could go with both of the options, eventually i want to detect if there > > is a problem and isolate it from the rest of the system. And i am trying > to > > decide what would be th

Re: circuit breaker for producer

2015-05-06 Thread mete
gt; > this kind of functionality into producer; for the latter use case, you > > may > > > want to do this traffic control out of Kafka producer, i.e. upon > > detecting > > > producer buffer full, do not call send() on it for a while but write > to a > > > dif

Re: circuit breaker for producer

2015-05-05 Thread mete
May 5, 2015 at 1:59 AM, mete wrote: > > > Hello Folks, > > > > I was looking through the kafka.producer metrics on the JMX interface, to > > find a good indicator when to "trip" the circuit. So far it seems like > the > > "bufferpool-wait-ra

circuit breaker for producer

2015-05-05 Thread mete
0. And i am thinking about tripping the circuit breaker using this metric, ex: if wait-ratio > 0.90 etc... What do you think? Do you think there would be a better indicator to check the health overall? Best Mete