ConsumerConnector not processing partitions on a particular kafka broker.

2014-07-24 Thread Pablo Picko
Hello all Some background. I have a 3 kafka brokers A,B and C, there is a kafka topic called topic with 20 partitions (no replicas). Everything has been working fine for about a week when suddenly all the data sent to partitions belonging to broker C are not seen by the Consumer the consumer is

Re: ConsumerConnector not processing partitions on a particular kafka broker.

2014-07-24 Thread Pablo Picko
ul 24, 2014 at 4:12 PM, Guozhang Wang wrote: > Hi Pablo, > > During the period did you see any exception/errors on Broker C's logs and > the consumer logs also? > > Guozhang > > > On Thu, Jul 24, 2014 at 6:23 AM, Pablo Picko wrote: > > > Hello all >

Re: ConsumerConnector not processing partitions on a particular kafka broker.

2014-07-24 Thread Pablo Picko
Jul 2014 17:57, "Guozhang Wang" wrote: > Pablo, > > Do you see any rebalance related logs in consumers? > > Guozhang > > > On Thu, Jul 24, 2014 at 9:02 AM, Pablo Picko wrote: > > > Hey Guozhang > > > > Thanks for the reply, No nothing at all in th

Re: ConsumerConnector not processing partitions on a particular kafka broker.

2014-07-24 Thread Pablo Picko
er: @allthingshadoop <http://www.twitter.com/allthingshadoop> > ****/ > > > On Thu, Jul 24, 2014 at 1:05 PM, Pablo Picko wrote: > > > Guozhang > > > > I didn't no. I did spot other people with similar symptoms to my problem > > mentioning your sug

Re: ConsumerConnector not processing partitions on a particular kafka broker.

2014-07-25 Thread Pablo Picko
ncipal Consultant > Big Data Open Source Security LLC > http://www.stealth.ly > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> > / > > > On Thu, Jul 24, 2014 at 3:30 PM, Pablo Picko wrote: > > &g

Re: ConsumerConnector not processing partitions on a particular kafka broker.

2014-07-25 Thread Pablo Picko
> > > > /*** > > Joe Stein > > Founder, Principal Consultant > > Big Data Open Source Security LLC > > http://www.stealth.ly > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> > >

Re: ConsumerConnector not processing partitions on a particular kafka broker.

2014-07-25 Thread Pablo Picko
it seems > they may have exited for some reason and the iterators are blocked on > receiving data. > > On Fri, Jul 25, 2014 at 12:50:13PM +0100, Pablo Picko wrote: > > Hey Joel > > > > I actually did issue a kill -3 to get a view on the consumer at the time > of > &g