Pablo, Do you see any rebalance related logs in consumers?
Guozhang On Thu, Jul 24, 2014 at 9:02 AM, Pablo Picko <p...@pitchsider.com> wrote: > Hey Guozhang > > Thanks for the reply, No nothing at all in the logs to suggest anything > went wrong. > > Its really puzzling as to what's happened. When I restarted the consumer > everything worked again. > > Prior to the restart I even stopped the producer for a bit. However any > messages that got assigned to the Broker C never got processed. When I ran > the console consumer script before I restarted it was able to all print all > messages, including messages on broker C. It seems to be that for my > consumers consumergroup one of the brokers messages just became > inaccessible. > > Thanks > Pablo > > > On Thu, Jul 24, 2014 at 4:12 PM, Guozhang Wang <wangg...@gmail.com> wrote: > > > Hi Pablo, > > > > During the period did you see any exception/errors on Broker C's logs and > > the consumer logs also? > > > > Guozhang > > > > > > On Thu, Jul 24, 2014 at 6:23 AM, Pablo Picko <p...@pitchsider.com> > wrote: > > > > > Hello all > > > > > > Some background. > > > > > > I have a 3 kafka brokers A,B and C, there is a kafka topic called topic > > > with 20 partitions (no replicas). > > > > > > Everything has been working fine for about a week when suddenly all the > > > data sent to partitions belonging to broker C are not seen by the > > Consumer > > > the consumer is using the high level consumer and does not look much > > > different to the sample provided in the documentation. > > > > > > When I inspected the topic i can see that all the partitions are > lagging > > > behind. A restart (og the consumer) seems to sort it out but I am > stumped > > > as to whats doing on any help appreciated. > > > > > > > > > Thanks > > > Pablo > > > > > > > > > > > -- > > -- Guozhang > > > -- -- Guozhang
