Re: Frequent UNKNOWN_MEMBER_ID errors in kafka consumer

2016-10-19 Thread Guozhang Wang
AM, dhiraj prajapati wrote: > Hi, > I have a consumer which implements new consumer api (0.9.0.1). I see below > errors quite frequently in the consumer application logs: > > ERROR [pool-4-thread-5] - o.a.k.c.c.i.ConsumerCoordinator - Error > UNKNOWN_MEMBER_ID occurred while comm

Frequent UNKNOWN_MEMBER_ID errors in kafka consumer

2016-10-19 Thread dhiraj prajapati
Hi, I have a consumer which implements new consumer api (0.9.0.1). I see below errors quite frequently in the consumer application logs: ERROR [pool-4-thread-5] - o.a.k.c.c.i.ConsumerCoordinator - Error UNKNOWN_MEMBER_ID occurred while committing offsets for group audit.consumer.group Can you

UNKNOWN_MEMBER_ID

2016-08-03 Thread dhiraj prajapati
Hi, I am using kafka 0.9.0.1 and the corresponding java client for my consumer. I see the below error in my consumer logs: o.a.k.c.c.i.ConsumerCoordinator - Error UNKNOWN_MEMBER_ID occurred while committing offsets for group consumergroup001 Why could this error occur?

Re: UNKNOWN_MEMBER_ID assigned to consumer group

2016-03-15 Thread Jason Gustafson
cases that we handle internally). -Jason On Mon, Mar 14, 2016 at 6:50 PM, tao xiao wrote: > Thanks Jason. What does consumer 1 would do upon > receiving UNKNOWN_MEMBER_ID and does it rejoin the group eventually if it > keeps polling? > > On Tue, 15 Mar 2016 at 00:58 Jason Gustafson

Re: UNKNOWN_MEMBER_ID assigned to consumer group

2016-03-14 Thread tao xiao
Thanks Jason. What does consumer 1 would do upon receiving UNKNOWN_MEMBER_ID and does it rejoin the group eventually if it keeps polling? On Tue, 15 Mar 2016 at 00:58 Jason Gustafson wrote: > Hey Tao, > > This error indicates that a rebalance completed successfully before the > co

Re: UNKNOWN_MEMBER_ID assigned to consumer group

2016-03-14 Thread Jason Gustafson
anced without consumer 1. 4. Consumer 1 eventually sends its heartbeat using the old id A. 5. The coordinator rejects the heartbeat with UNKNOWN_MEMBER_ID. So most likely what has happened is that the consumer has taken longer than the session timeout to handle a batch of records. In 0.10, we will ha

UNKNOWN_MEMBER_ID assigned to consumer group

2016-03-14 Thread tao xiao
Hi team, I have about 10 consumers using the same consumer group connecting to Kafka. Occasional I can see UNKNOWN_MEMBER_ID assigned to some of the consumers. I want to under what situation this would happen? I use Kafka version 0.9.0.1