Re: UNKNOWN_MEMBER_ID assigned to consumer group

2016-03-15 Thread Jason Gustafson
Yes, the consumer handles this error by rejoining the group. This is probably a case where the logging is a bit more verbose than it should be. I've tried to tune the logging a bit better for 0.10 so that some of these low-level details only come out at the DEBUG level (in particular for cases that

Re: UNKNOWN_MEMBER_ID assigned to consumer group

2016-03-14 Thread tao xiao
Thanks Jason. What does consumer 1 would do upon receiving UNKNOWN_MEMBER_ID and does it rejoin the group eventually if it keeps polling? On Tue, 15 Mar 2016 at 00:58 Jason Gustafson wrote: > Hey Tao, > > This error indicates that a rebalance completed successfully before the > consumer could re

Re: UNKNOWN_MEMBER_ID assigned to consumer group

2016-03-14 Thread Jason Gustafson
Hey Tao, This error indicates that a rebalance completed successfully before the consumer could rejoin. Basically it works like this: 1. Consumer 1 joins the group and is assigned member id A 2. Consumer 1's session timeout expires before successfully heartbeating. 3. The group is rebalanced with

UNKNOWN_MEMBER_ID assigned to consumer group

2016-03-14 Thread tao xiao
Hi team, I have about 10 consumers using the same consumer group connecting to Kafka. Occasional I can see UNKNOWN_MEMBER_ID assigned to some of the consumers. I want to under what situation this would happen? I use Kafka version 0.9.0.1