Re: Consumer group keep bouncing between generation id 0 and 1

2016-11-22 Thread Guozhang Wang
1. If you are not having heavy callback, then I'd suggest you checking the frequency of consumer.poll() call, because that is when the heartbeat is sent. For example, between [2016-11-17 06:17:42,399] new group formed with the single consumer member [2016-11-17 06:18:12,404] that single member ha

Re: Consumer group keep bouncing between generation id 0 and 1

2016-11-19 Thread Jun Ma
Hi Guozhang, Thank you so much for your reply. Follow up questions: 1. We are using default onPartitionAssigned callback, not customized one. What do you think would be the possible reason of the heavy callback? Can you point me the actual implementation class for Java 0.9.0.1 driver? 2. Does con

Re: Consumer group keep bouncing between generation id 0 and 1

2016-11-19 Thread Guozhang Wang
Hello Jun, The reason that the group is bouncing between generation 0 and 1 is that it is iteratively removed as an empty group after the only member is removed, and then re-create the group with the member jumping back to re-join. My suspect is that your PartitionAssigned callback is too heavy,

Consumer group keep bouncing between generation id 0 and 1

2016-11-18 Thread Jun MA
Hi guys, I’m using kafka 0.9.0.1 and Java client. I saw the following exceptions throw by my consumer: Caused by: java.lang.IllegalStateException: Correlation id for response (767587) does not match request (767585) at org.apache.kafka.clients.NetworkClient.correlate(NetworkClient.java: