Re: kafka consumer group is rebalancing

2016-05-31 Thread Liquan Pei
Hi Sunny, It would be helpful to know the processing logic after the records are returned by poll(). How do you make sure that the polling is happening within session timeout? Did you try to reduce the number of messages returned by setting max.poll.records to a smaller value? Thanks, Liquan On

kafka consumer group is rebalancing

2016-05-30 Thread Sunny Gupta
Hi, I am using Kafka .9 and new Java consumer. I am polling inside a loop. I am getting commitfailedexcption because of group rebalance, when code try to execute consumer.commitSycn . Please note, I am adding session.timeout.ms as 3 and heartbeat.interval.ms as 1 to consumer and polling hap