Re: too many rebalances in my consumer log and fetcher threads are getting stopped

2014-04-20 Thread ankit tyagi
Can i reduce the consumer balances if i increase the zookeeper session timeout? On Sat, Apr 19, 2014 at 9:11 PM, ankit tyagi wrote: > Hi Jun, > > i grabbed for 'begin rebalancing consumer' in my log and got around > *5000*times in today's logs. > > Can there be any other reason instead full G

Re: high level consumer shutdown exception

2014-04-20 Thread Jun Rao
You are talking about the broker side exception in Processor? That can happen on a consumer shutdown. Thanks, Jun On Sat, Apr 19, 2014 at 6:16 AM, Yonghui Zhao wrote: > In kafka 0.8.1, when I shut down high level consumer, I found one > exception. > I think it is expected, right? > > > 14/04/

Re: too many rebalances in my consumer log and fetcher threads are getting stopped

2014-04-20 Thread Jun Rao
Yes, you could increase zk session timeout too. The impact is that a hard kill of the consumer could take up to that timeout to be detected. Thanks, Jun On Sun, Apr 20, 2014 at 9:50 AM, ankit tyagi wrote: > Can i reduce the consumer balances if i increase the zookeeper session > timeout? > > >