Re: consumer.poll() takes approx. 30 seconds - 0.9 new consumer api

2016-06-20 Thread Rohit Sardesai
poll returned in 30 seconds. From: Rohit Sardesai Sent: 20 June 2016 11:41:50 To: users@kafka.apache.org Subject: Re: consumer.poll() takes approx. 30 seconds - 0.9 new consumer api The consumer instances close I.e leave the group only if they are idle for a long

Re: consumer.poll() takes approx. 30 seconds - 0.9 new consumer api

2016-06-19 Thread Rohit Sardesai
this, and we're making further refinements to the consumer to provide better application control over number of messages fetched vs total processing time). -Ewen On Sun, Jun 19, 2016 at 10:01 PM, Rohit Sardesai wrote: > > Can anybody help out on this? > ___

Re: consumer.poll() takes approx. 30 seconds - 0.9 new consumer api

2016-06-19 Thread Rohit Sardesai
Can anybody help out on this? From: Rohit Sardesai Sent: 19 June 2016 11:47:01 To: users@kafka.apache.org Subject: Re: consumer.poll() takes approx. 30 seconds - 0.9 new consumer api In my tests , I am using around 24 consumer groups. I never call

Re: consumer.poll() takes approx. 30 seconds - 0.9 new consumer api

2016-06-18 Thread Rohit Sardesai
gracefully leaving? This may cause subsequent 'rebalance' operations to block until those old consumers check-in or the session timeout happens (30secs) -Dana On Jun 18, 2016 8:56 PM, "Rohit Sardesai" wrote: > I am using the group management feature of Kafka 0.9 to handle pa

consumer.poll() takes approx. 30 seconds - 0.9 new consumer api

2016-06-18 Thread Rohit Sardesai
operation that the consumers are blocked on the poll() ? What is the best way to use poll() if I have to serve many parallel requests per second ? Should I prefer manual assignment of partitions in this case instead of relying on re-balance ? Regards, Rohit Sardesai