poll returned in 30 seconds.
From: Rohit Sardesai
Sent: 20 June 2016 11:41:50
To: users@kafka.apache.org
Subject: Re: consumer.poll() takes approx. 30 seconds - 0.9 new consumer api
The consumer instances close I.e leave the group only if they are idle for a
long
this, and we're making
further refinements to the consumer to provide better application control
over number of messages fetched vs total processing time).
-Ewen
On Sun, Jun 19, 2016 at 10:01 PM, Rohit Sardesai wrote:
>
> Can anybody help out on this?
> ___
Can anybody help out on this?
From: Rohit Sardesai
Sent: 19 June 2016 11:47:01
To: users@kafka.apache.org
Subject: Re: consumer.poll() takes approx. 30 seconds - 0.9 new consumer api
In my tests , I am using around 24 consumer groups. I never call
gracefully leaving? This may cause subsequent 'rebalance' operations to
block until those old consumers check-in or the session timeout happens
(30secs)
-Dana
On Jun 18, 2016 8:56 PM, "Rohit Sardesai"
wrote:
> I am using the group management feature of Kafka 0.9 to handle pa
operation that the consumers are
blocked on the poll() ? What is the best way to use poll() if I have to serve
many parallel requests per second ? Should I prefer manual assignment of
partitions in this case instead of relying on re-balance ?
Regards,
Rohit Sardesai