Re: Detecting lost connection in high level consumer

2015-02-04 Thread harikiran
Thanks Guozhang and Jun for your replies. On Wed, Feb 4, 2015 at 4:06 PM, harikiran wrote: > Hey! Did anyone get a chance to read this? > > Thanks!! > > On Mon, Jan 19, 2015 at 1:26 AM harikiran wrote: > >> Hi >> >> I am using the 0811 Kafka High level consumer and I have configured " >> consum

Re: Detecting lost connection in high level consumer

2015-02-04 Thread harikiran
Hey! Did anyone get a chance to read this? Thanks!! On Mon, Jan 19, 2015 at 1:26 AM harikiran wrote: > Hi > > I am using the 0811 Kafka High level consumer and I have configured " > consumer.timeout.ms" to a value that is not -1, say 5000ms. > > I create the consumer iterator and invoke hasNext(

Re: Detecting lost connection in high level consumer

2015-01-19 Thread Guozhang Wang
Hi Hari, For high level consumer the fetching logic is handled by a background fetcher thread and is hidden from user, for either case of 1) broker down or 2) no message is available the fetcher thread will keep retrying while the user thread will wait on the fetcher thread to put some data into t

Detecting lost connection in high level consumer

2015-01-19 Thread harikiran
Hi I am using the 0811 Kafka High level consumer and I have configured " consumer.timeout.ms" to a value that is not -1, say 5000ms. I create the consumer iterator and invoke hasNext() method on it. Irrespective of whether kafka broker was shutdown or there was no message written to kafka, I see