Re: a few questions from high level consumer documentation.

You understanding is correct. There should be no message loss, unless the # of correlated failures is larger than the replication factor. Thanks, Jun On Mon, May 13, 2013 at 8:46 AM, Yu, Libo wrote: > Thanks for answering my questions. Now I know why the offset is saved in > zookeepers. > If

Re: a few questions from high level consumer documentation.

Thanks for answering my questions. Now I know why the offset is saved in zookeepers. If a consumer group has only one consumer, when it fails and restarts, I assume it starts consuming from the offset saved in the zookeeper. Is that right? If that is the case, then the consumer client does not ne

Re: a few questions from high level consumer documentation.

Thanks, Neha On May 9, 2013 5:28 AM, "Chris Curtin" wrote: > > On Thu, May 9, 2013 at 12:36 AM, Rob Withers wrote: > > > > > > > > -Original Message- > > > From: Chris Curtin [mailto:curtin.ch...@gmail.com] > > > > > > 1 When you say the iterator may block, do you mean hasNext() may block

Re: a few questions from high level consumer documentation.

On 5/9/13 8:27 AM, Chris Curtin wrote: On Thu, May 9, 2013 at 12:36 AM, Rob Withers wrote: -Original Message- From: Chris Curtin [mailto:curtin.ch...@gmail.com] 1 When you say the iterator may block, do you mean hasNext() may block? Yes. Is this due to a potential non-blocking f

Re: a few questions from high level consumer documentation.

On Thu, May 9, 2013 at 12:36 AM, Rob Withers wrote: > > > > -Original Message- > > From: Chris Curtin [mailto:curtin.ch...@gmail.com] > > > > 1 When you say the iterator may block, do you mean hasNext() may block? > > > > > > > Yes. > > Is this due to a potential non-blocking fetch (broke

RE: a few questions from high level consumer documentation.

> -Original Message- > From: Chris Curtin [mailto:curtin.ch...@gmail.com] > > 1 When you say the iterator may block, do you mean hasNext() may block? > > > > Yes. Is this due to a potential non-blocking fetch (broker/zookeeper returns an empty block if offset is current)? Yet this blo

Re: a few questions from high level consumer documentation.

For #3, we need to checkpoint offsets to a central place so that if a consumer fails, another consumer in the same group can pick up from where it's left off. For #4c, leader change doesn't introduce duplicates. Thanks, Jun On Wed, May 8, 2013 at 9:17 AM, Yu, Libo wrote: > Hi, > > I read thi

Re: a few questions from high level consumer documentation.

I'll try to answer some, the Kafka team will need to answer the others: On Wed, May 8, 2013 at 12:17 PM, Yu, Libo wrote: > Hi, > > I read this link > https://cwiki.apache.org/KAFKA/consumer-group-example.html > and have a few questions (if not too many). > > 1 When you say the iterator may bloc