Re: Recovering from broker failure with KafkaConsumer

2015-06-19 Thread Jan Stette
Sounds good, thanks for the clarification. Jan On 17 June 2015 at 22:09, Jason Gustafson wrote: > We have a couple open tickets to address these issues (see KAFKA-1894 and > KAFKA-2168). It's definitely something we want to fix. > > On Wed, Jun 17, 2015 at 4:21 AM, Jan Stette wrote: > >> Add

Re: Recovering from broker failure with KafkaConsumer

2015-06-17 Thread Jason Gustafson
We have a couple open tickets to address these issues (see KAFKA-1894 and KAFKA-2168). It's definitely something we want to fix. On Wed, Jun 17, 2015 at 4:21 AM, Jan Stette wrote: > Adding some more details to the previous question: > > The indefinite wait doesn't happen on calling subscribe() o

Re: Recovering from broker failure with KafkaConsumer

2015-06-17 Thread Jan Stette
Adding some more details to the previous question: The indefinite wait doesn't happen on calling subscribe() on the consumer, it happens when I (in this case) call seekToEnd(). A related problem to this is that the seekToEnd() method is synchronized (as are the other access methods on KafkaConsum

Recovering from broker failure with KafkaConsumer

2015-06-17 Thread Jan Stette
I'm trying out the new KafkaConsumer client API in the trunk of the source tree, and while I realise that this is a work in progress, I have a question that perhaps someone can shed some light on. I'm looking at how to handle various error scenarios for a Kafka client, in particular what happens w