Re: New consumer subscribe then seek

2015-09-08 Thread Phil Steitz
On 9/8/15 6:58 PM, Jason Gustafson wrote: > Hey Phil, > > You've stumbled onto one of the tricky aspects of the new consumer that > we've been talking about recently. KafkaConsumer.subscribe() is > asynchronous in the sense that it will return before partitions have been > assigned. We could make i

Re: New consumer subscribe then seek

2015-09-08 Thread Jason Gustafson
Hey Phil, You've stumbled onto one of the tricky aspects of the new consumer that we've been talking about recently. KafkaConsumer.subscribe() is asynchronous in the sense that it will return before partitions have been assigned. We could make it synchronous, but we wouldn't be able to guarantee h

New consumer subscribe then seek

2015-09-08 Thread Phil Steitz
I have been experimenting with the KafkaConsumer currently in development [1]. Sorry if this should be a question for the user list, but I am not sure if what I am seeing is something not working yet or if I am misunderstanding the API. If I use KafkaConsumer#subscribe to subscribe to a topic and