Re: Kafka 0.9 Consumer Group

2016-01-11 Thread Jason Gustafson
Ah, that actually makes sense. The consumer-groups.sh script only returns offset data when the group is active. The offsets should still be there, but it does seem unfortunate that there's no way to view them. We have KAFKA-3059 which adds some additional capabilities for managing offsets with this

Re: Kafka 0.9 Consumer Group

2016-01-11 Thread Wang, Howard
Hi Jason, I used the kafka-consumer-groups.sh to check my consumer group : ~/GitHub/kafka/bin/kafka-consumer-groups.sh --bootstrap-server‹group test.group --describe --new-consumer . I ran this command several times after my app was shut down. I always get "Consumer group `test.group` doe

Re: Kafka 0.9 Consumer Group

2016-01-11 Thread Jason Gustafson
Sorry, wrong property, I meant enable.auto.commit. -Jason On Mon, Jan 11, 2016 at 9:52 AM, Jason Gustafson wrote: > Hi Howard, > > The offsets are persisted in the __consumer_offsets topic indefinitely. > Since you're using manual commit, have you ensured that auto.offset.reset > is disabled? I

Re: Kafka 0.9 Consumer Group

2016-01-11 Thread Jason Gustafson
Hi Howard, The offsets are persisted in the __consumer_offsets topic indefinitely. Since you're using manual commit, have you ensured that auto.offset.reset is disabled? It might also help if you provide a little more detail on how you're verifying that offsets were lost. -Jason On Mon, Jan 11,