Thanks, Stevo, for the quick reply, Yes, I understand how to do this programmatically - but I would like to be able to do this manually from a command line, just as before I was able to do this in the Zookeeper shell. I don't want to write and run a Java app just to set an offset :)
[unless, of course, this is the only way to do this.....] thanks! Marina ----- Original Message ----- From: Stevo Slavić <ssla...@gmail.com> To: users@kafka.apache.org; Marina <ppi...@yahoo.com> Cc: Sent: Friday, June 19, 2015 9:33 AM Subject: Re: how to modify offsets stored in Kafka in 0.8.2.1 version? Hello Marina, There's Kafka API to fetch and commit offsets https://cwiki.apache.org/confluence/display/KAFKA/Committing+and+fetching+consumer+offsets+in+Kafka - maybe it will work for you. Kind regards, Stevo Slavic. On Fri, Jun 19, 2015 at 3:23 PM, Marina <ppi...@yahoo.com.invalid> wrote: > Hi, > > in older Kafka versions where offsets were stored in Zookeeper - I could > manually update the value of the Zookeeper's node: > > /consumers/<consumer_group_name>/offsets/<topic_name>/<partition_number>/<offset_value>. > > In 0.8.2.1 - there are no values in offsets anymore, but there is a new > topic, > __consumer_offsets, where as I understand offsets are tracked now. > > the ConsumerOffsetChecker tool seems to be able to get the offsets values > from this topic , since I see correct value running it. > So, how do I access this info myself? > > > I tried: > > ./kafka-console-consumer.sh --zookeeper localhost:2181 --topic > __consumer_offsets --from-beginning > > but it does not show anything.... > Also, how would I change the offset? I need to do this sometimes if I want > to skip/ignore some messages and just advance offset manually. > > thanks, > Marina >
