Marina, We do not have a command line tool to manually set offsets stored in Kafka yet, but we are thinking about adding this feature soon. Could you elaborate your use case of cmd manual offset modification a little bit so I can understand your scenario better while working on the cmd design?
Guozhang On Fri, Jun 19, 2015 at 7:11 AM, Rajasekar Elango <rela...@salesforce.com> wrote: > Hi Marina, > > Check slide 32 in this presentation > <http://www.slideshare.net/jjkoshy/offset-management-in-kafka>. > > Hope this helps. > > Thanks, > Raja. > > On Fri, Jun 19, 2015 at 9:43 AM, Marina <ppi...@yahoo.com.invalid> wrote: > > > Thanks, Stevo, for the quick reply, > > Yes, I understand how to do this programmatically - but I would like to > be > > able to do this manually from a command line, just as before I was able > to > > do this in the Zookeeper shell. I don't want to write and run a Java app > > just to set an offset :) > > > > [unless, of course, this is the only way to do this.....] > > > > thanks! > > Marina > > > > > > > > > > ----- Original Message ----- > > From: Stevo Slavić <ssla...@gmail.com> > > To: users@kafka.apache.org; Marina <ppi...@yahoo.com> > > Cc: > > Sent: Friday, June 19, 2015 9:33 AM > > Subject: Re: how to modify offsets stored in Kafka in 0.8.2.1 version? > > > > Hello Marina, > > > > There's Kafka API to fetch and commit offsets > > > > > https://cwiki.apache.org/confluence/display/KAFKA/Committing+and+fetching+consumer+offsets+in+Kafka > > - maybe it will work for you. > > > > Kind regards, > > Stevo Slavic. > > > > > > On Fri, Jun 19, 2015 at 3:23 PM, Marina <ppi...@yahoo.com.invalid> > wrote: > > > > > Hi, > > > > > > in older Kafka versions where offsets were stored in Zookeeper - I > could > > > manually update the value of the Zookeeper's node: > > > > > > > > > /consumers/<consumer_group_name>/offsets/<topic_name>/<partition_number>/<offset_value>. > > > > > > In 0.8.2.1 - there are no values in offsets anymore, but there is a new > > > topic, > > > __consumer_offsets, where as I understand offsets are tracked now. > > > > > > the ConsumerOffsetChecker tool seems to be able to get the offsets > values > > > from this topic , since I see correct value running it. > > > So, how do I access this info myself? > > > > > > > > > I tried: > > > > > > ./kafka-console-consumer.sh --zookeeper localhost:2181 --topic > > > __consumer_offsets --from-beginning > > > > > > but it does not show anything.... > > > Also, how would I change the offset? I need to do this sometimes if I > > want > > > to skip/ignore some messages and just advance offset manually. > > > > > > thanks, > > > Marina > > > > > > > > > -- > Thanks, > Raja. > -- -- Guozhang
