Re: how to reset kafka offset in zookeeper

2015-12-19 Thread James Cheng
This page describes what Kafka stores in Zookeeper: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+data+structures+in+Zookeeper It looks like the info for a particular consumer groupId is stored at: /consumers// According to https://community.cloudera.com/t5/Cloudera-Labs/Kafka-Parcels

Re: how to reset kafka offset in zookeeper

2015-12-19 Thread Todd Palino
There’s no simple command. You’ll need to use either zookeeper-shell.sh or zkCli.sh or something similar that lets you explore and edit Zookeeper and do a recursive delete on the group name in the consumers tree. I’m not sure how Cloudera’s interface differs, however, or if they provide a separate

Re: how to reset kafka offset in zookeeper

2015-12-19 Thread Akhilesh Pathodia
What is the command to delete group from zookeeper? I dont find /consumer/ directory? I am using cloudera, is there any place on cloudera manager where I can delete the group? Thanks On Sat, Dec 19, 2015 at 11:47 PM, Todd Palino wrote: > If what you want to do is reset to smallest, all you ne

Re: how to reset kafka offset in zookeeper

2015-12-19 Thread Todd Palino
If what you want to do is reset to smallest, all you need to do is stop the consumer, delete the group from Zookeeper, and restart the consumer. It will automatically create the group again. You only need to export the offsets first if you later need to reset to where you were in the partitions.

Re: how to reset kafka offset in zookeeper

2015-12-19 Thread Akhilesh Pathodia
What is the process for deleting the consumer group from zookeeper? Should I export offset, delete and then import? Thanks, Akhilesh On Fri, Dec 18, 2015 at 11:32 PM, Todd Palino wrote: > Yes, that’s right. It’s just work for no real gain :) > > -Todd > > On Fri, Dec 18, 2015 at 9:38 AM, Marko