Yeah, this works! The consumer API is able to update the consumer offset. The only downside is to stop the real consumers.
On Fri, Oct 14, 2016 at 2:47 PM, Kevin A <k4m...@gmail.com> wrote: > I didn't find an off-the-shelf tool to do this when I needed to a few weeks > ago (which was kind of surprising). > > I used the kafka-python library (my company's wrappers around it, actually) > to pretend I was in the consumer group I wanted to update and called commit > with the offsets I wanted. > > First I stopped the real consumers. Then I ran my little script. Then > re-started the real consumers. > > Hope that helps. (Or elicits a more effective response. ;)) > > On Fri, Oct 14, 2016 at 10:53 AM, Yifan Ying <nafan...@gmail.com> wrote: > > > Hi Jeff, > > > > Could you explain how you send messages to __consumer_offsets to > overwrite > > offsets? Thanks! > > > > Yifan > > > > On Fri, Oct 14, 2016 at 9:55 AM, Jeff Widman <j...@netskope.com> wrote: > > > > > I also would like to know this. > > > > > > Is the solution to just use a console producer against the internal > > topics > > > that store the offsets? > > > > > > On Wed, Oct 12, 2016 at 2:26 PM, Yifan Ying <nafan...@gmail.com> > wrote: > > > > > > > Hi, > > > > > > > > In old consumers, we use the following command line tool to manually > > > update > > > > offsets stored in zk: > > > > > > > > *./kafka-run-class.sh kafka.tools.UpdateOffsetsInZK [latest | > earliest] > > > > [consumer.properties file path] [topic]* > > > > > > > > But it doesn't work with offsets stored in Kafka. How can I update > the > > > > Kafka offsets to latest? > > > > > > > > Yifan > > > > > > > > -- > > > > Yifan > > > > > > > > > > > > > > > -- > > Yifan > > > -- Yifan
