Re: How to set offset for a consumer in Kafka 0.10.0.X

2017-04-09 Thread Glen Ogilvie
9 March, 2017 7:25:21 PM Subject: Re: How to set offset for a consumer in Kafka 0.10.0.X Hi Glen, Maybe have a look at this, slightly different version. Not doing anything more than what you have seen in gist. You should pass broker url as first parameter and and a json containing desired of

Re: How to set offset for a consumer in Kafka 0.10.0.X

2017-03-08 Thread Sudev A C
> > in Kafka or the docs? > > > > > > Regards > > > -- > > > Glen Ogilvie > > > Open Systems Specialists > > > Level 1, 162 Grafton Road > > > http://www.oss.co.nz/ > > > > > > Ph: +64 9 984 3000 > > > Mo

Re: How to set offset for a consumer in Kafka 0.10.0.X

2017-03-08 Thread Manikumar
; > > > > > > I'm still a little unclear as to how to do this. > > > > > > > > Is this python script: http://pastebin.com/tvxj1wTX > > > > > > > > The right way to go about getting the offset set to a specific value > > >

Re: How to set offset for a consumer in Kafka 0.10.0.X

2017-03-08 Thread Jeff Widman
> Regards > -- > Glen Ogilvie > Open Systems Specialists > Level 1, 162 Grafton Road > http://www.oss.co.nz/ > > Ph: +64 9 984 3000 > Mobile: +64 21 684 146 > GPG Key: ACED9C17 > > > From: "Robert Quinlivan" > To: "users" > Sent: Thur

Re: How to set offset for a consumer in Kafka 0.10.0.X

2017-03-08 Thread Glen Ogilvie
Open Systems Specialists Level 1, 162 Grafton Road http://www.oss.co.nz/ Ph: +64 9 984 3000 Mobile: +64 21 684 146 GPG Key: ACED9C17 From: "Robert Quinlivan" To: "users" Sent: Thursday, 9 March, 2017 6:42:15 AM Subject: Re: How to set offset for a consumer in Kafka 0.1

Re: How to set offset for a consumer in Kafka 0.10.0.X

2017-03-08 Thread Robert Quinlivan
to a specific value > > (12345678 in this example) for a specific consumer group? > > > > Regards > > -- > > Glen Ogilvie > > Open Systems Specialists > > Level 1, 162 Grafton Road > > http://www.oss.co.nz/ > > > > Ph: +64 9 984 3000 >

Re: How to set offset for a consumer in Kafka 0.10.0.X

2017-03-08 Thread Jeff Widman
3000 > Mobile: +64 21 684 146 > GPG Key: ACED9C17 > > > From: "Jeff Widman" > To: "users" > Sent: Wednesday, 8 March, 2017 1:41:17 PM > Subject: Re: How to set offset for a consumer in Kafka 0.10.0.X > > Offsets for modern kafka consumers are stored in an

Re: How to set offset for a consumer in Kafka 0.10.0.X

2017-03-07 Thread Glen Ogilvie
afton Road http://www.oss.co.nz/ Ph: +64 9 984 3000 Mobile: +64 21 684 146 GPG Key: ACED9C17 From: "Jeff Widman" To: "users" Sent: Wednesday, 8 March, 2017 1:41:17 PM Subject: Re: How to set offset for a consumer in Kafka 0.10.0.X Offsets for modern kafka consu

Re: How to set offset for a consumer in Kafka 0.10.0.X

2017-03-07 Thread Jeff Widman
Offsets for modern kafka consumers are stored in an internal Kafka topic, so they aren't as easy to change as zookeeper. To set a consumer offset, you need a consumer within a consumer group to call commit() with your explicit offset. If needed, you can create a dummy consumer and tell it to join

How to set offset for a consumer in Kafka 0.10.0.X

2017-03-07 Thread Glen Ogilvie
Hi, We are running Kafka 0.10.0.X, with zookeeper. I'm trying to figure out if I can manually set a consumer offset, for a specific consumer when that consumer is stopped. It looks like it used to be done using: kafka.tools.ExportZkOffsets and kafka.tools.ImportZkOffsets ( https://cwiki.ap