Kafka - Consumer Offset Reset Automatically

2017-08-25 Thread Daniccan VP
Hi Users, While using Apache Kafka with a Java API High Level Consumer, I get the following error sometimes, WARNpool-1-thread-4 Auto-commit of offsets {my_topic-2=OffsetAndMetadata{offset=53847, metadata=''}} failed for group my_consumer_group: Offset commit failed with a retriable exception. Yo

Re: Kafka consumer offset reset

2017-03-22 Thread Stevo Slavić
Hello Jakub, Maybe you're interested in feature that's not yet available but is being proposed and discussed (on dev ML) for future - see https://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+Reset+Consumer+Group+Offsets+tooling Kind regards, Stevo Slavic. On Tue, Mar 21, 2017 at 4:43

Re: Kafka consumer offset reset

2017-03-21 Thread Robert Quinlivan
What offset do you want to reset them to? The easier way to adjust offsets in 0.10 is to attach a consumer for the target topic-partition and seek to the position you desire and commit that new offset. On Tue, Mar 21, 2017 at 9:56 AM, Jakub Stransky wrote: > Hello, > > just recently migrated to

Kafka consumer offset reset

2017-03-21 Thread Jakub Stransky
Hello, just recently migrated to using Kafka 0.10.1.0 I would like to reset position for some consumers. I went through documentation and couldn't spot it how to achieve that. All what I got is that v 10 reduces usage of zookeeper and clients have possibility to use different storage for maintain