.ts...@hk.daiwacm.com>
Sent: Monday, January 22, 2018 6:57 PM
To: users@kafka.apache.org<mailto:users@kafka.apache.org>
Subject: RE: How to always consume from latest offset in kafka-streams
If you are doing dynamic assignment ( consumer.subscription), you can try this
in your code:
K
---
From: Xin Li [mailto:xin...@trivago.com]
Sent: Tuesday, January 23, 2018 3:01 AM
To: users@kafka.apache.org
Subject: Re: How to always consume from latest offset in kafka-streams
This?
consumer.auto.offset.reset = latest
Best,
Xin
On 19.01.18, 19:34, "Saloni Vithalani" wrote:
Ou
This?
consumer.auto.offset.reset = latest
Best,
Xin
On 19.01.18, 19:34, "Saloni Vithalani" wrote:
Our requirement is such that if a kafka-stream app is consuming a
partition, it should start it's consumption from latest offset of that
partition.
This seems like do-able usin
You can try generating a random consumer group ID to ensure that no
existing offset is used.
On 20 January 2018 at 01:11, Matthias J. Sax wrote:
> That is not supported out-of-box.
>
> Configuration "auto.offset.reset" only triggers, if there are not
> committed offsets and there is KS config to
That is not supported out-of-box.
Configuration "auto.offset.reset" only triggers, if there are not
committed offsets and there is KS config to change this behavior.
A possible workaround might be (but not sure if I want to recommend
this), to increase KafkaStreams commit interval via StreamsConf
Our requirement is such that if a kafka-stream app is consuming a
partition, it should start it's consumption from latest offset of that
partition.
This seems like do-able using
streamsConfiguration.put(ConsumerConfig.AUTO_OFFSET_RESET_CONFIG, "latest")
Now, let's say using above configuration,
