Hi,

We have come up with Kafka consumer and we only have 1 consumer in the
group. We are using Kafka 0.9. We are able to consume messages as soon as
we start polling, however for some reason our consumer gets crashed after
processing the message but before manually committing it.

When we restart our consumer after 15min, we observe the message that we
processed being polled again and also other messages that were published in
the 15mins interval.

We want to ignore these messages and start consuming the messages that
comes after the consumer is restarted. Please let us know how to achieve
this.

Kafka consumer consumed 10 messages and while processing 11th message
before committing our consumer went down. We started after 15min, and there
were 20 messages in that whole topic, we dont want to fetch/consume
messages 11 - 20, we want only new messages that is from 21 (message/record
id).

Please let us know if more details needed.

Thanks
A.SathishKumar

Reply via email to