Re: Facing Duplication in consumer

2018-05-28 Thread Kamal Chandraprakash
If the consumer is idle (not doing any commit) for more than a day, the offsets will be wiped out. Rf. offsets.retention.minutes property in Kafka documentation. On Tue, May 29, 2018 at 9:49 AM, Shantanu Deshmukh wrote: > Which Kafka version? > > On Mon, May 28, 2018 at 9:09 PM Dinesh Subramani

Re: Facing Duplication in consumer

2018-05-28 Thread Shantanu Deshmukh
Which Kafka version? On Mon, May 28, 2018 at 9:09 PM Dinesh Subramanian < dsubraman...@apptivo.co.in> wrote: > Hi, > > Whenever we bounce the consumer in tomcat node, I am facing duplication. > It is consumed from the beginning. I have this property in consumer > "auto.offset.reset" = "earliest

Facing Duplication in consumer

2018-05-28 Thread Dinesh Subramanian
Hi, Whenever we bounce the consumer in tomcat node, I am facing duplication. It is consumed from the beginning. I have this property in consumer "auto.offset.reset" = "earliest". if it is new consumer means it will consume from the beginning, but it is consumed from the beginning for the consume