Re: flink-kafka-connector offset management

2016-05-20 Thread Ufuk Celebi
Hey Arun! How did you configure your Kafka source? If the offset has been committed and you configured the source to read from the latest offset, the message should not be re-processed. – Ufuk On Fri, May 13, 2016 at 2:19 PM, Arun Balan wrote: > Hi, I am trying to use the flink-kafka-connector

flink-kafka-connector offset management

2016-05-13 Thread Arun Balan
Hi, I am trying to use the flink-kafka-connector and I notice that every time I restart my application it re-reads the last message on the kafka topic. So if the latest offset on the topic is 10, then when the application is restarted, kafka-connector will re-read message 10. Why is this the behavi