Re: Reading messages from start - new job submission

2019-02-19 Thread Dian Fu
Hi Avi, As described in the documentation: "If offsets could not be found for a partition, the auto.offset.reset setting in the properties will be used.". For starting from GroupOffset, the property "auto.offset.reset" will ONLY be respected when the group offset cannot be found for a partition

Re: Reading messages from start - new job submission

2019-02-19 Thread avilevi
Thanks for the answer, But my question is why do I need to set /myConsumer.setStartFromEarliest();/ if I set this property /setProperty("auto.offset.reset", "earliest") /in consumer properties ? I want the consumer to start reading from earliest only If offsets could not be found as stated in th

Re: Reading messages from start - new job submission

2019-02-18 Thread avilevi
Hi , I'm using 1.7.0 Cheers -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Reading messages from start - new job submission

2019-02-18 Thread sohimankotia
Hi, Which version of flink you r using ? Reset offset to earliest : https://ci.apache.org/projects/flink/flink-docs-stable/dev/connectors/kafka.html#kafka-consumers-start-position-configuration Thanks -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Reading messages from start - new job submission

2019-02-17 Thread Avi Levi
I'm updating a job without savepoint. The consumer properties is set to * prop.setProperty("auto.offset.reset", "earliest")* The start strategy is not explicitly set (using the default setStartFromGroupOffsets). In this case I expect that the consumer will read the messages from the beginning sinc