Re: AW: How Flink Kafka Consumer works when it restarts

2020-02-14 Thread Robert Metzger
iefent...@scoop-software.de> >> *Date: *Thursday, 13 February 2020 at 12:13 AM >> *To: *"Hegde, Mahendra" , " >> user@flink.apache.org" >> *Subject: *[External] AW: How Flink Kafka Consumer works when it restarts >> >> >> >> Hi Ma

Re: AW: How Flink Kafka Consumer works when it restarts

2020-02-13 Thread Timothy Victor
nk.apache.org" > > *Subject: *[External] AW: How Flink Kafka Consumer works when it restarts > > > > Hi Mahendra, > > > > Flink will regularly create checkpoints or manually triggered savepoints. > This is data managed and stored by Flink and that data also cont

Re: AW: How Flink Kafka Consumer works when it restarts

2020-02-12 Thread Hegde, Mahendra
Thanks Theo ! From: "theo.diefent...@scoop-software.de" Date: Thursday, 13 February 2020 at 12:13 AM To: "Hegde, Mahendra" , "user@flink.apache.org" Subject: [External] AW: How Flink Kafka Consumer works when it restarts Hi Mahendra, Flink will regularly

AW: How Flink Kafka Consumer works when it restarts

2020-02-12 Thread theo.diefent...@scoop-software.de
Hi Mahendra, Flink will regularly create checkpoints or manually triggered savepoints. This is data managed and stored by Flink and that data also contains the kafka offsets. When restarting, you can configure to restart from the last checkpoint and or savepoint. You can additionally configure F