Re: AW: How Flink Kafka Consumer works when it restarts

2020-02-12 Thread Hegde, Mahendra
Thanks Theo ! From: "theo.diefent...@scoop-software.de" Date: Thursday, 13 February 2020 at 12:13 AM To: "Hegde, Mahendra" , "user@flink.apache.org" Subject: [External] AW: How Flink Kafka Consumer works when it restarts Hi Mahendra, Flink will regularly

How Flink Kafka Consumer works when it restarts

2020-02-12 Thread Hegde, Mahendra
Hi All, I am bit confused on Flink kafka consumer working. I read that Flink stores the kafka message offset in checkpoint and uses it in case if it restarts. Question is when exactly Flink is committing about successful consumption confirmation to kafka broker? And when Flink job restarts will

java.lang.NoClassDefFoundError due to Native library issue?

2019-12-19 Thread Hegde, Mahendra
Hello Team, I am trying to use timezone finding service (https://github.com/dustin-johnson/timezonemap) in my Flink java job. It worked fine in local machine and it worked fine initially in Flink server, but after 2-3 restart of the job it started giving NoClassDefFoundError error- java.lang.N