Hi,
When you are restoring from a savepoint (or checkpoint) the offsets in Kafka
are complete ignored. Flink is checkpointing the offset at the time the
checkpoint/savepoint is taken and that will be used as the read offset when
restoring.
Best,
Aljoscha
> On 11. Oct 2017, at 12:58, Rahul Raj
Changing the group id didn't work for me, instead using
setStartfromEarliest() on kafka consumer worked for me. But it created one
confusion, that is in case of failure if I start from a particular
checkpoint or savepoint will the application start reading the message from
a particular offset where
Hi,
I think the problem is that your Kafka consumer has the same group-id across
those two runs. This means that it will pick up the last "read position" of the
previous run, and thus not read anything. If you change the group-id for the
second run you should be able to read your data again.
B
Hi ,
I have written a program which reads data from Kafka, parses the json and
does some reduce operation. The problem I am facing is, the program
executes perfectly for the first time on a day. But when I kill the program
and execute it again, an empty file is created. Even after compiling again
