A simple query

Does Flink' KafkaConnector flush the current offsets to kafka on a SP ?
Note that the I do koow that Flink consumes data from Kafka topics and
periodically checkpoints using Flink's distributed checkpointing mechanism.
In case of failure, Flink will restore the records from checkpoint
directory and will start reading data from Kafka offset after that. In this
case however I want to restart a radically different pipe but from an
offset that is part of the SP and the hope is that I could just depend on
the kafka offsets of the consumer group.

Thanks

Reply via email to