Re: Restore from save point but need to read from different Kafka topics

2020-04-29 Thread Robert Metzger
Hey, as far as I remember, the Kafka consumer stores the topic name + partition id + offset in state. If you modify the kafka topic on restore, the Kafka consumer would continue where it left off. If the topics don't exist anymore, it would fail. If you want Kafka to start from a different topic,

Restore from save point but need to read from different Kafka topics

2020-04-23 Thread Casado Tejedor , Rubén
Hi Let me introduce our scenario: 1. We have a Flink job reading from a Kafka topic, using the Flink Kafka. Name of Kafka topic is an input variable in properties file 2. A savepoint is created for that job, so the Kafka offsets for the input topic is stored in that savepoint 3. The j