[
https://issues.apache.org/jira/browse/FLINK-16865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhisheng updated FLINK-16865:
-----------------------------
Description:
h3. 【Flink Kafka Connector】
If the job adds another Kafka topic when the job start from Savepoint, it will
start to consume from the earlist of that topic, it may cause duplicate data
sink.
I found that the configuration is already written in the code
FlinkKafkaConsumerBase#open(), maybe it can be Configurable.
!image-2020-03-30-19-57-42-451.png!
was:
h3. 【Flink Kafka Connector】
If the job adds another Kafka topic when the job start from Savepoint, it will
start to consume from the earlist of that topic, it may cause duplicate data
sink.
I found the config is in , maybe it can be
I found that the configuration is already written in the code
FlinkKafkaConsumerBase#open(), maybe it can be Configurable.
!image-2020-03-30-19-57-42-451.png!
> 【Flink Kafka Connector】Restore from Savepoint，if add new Kafka topic，Flink
> will consume the new topic from earlist，it may cause duplicate data sink
> ---------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-16865
> URL: https://issues.apache.org/jira/browse/FLINK-16865
> Project: Flink
> Issue Type: Bug
> Reporter: zhisheng
> Priority: Major
> Attachments: image-2020-03-30-19-57-42-451.png
>
>
> h3. 【Flink Kafka Connector】
> If the job adds another Kafka topic when the job start from Savepoint, it
> will start to consume from the earlist of that topic, it may cause duplicate
> data sink.
> I found that the configuration is already written in the code
> FlinkKafkaConsumerBase#open(), maybe it can be Configurable.
>
> !image-2020-03-30-19-57-42-451.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
