[ https://issues.apache.org/jira/browse/FLINK-25132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17454980#comment-17454980 ]
Qingsheng Ren commented on FLINK-25132: --------------------------------------- [~mason6345] I think so. We'll make a back-port on 1.13 after fix this on master > KafkaSource cannot work with object-reusing DeserializationSchema > ----------------------------------------------------------------- > > Key: FLINK-25132 > URL: https://issues.apache.org/jira/browse/FLINK-25132 > Project: Flink > Issue Type: Bug > Components: Connectors / Kafka > Affects Versions: 1.14.0, 1.15.0, 1.14.1 > Reporter: Qingsheng Ren > Assignee: Qingsheng Ren > Priority: Blocker > Labels: pull-request-available > Fix For: 1.15.0, 1.14.1 > > > Currently Kafka source deserializes ConsumerRecords in split reader and puts > them into the elementQueue, then task's main thread polls these records from > the queue asynchronously. This mechanism cannot cooperate with > DeserializationSchemas with object reuse: all records staying in the element > queue points to the same object. > A solution would be moving deserialization to RecordEmitter, which works in > the task's main thread. > Notes that this issue actually effects all sources which do deserialization > in split reader. -- This message was sent by Atlassian Jira (v8.20.1#820001)