Till Rohrmann created FLINK-3542: ------------------------------------ Summary: FlinkKafkaConsumer09 cannot handle changing number of partitions Key: FLINK-3542 URL: https://issues.apache.org/jira/browse/FLINK-3542 Project: Flink Issue Type: Improvement Components: Kafka Connector Affects Versions: 1.0.0 Reporter: Till Rohrmann Priority: Minor
The current {{FlinkKafkaConsumer09}} cannot handle increasing the number of partitions of a topic while running. The consumer will simply leave the newly created partitions out and thus miss all data which is written to the new partitions. The reason seems to be a static assignment of partitions to consumer tasks when the job is started. We should either fix this behaviour or clearly document it in the online and code docs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)