Till Rohrmann created FLINK-3542:
------------------------------------

             Summary: FlinkKafkaConsumer09 cannot handle changing number of 
partitions
                 Key: FLINK-3542
                 URL: https://issues.apache.org/jira/browse/FLINK-3542
             Project: Flink
          Issue Type: Improvement
          Components: Kafka Connector
    Affects Versions: 1.0.0
            Reporter: Till Rohrmann
            Priority: Minor


The current {{FlinkKafkaConsumer09}} cannot handle increasing the number of 
partitions of a topic while running. The consumer will simply leave the newly 
created partitions out and thus miss all data which is written to the new 
partitions. The reason seems to be a static assignment of partitions to 
consumer tasks when the job is started.

We should either fix this behaviour or clearly document it in the online and 
code docs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to