Hello, I want FlinkKafkaConsumer to follow changes in Kafka topic/partition change. This means: - When we add partitions to a topic, we want FlinkKafkaConsumer to start reading added partitions. - We want to specify topics by pattern (e.g accesslog.*), and want FlinkKafkaConsumer to start reading new topics if they appeared after starting job.
As long as reading source code and my experiment, FlinkKafkaConsumer uses KafkaConsumer.assign() instead of subscribe(), so partitions are assigned to each KafkaConsumer instance just once at job starting time. Is there any way to let FlinkKafkaConsumer follow topic/partition change? Regards, Hironori Ogibayashi
