Hi Tarandeep, The error you are seeing only occurs when on startup of the consumer, it couldn’t retrieve any partition information from Kafka. Therefore, according to your description, there should be another error that caused the previous execution of the job to fail. Could you check that? Maybe that would give more insight into why this is happening.
Cheers, Gordon On 23 January 2018 at 5:37:15 AM, Tarandeep Singh (tarand...@gmail.com) wrote: Hi, Our flink streaming job that is reading from old version of Kafka keeps failing (every 9 minutes or so) with this error: java.lang.RuntimeException: Unable to retrieve any partitions for the requested topics [extracted-dimensions]. Please check previous log entries at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08.getKafkaPartitions(FlinkKafkaConsumer08.java:220) at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.open(FlinkKafkaConsumerBase.java:381) at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36) at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:111) at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:376) at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:253) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:702) at java.lang.Thread.run(Thread.java:748) Sometimes it runs for a long time but when it starts to fail, it is predictable failure every 9 minutes. The topic does exist in the Kafka cluster. Can someone help me understand what could be going wrong? Thank you, Tarandeep
