[ 
https://issues.apache.org/jira/browse/FLINK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sendoh updated FLINK-5368:
--------------------------
    Description: 
As a developer when reading data from many topics, I want Kafka consumer to 
show something if any topic is not available. The motivation is we read many 
topics as list at one time, and sometimes we fail to recognize that one or two 
topics' names have been changed or deprecated, and Flink Kafka connector 
doesn't show the error.

My proposed change would be either to throw RuntimeException or to use 
LOG.error(topic + "doesn't have any partition") if partitionsForTopic is null 
at this function. 
https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer09.java#L208

Any suggestion is welcome.

  was:
As a developer when reading data from many topics, I want Kafka consumer show 
something if any topic is not available. The motivation is we read many topics 
as list at one time, and sometimes we fail to recognize that one or two topics' 
names have been changed or deprecated, and Flink Kafka connector doesn't show 
the error.

My proposed change would be either to throw RuntimeException or to use 
LOG.error(topic + "doesn't have any partition") if partitionsForTopic is null 
at this function. 
https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer09.java#L208

Any suggestion is welcome.


> Let Kafka consumer show something when it fails to read one topic out of 
> topic list
> -----------------------------------------------------------------------------------
>
>                 Key: FLINK-5368
>                 URL: https://issues.apache.org/jira/browse/FLINK-5368
>             Project: Flink
>          Issue Type: Improvement
>          Components: Kafka Connector
>            Reporter: Sendoh
>            Assignee: Sendoh
>            Priority: Minor
>
> As a developer when reading data from many topics, I want Kafka consumer to 
> show something if any topic is not available. The motivation is we read many 
> topics as list at one time, and sometimes we fail to recognize that one or 
> two topics' names have been changed or deprecated, and Flink Kafka connector 
> doesn't show the error.
> My proposed change would be either to throw RuntimeException or to use 
> LOG.error(topic + "doesn't have any partition") if partitionsForTopic is null 
> at this function. 
> https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer09.java#L208
> Any suggestion is welcome.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to