The FlinkKafkaConsumer takes the two arguments --bootstrap.servers (kafka servers) and --zookeeper.connect (zookeeper servers). Then it seems to resolve Kafka brokers from zookeeper, and uses those host names to consume kafka. But it also connects to the given bootstrap servers to fetch some metadata, it seems.
This is problematic when zookeeper uses internal kafka hostnames – consuming won't work when those resolved kafka hosts can't be reached. Could the consumer be changed to - respect the provided kafka hosts / ips and not use host names resolved from zookeeper and optionally - not require bootstrap.servers argument at all, just resolve broker host names from zookeeper and use those as "bootstrap servers", too? Is the concept of bootstrap server something entirely else, or what am I missing here? Thanks! -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/FlinkKafkaConsumer-bootstrap-servers-vs-broker-hosts-tp3109.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.
