Hi, I am using Apache NiFi to read data form Kafka which runs as part of Hortonworks HDP 2.4. I use GetKafka processor to read messages form a topic but see the exception bellow. What can be wrong?
2016-05-26 17:13:36,776 INFO [d217bceb-d58b-4031-9143-26d8ddd15e40_BPIW01a-1464297163195-b78e95a5-leader-finder-thread] kafka.consumer.ConsumerFetcherManager [ConsumerFetcherManager-1464297163222] Added fetcher for partitions ArrayBuffer() 2016-05-26 17:13:36,981 INFO [d217bceb-d58b-4031-9143-26d8ddd15e40_BPIW01a-1464297163195-b78e95a5-leader-finder-thread] kafka.utils.VerifiableProperties Verifying properties 2016-05-26 17:13:36,981 INFO [d217bceb-d58b-4031-9143-26d8ddd15e40_BPIW01a-1464297163195-b78e95a5-leader-finder-thread] kafka.utils.VerifiableProperties Property client.id is overridden to NiFi-d217bceb-d58b-4031-9143-26d8ddd15e40 2016-05-26 17:13:36,981 INFO [d217bceb-d58b-4031-9143-26d8ddd15e40_BPIW01a-1464297163195-b78e95a5-leader-finder-thread] kafka.utils.VerifiableProperties Property metadata.broker.list is overridden to 10.1.132.113:6667 2016-05-26 17:13:36,981 INFO [d217bceb-d58b-4031-9143-26d8ddd15e40_BPIW01a-1464297163195-b78e95a5-leader-finder-thread] kafka.utils.VerifiableProperties Property request.timeout.ms is overridden to 30000 2016-05-26 17:13:36,981 INFO [d217bceb-d58b-4031-9143-26d8ddd15e40_BPIW01a-1464297163195-b78e95a5-leader-finder-thread] kafka.client.ClientUtils$ Fetching metadata from broker id:1001,host:10.1.132.113,port:6667 with correlation id 256 for 1 topic(s) Set(Test1) 2016-05-26 17:13:36,981 INFO [d217bceb-d58b-4031-9143-26d8ddd15e40_BPIW01a-1464297163195-b78e95a5-leader-finder-thread] kafka.producer.SyncProducer Connected to 10.1.132.113:6667 for producing 2016-05-26 17:13:36,981 INFO [d217bceb-d58b-4031-9143-26d8ddd15e40_BPIW01a-1464297163195-b78e95a5-leader-finder-thread] kafka.producer.SyncProducer Disconnecting from 10.1.132.113:6667 2016-05-26 17:13:36,981 WARN [d217bceb-d58b-4031-9143-26d8ddd15e40_BPIW01a-1464297163195-b78e95a5-leader-finder-thread] kafka.client.ClientUtils$ Fetching topic metadata with correlation id 256 for topics [Set(Test1)] from broker [id:1001,host:10.1.132.113,port:6667] failed java.nio.channels.ClosedChannelException: null at kafka.network.BlockingChannel.send(BlockingChannel.scala:100) ~[kafka_2.10-0.8.2.2.jar:na] at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:73) ~[kafka_2.10-0.8.2.2.jar:na] at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:72) ~[kafka_2.10-0.8.2.2.jar:na] at kafka.producer.SyncProducer.send(SyncProducer.scala:113) ~[kafka_2.10-0.8.2.2.jar:na] at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:58) [kafka_2.10-0.8.2.2.jar:na] at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:93) [kafka_2.10-0.8.2.2.jar:na] at kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:66) [kafka_2.10-0.8.2.2.jar:na] at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60) [kafka_2.10-0.8.2.2.jar:na] 2016-05-26 17:13:36,981 INFO [d217bceb-d58b-4031-9143-26d8ddd15e40_BPIW01a-1464297163195-b78e95a5-leader-finder-thread] kafka.producer.SyncProducer Disconnecting from 10.1.132.113:6667 2016-05-26 17:13:36,981 WARN [d217bceb-d58b-4031-9143-26d8ddd15e40_BPIW01a-1464297163195-b78e95a5-leader-finder-thread] k.c.ConsumerFetcherManager$LeaderFinderThread [d217bceb-d58b-4031-9143-26d8ddd15e40_BPIW01a-1464297163195-b78e95a5-leader-finder-thread], Failed to find leader for Set([Test1,0]) kafka.common.KafkaException: fetching topic metadata for topics [Set(Test1)] from broker [ArrayBuffer(id:1001,host:10.1.132.113,port:6667)] failed at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:72) ~[kafka_2.10-0.8.2.2.jar:na] at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:93) ~[kafka_2.10-0.8.2.2.jar:na] at kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:66) ~[kafka_2.10-0.8.2.2.jar:na] at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60) [kafka_2.10-0.8.2.2.jar:na] Caused by: java.nio.channels.ClosedChannelException: null at kafka.network.BlockingChannel.send(BlockingChannel.scala:100) ~[kafka_2.10-0.8.2.2.jar:na] at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:73) ~[kafka_2.10-0.8.2.2.jar:na] at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:72) ~[kafka_2.10-0.8.2.2.jar:na] at kafka.producer.SyncProducer.send(SyncProducer.scala:113) ~[kafka_2.10-0.8.2.2.jar:na] at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:58) ~[kafka_2.10-0.8.2.2.jar:na] ... 3 common frames omitted
