We are running 0.8.1.1, am experiencing following issue, any clue I have 7 topics in my Kafka cluster of 5 nodes. I pushed 1 million messages to each topic using perf producer tool (no compression, no acknowledgement) . I saw old messages about a bug in 0.8 Consumer code and it is fixed but I am still experiencing this issue /opt/kafka/kafka-0.8.1.1-src/bin/kafka-producer-perf-test.sh --topics ${dc}-perf-topic${topic} --messages 142857 --message-size 2000 --broker-list ${listBroker} --threads ${threads} --request-num-acks ${acks} --compression-codec ${codec} > ${logFileProd}.${dc}.topic${topic}.log 2>&1
After Producers populated topics, I run 7 consumers to consume from each above topic (1 consumer from 1 topic only) using Consumer Perf tool using below command /opt/kafka/kafka-0.8.1.1-src/bin/kafka-consumer-perf-test.sh --zookeeper ${listZoo}/kafka --from-latest --topic ${dc}-perf-topic${topic} --compression-codec ${codec} > ${logFileConsume}.${dc}.topic${topic}.log 2>&1 All my consumers end up with following message start.time, end.time, fetch.size, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.secSLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".SLF4J: Defaulting to no-operation (NOP) logger implementationSLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.[2015-03-20 18:51:36,890] WARN [perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec], No broker partitions consumed by consumer thread perf-consumer-68009_gckcnsys090001.1426877494243-2472feec-8 for topic dc7-perf-topic7 (kafka.consumer.ZookeeperConsumerConnector)[2015-03-20 18:51:36,903] WARN [perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec], No broker partitions consumed by consumer thread perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec-7 for topic dc7-perf-topic7 (kafka.consumer.ZookeeperConsumerConnector)[2015-03-20 18:51:36,904] WARN [perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec], No broker partitions consumed by consumer thread perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec-4 for topic dc7-perf-topic7 (kafka.consumer.ZookeeperConsumerConnector)[2015-03-20 18:51:36,906] WARN [perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec], No broker partitions consumed by consumer thread perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec-1 for topic dc7-perf-topic7 (kafka.consumer.ZookeeperConsumerConnector)[2015-03-20 18:51:36,906] WARN [perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec], No broker partitions consumed by consumer thread perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec-5 for topic dc7-perf-topic7 (kafka.consumer.ZookeeperConsumerConnector)[2015-03-20 18:51:36,907] WARN [perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec], No broker partitions consumed by consumer thread perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec-2 for topic dc7-perf-topic7 (kafka.consumer.ZookeeperConsumerConnector)[2015-03-20 18:51:36,907] WARN [perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec], No broker partitions consumed by consumer thread perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec-9 for topic dc7-perf-topic7 (kafka.consumer.ZookeeperConsumerConnector)[2015-03-20 18:51:36,907] WARN [perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec], No broker partitions consumed by consumer thread perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec-3 for topic dc7-perf-topic7 (kafka.consumer.ZookeeperConsumerConnector)[2015-03-20 18:51:36,907] WARN [perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec], No broker partitions consumed by consumer thread perf-consumer-68009_gckcnsys090001.c090.net-1426877494243-2472feec-6 for topic dc7-perf-topic7 (kafka.consumer.ZookeeperConsumerConnector)2015-03-20 18:51:37:939, 2015-03-20 18:51:42:960, 1048576, 0.0000, 0.0000, 0, 0.0000 Naidu Saladi