Hi please find below the o/p of the list and the console producer. There
are no errors in the state change log or in the controller log.
One thing i found is this one happens only at starting time. I mean the
first time, when i start kafka and try to insert the messages i see this
error.
arjunn@PRINHYLTPDL0061:~/Kafka/kafka_2.8.0-0.8.0$ bin/kafka-run-class.sh
kafka.tools.ConsumerOffsetChecker --group group1 --zkconnect
localhost:2181,localhost:2182,localhost:2183 --topic test
Group Topic Pid Offset logSize
Lag Owner
arjunn@PRINHYLTPDL0061:~/Kafka/kafka_2.8.0-0.8.0$
bin/kafka-console-producer.sh --broker-list
localhost:9092,localhost:9093,localhost:9094
--topic test
THis ia s test message
[2014-02-22 14:16:26,924] WARN Error while fetching metadata
[{TopicMetadata for topic test ->
No partition metadata for topic test due to
kafka.common.LeaderNotAvailableException}]
for topic [test]: class kafka.common.LeaderNotAvailableException
(kafka.producer.BrokerPartitionInfo)
[2014-02-22 14:16:27,120] WARN Error while fetching metadata
[{TopicMetadata for topic test ->
No partition metadata for topic test due to
kafka.common.LeaderNotAvailableException}]
for topic [test]: class kafka.common.LeaderNotAvailableException
(kafka.producer.BrokerPartitionInfo)
[2014-02-22 14:16:27,121] ERROR Failed to collate messages by topic,
partition due to: Failed to fetch topic metadata for topic: test
(kafka.producer.async.DefaultEventHandler)
[2014-02-22 14:16:27,259] WARN Error while fetching metadata
[{TopicMetadata for topic test ->
No partition metadata for topic test due to
kafka.common.LeaderNotAvailableException}]
for topic [test]: class kafka.common.LeaderNotAvailableException
(kafka.producer.BrokerPartitionInfo)
[2014-02-22 14:16:27,293] WARN Error while fetching metadata
[{TopicMetadata for topic test ->
No partition metadata for topic test due to
kafka.common.LeaderNotAvailableException}]
for topic [test]: class kafka.common.LeaderNotAvailableException
(kafka.producer.BrokerPartitionInfo)
[2014-02-22 14:16:27,295] ERROR Failed to collate messages by topic,
partition due to: Failed to fetch topic metadata for topic: test
(kafka.producer.async.DefaultEventHandler)
[2014-02-22 14:16:27,443] WARN Error while fetching metadata
[{TopicMetadata for topic test ->
No partition metadata for topic test due to
kafka.common.LeaderNotAvailableException}]
for topic [test]: class kafka.common.LeaderNotAvailableException
(kafka.producer.BrokerPartitionInfo)
[2014-02-22 14:16:27,499] WARN Error while fetching metadata
[{TopicMetadata for topic test ->
No partition metadata for topic test due to
kafka.common.LeaderNotAvailableException}]
for topic [test]: class kafka.common.LeaderNotAvailableException
(kafka.producer.BrokerPartitionInfo)
[2014-02-22 14:16:27,499] ERROR Failed to collate messages by topic,
partition due to: Failed to fetch topic metadata for topic: test
(kafka.producer.async.DefaultEventHandler)
[2014-02-22 14:16:27,630] WARN Error while fetching metadata
[{TopicMetadata for topic test ->
No partition metadata for topic test due to
kafka.common.LeaderNotAvailableException}]
for topic [test]: class kafka.common.LeaderNotAvailableException
(kafka.producer.BrokerPartitionInfo)
[2014-02-22 14:16:27,693] WARN Error while fetching metadata
[{TopicMetadata for topic test ->
No partition metadata for topic test due to
kafka.common.LeaderNotAvailableException}]
for topic [test]: class kafka.common.LeaderNotAvailableException
(kafka.producer.BrokerPartitionInfo)
[2014-02-22 14:16:27,694] ERROR Failed to collate messages by topic,
partition due to: Failed to fetch topic metadata for topic: test
(kafka.producer.async.DefaultEventHandler)
[2014-02-22 14:16:27,881] WARN Error while fetching metadata
[{TopicMetadata for topic test ->
No partition metadata for topic test due to
kafka.common.LeaderNotAvailableException}]
for topic [test]: class kafka.common.LeaderNotAvailableException
(kafka.producer.BrokerPartitionInfo)
[2014-02-22 14:16:27,884] ERROR Failed to send requests for topics test
with correlation ids in [0,8] (kafka.producer.async.DefaultEventHandler)
[2014-02-22 14:16:27,886] ERROR Error in handling batch of 1 events
(kafka.producer.async.ProducerSendThread)
kafka.common.FailedToSendMessageException: Failed to send messages after
3 tries.
at kafka.producer.async.DefaultEventHandler.handle(
DefaultEventHandler.scala:90)
at kafka.producer.async.ProducerSendThread.tryToHandle(
ProducerSendThread.scala:104)
at kafka.producer.async.ProducerSendThread$$anonfun$
processEvents$3.apply(ProducerSendThread.scala:87)
at kafka.producer.async.ProducerSendThread$$anonfun$
processEvents$3.apply(ProducerSendThread.scala:67)
at scala.collection.immutable.Stream.foreach(Stream.scala:254)
at kafka.producer.async.ProducerSendThread.processEvents(
ProducerSendThread.scala:66)
at kafka.producer.async.ProducerSendThread.run(
ProducerSendThread.scala:44)
arjunn@PRINHYLTPDL0061:~/Kafka/kafka_2.8.0-0.8.0$ bin/kafka-list-topic.sh
--zookeeper localhost:2181
topic: test partition: 0 leader: 2 replicas: 2,0 isr: 2,0
topic: test partition: 1 leader: 0 replicas: 0,1 isr: 0,1
topic: test partition: 2 leader: 1 replicas: 1,2 isr: 1,2
topic: test partition: 3 leader: 2 replicas: 2,1 isr: 2,1
topic: test partition: 4 leader: 0 replicas: 0,2 isr: 0,2
topic: test partition: 5 leader: 1 replicas: 1,0 isr: 1,0
topic: test partition: 6 leader: 2 replicas: 2,0 isr: 2,0
topic: test partition: 7 leader: 0 replicas: 0,1 isr: 0,1
topic: test partition: 8 leader: 1 replicas: 1,2 isr: 1,2
topic: test partition: 9 leader: 2 replicas: 2,1 isr: 2,1
topic: test partition: 10 leader: 0 replicas: 0,2 isr: 0,2
topic: test partition: 11 leader: 1 replicas: 1,0 isr: 1,0
What i did:
started 3 kafka processes in my system.The config is default config with
just the ports and log dir's changed.There are 3 zookeeper servers running.
If i start the console producer next time it will work fine.
To reproduce what did was, stopped all the kafka and zookeeper process,
deleted the log dirs of the kafka and the zookeeper and restated the
processes.
Thanks
Arjun Narasimha Kota
On Friday 21 February 2014 09:41 PM, Jun Rao wrote:
Could you do a list topic and show the output? Also, any error in the
controller and state-change log?
Thanks,
Jun
On Fri, Feb 21, 2014 at 2:33 AM, Arjun <ar...@socialtwist.com> wrote:
hi,
I am testing kafka 0.8 on my local machine. i have only one zookeeper and
one kafka broker running.
when i run the console producer i get this error:
[2014-02-21 16:01:20,512] WARN Error while fetching metadata
[{TopicMetadata for topic test ->
No partition metadata for topic test due to kafka.common.
LeaderNotAvailableException}]
for topic [test]: class kafka.common.LeaderNotAvailableException
(kafka.producer.BrokerPartitionInfo)
[2014-02-21 16:01:20,513] ERROR Failed to collate messages by topic,
partition due to: Failed to fetch topic metadata for topic: test
(kafka.producer.async.DefaultEventHandler)
[2014-02-21 16:01:20,632] WARN Error while fetching metadata
[{TopicMetadata for topic test ->
No partition metadata for topic test due to kafka.common.
LeaderNotAvailableException}]
for topic [test]: class kafka.common.LeaderNotAvailableException
(kafka.producer.BrokerPartitionInfo)
[2014-02-21 16:01:20,636] ERROR Failed to send requests for topics test
with correlation ids in [0,8] (kafka.producer.async.DefaultEventHandler)
ERROR Error in handling batch of 1 events (kafka.producer.async.
ProducerSendThread)
kafka.common.FailedToSendMessageException: Failed to send messages after
3 tries.
at kafka.producer.async.DefaultEventHandler.handle(
DefaultEventHandler.scala:90)
at kafka.producer.async.ProducerSendThread.tryToHandle(
ProducerSendThread.scala:104)
at kafka.producer.async.ProducerSendThread$$anonfun$
processEvents$3.apply(ProducerSendThread.scala:87)
at kafka.producer.async.ProducerSendThread$$anonfun$
processEvents$3.apply(ProducerSendThread.scala:67)
at scala.collection.immutable.Stream.foreach(Stream.scala:254)
at kafka.producer.async.ProducerSendThread.processEvents(
ProducerSendThread.scala:66)
at kafka.producer.async.ProducerSendThread.run(
ProducerSendThread.scala:44)
Can some one please let me know why this is happening.
I checked my vhost files and localhost, my hostname are correct.
