Hi, Aniket Thanks for your reply I checked the log from /tmp/kafka-logs/ There are some empty files, likes 00000000000000000000.index, 00000000000000000000.log. I cannot find any useful information there. However, i found some other interesting things, I have posted here https://mail.google.com/mail/ca/u/0/#label/TechDiscuss/141a5c074641dd70 Please have a look. Thanks a lot.
2013/10/11 Aniket Bhatnagar <aniket.bhatna...@gmail.com> > Hi Jiang > > Just thinking out loud, it could be because Kafka can't connect to > Zookeeper. Can you check Kafka logs to validate the same? > > > On 11 October 2013 08:22, Jiang Jacky <jiang0...@gmail.com> wrote: > > > Hi, Everyone, I use the larger memory instance to replace that small one, > > for now, I can create the topic, but when I try to produce message, it > > still gives the same error. > > Its so weird. can any one help me? Thanks > > > > > > 2013/10/10 Jiang Jacky <jiang0...@gmail.com> > > > > > Another thing need is my instance comes with very small memory, just > > 683M, > > > I am not sure if it is related. I will try to use 8G memory instance. > > > > > > > > > 2013/10/10 Jiang Jacky <jiang0...@gmail.com> > > > > > >> yes, even I cannot create new topic, same error, leadernotavailable. > > >> My zookeeper and storm all are working very well, except of Kafka. > > >> > > >> > > >> 2013/10/10 Neha Narkhede <neha.narkh...@gmail.com> > > >> > > >>> Are you trying to produce these messages to a newly created topic? > > >>> > > >>> > > >>> On Thu, Oct 10, 2013 at 6:15 PM, Jiang Jacky <jiang0...@gmail.com> > > >>> wrote: > > >>> > > >>> > can anyone help me? Thanks a lot > > >>> > > > >>> > > > >>> > 2013/10/10 Jiang Jacky <jiang0...@gmail.com> > > >>> > > > >>> > > Hi, I run into kafka issue recently, when I try to produce a > > >>> message, it > > >>> > > gives me follow error > > >>> > > > > >>> > > [2013-10-11 00:30:26,740] INFO Fetching metadata from broker > > >>> > > id:0,host:localhost,port:9092 with correlation id 47 for 1 > topic(s) > > >>> > > Set(my-replicated-topic) (kafka.client.ClientUtils$) > > >>> > > [2013-10-11 00:30:26,741] INFO Connected to localhost:9092 for > > >>> producing > > >>> > > (kafka.producer.SyncProducer) > > >>> > > [2013-10-11 00:30:26,753] INFO Disconnecting from localhost:9092 > > >>> > > (kafka.producer.SyncProducer) > > >>> > > [2013-10-11 00:30:26,753] INFO Closing socket connection to / > > >>> 127.0.0.1. > > >>> > > (kafka.network.Processor) > > >>> > > [2013-10-11 00:30:26,754] WARN Error while fetching metadata > > >>> > > [{TopicMetadata for topic my-replicated-topic -> > > >>> > > No partition metadata for topic my-replicated-topic due to > > >>> > > kafka.common.LeaderNotAvailableException}] for topic > > >>> > [my-replicated-topic]: > > >>> > > class kafka.common.LeaderNotAvailableException > > >>> > > (kafka.producer.BrokerPartitionInfo) > > >>> > > [2013-10-11 00:30:26,755] ERROR Failed to collate messages by > > topic, > > >>> > > partition due to: Failed to fetch topic metadata for topic: > > >>> > > my-replicated-topic (kafka.producer.async.DefaultEventHandler) > > >>> > > [2013-10-11 00:30:26,755] INFO Back off for 100 ms before > retrying > > >>> send. > > >>> > > Remaining retries = 0 (kafka.producer.async.DefaultEventHandler) > > >>> > > [2013-10-11 00:30:26,856] INFO Fetching metadata from broker > > >>> > > id:0,host:localhost,port:9092 with correlation id 48 for 1 > topic(s) > > >>> > > Set(my-replicated-topic) (kafka.client.ClientUtils$) > > >>> > > [2013-10-11 00:30:26,857] INFO Connected to localhost:9092 for > > >>> producing > > >>> > > (kafka.producer.SyncProducer) > > >>> > > [2013-10-11 00:30:26,874] INFO Disconnecting from localhost:9092 > > >>> > > (kafka.producer.SyncProducer) > > >>> > > [2013-10-11 00:30:26,874] INFO Closing socket connection to / > > >>> 127.0.0.1. > > >>> > > (kafka.network.Processor) > > >>> > > [2013-10-11 00:30:26,875] WARN Error while fetching metadata > > >>> > > [{TopicMetadata for topic my-replicated-topic -> > > >>> > > No partition metadata for topic my-replicated-topic due to > > >>> > > kafka.common.LeaderNotAvailableException}] for topic > > >>> > [my-replicated-topic]: > > >>> > > class kafka.common.LeaderNotAvailableException > > >>> > > (kafka.producer.BrokerPartitionInfo) > > >>> > > [2013-10-11 00:30:26,876] ERROR Failed to send requests for > topics > > >>> > > my-replicated-topic with correlation ids in [41,48] > > >>> > > (kafka.producer.async.DefaultEventHandler) > > >>> > > [2013-10-11 00:30:26,876] ERROR Error in handling batch of 1 > events > > >>> > > (kafka.producer.async.ProducerSendThread) > > >>> > > kafka.common.FailedToSendMessageException: Failed to send > messages > > >>> after > > >>> > 3 > > >>> > > tries. > > >>> > > at > > >>> > > > > >>> > > > >>> > > > kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:90) > > >>> > > at > > >>> > > > > >>> > > > >>> > > > kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104) > > >>> > > at > > >>> > > > > >>> > > > >>> > > > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:87) > > >>> > > at > > >>> > > > > >>> > > > >>> > > > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:67) > > >>> > > at > > >>> scala.collection.immutable.Stream.foreach(Stream.scala:254) > > >>> > > at > > >>> > > > > >>> > > > >>> > > > kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:66) > > >>> > > at > > >>> > > > > >>> > > kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44) > > >>> > > > > >>> > > > > >>> > > I have no idea why the leader is not available.Can someone give > me > > a > > >>> > hint? > > >>> > > Thanks a lot. > > >>> > > > > >>> > > > >>> > > >> > > >> > > > > > >