Do you see the following warn messages on the producer ?
Fetching topic metadata with correlation id %d for topics [%s] from broker
[%s] failed
fetching topic metadata for topics [%s] from broker [%s] failed
On the server side -
1. could you enable DEBUG on kafka.server.KafkaApis and see if y
I did some more debugging and found the corresponding debug message on the
broker for topic (417topic1381383668416) in the producer:
Seems like broker is removing fetcher for partition as producer throws no
metadata for topic.
[2013-10-09 22:41:09,529] INFO [Log Manager on Broker 2] Created log
I could not see such messages (Error while fetching metadata [%s] for topic
[%s]: %s ")
In the perf test, I create new topic for sending the JSON blob in a new
producer thread.
The error happened when I increased no. of files (mapping to producer
threads). There are already topics of previous pe
Do you see WARN messages like -
"Error while fetching metadata [%s] for topic [%s]: %s "
OR
"Error while fetching metadata %s for topic partition [%s,%d]: [%s]"
On Wed, Oct 9, 2013 at 5:49 PM, Shafaq wrote:
> yes I'm using 0.8 head
>
>
> roducer starting with option to multi-thread
> compr
yes I'm using 0.8 head
roducer starting with option to multi-thread
compressed---true
Exception in thread "pool-1-thread-1" kafka.common.KafkaException: Failed
to fetch topic metadata for topic: 225topic1381362148396
at
kafka.producer.BrokerPartitionInfo.getBrokerPartitionInfo(BrokerParti
Are you using 0.8 HEAD ?
Can you send around the full stack trace since one of the common reasons
for failed topic metadata requests are socket timeouts.
Thanks,
Neha
On Wed, Oct 9, 2013 at 4:30 PM, Shafaq wrote:
> I run into following error while doing some performance testing in Kafka
> wit
I run into following error while doing some performance testing in Kafka
with producers running in multiple threads.
I can see the topic under /broker/topics in zooKeeper
I believe the producer tries to get the metadata info from Zookeeper.
I have tried to restart the 2-node Kafka broker cluster
