[
https://issues.apache.org/jira/browse/KAFKA-4610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15820941#comment-15820941
]
sandeep kumar singh commented on KAFKA-4610:
--------------------------------------------
thanks for the update. i am trying to check in broker logs. but non of the
brokers throwing any exceptions when this error occurred. i am seeing this
error "ERROR Error when sending message to topic test3R3P3 with key: null,
value: 4096 bytes with error:
(org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
expired due to timeout while requesting metadata from brokers for test3R3P3-0"
every time i run producer.
producer command - cat kafka_output.log | bin/kafka-console-producer.sh
--broker-list localhost:9092,localhost:9093,localhost:9094 --batch-size 1000
--message-send-max-retries 10 --request-required-acks -1 --topic test3R3P3
kafka_output.log has 100000 records of 4096 length each
i see this error even when all brokers are healthy and all partitions have
valid leaders.
are you saying brokers restarts internally may be due to load? but when i check
the UNIX Process ID of brokers before and after running broker, i see the PID
is same. which means the brokers are not restarted.
> getting error:Batch containing 3 record(s) expired due to timeout while
> requesting metadata from brokers for test2R2P2-1
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-4610
> URL: https://issues.apache.org/jira/browse/KAFKA-4610
> Project: Kafka
> Issue Type: Bug
> Environment: Dev
> Reporter: sandeep kumar singh
>
> i a getting below error when running producer client, which take messages
> from an input file kafka_message.log. this log file is pilled with 100000
> records per second of each message of length 4096
> error -
> [2017-01-09 14:45:24,813] ERROR Error when sending message to topic test2R2P2
> with key: null, value: 4096 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
> expired due to timeout while requesting metadata from brokers for test2R2P2-0
> [2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2
> with key: null, value: 4096 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
> expired due to timeout while requesting metadata from brokers for test2R2P2-0
> [2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2
> with key: null, value: 4096 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
> expired due to timeout while requesting metadata from brokers for test2R2P2-0
> [2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2
> with key: null, value: 4096 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
> expired due to timeout while requesting metadata from brokers for test2R2P2-0
> [2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2
> with key: null, value: 4096 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
> expired due to timeout while requesting metadata from brokers for test2R2P2-0
> command i run :
> $ bin/kafka-console-producer.sh --broker-list x.x.x.x:xxxx,x.x.x.x:xxxx
> --batch-size 1000 --message-send-max-retries 10 --request-required-acks 1
> --topic test2R2P2 <~/kafka_message.log
> there are 2 brokers running and the topic has partitions = 2 and replication
> factor 2.
> Could you please help me understand what does that error means?
> also i see message loss when i manually restart one of the broker and while
> kafak-producer-perf-test command is running? is this a expected behavior?
> thanks
> Sandeep
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
