[ https://issues.apache.org/jira/browse/KAFKA-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13932559#comment-13932559 ]
Guozhang Wang commented on KAFKA-1303: -------------------------------------- I am wondering why with the new producer we could have a high chance of queued-up produce requests? If it is due to the higher throughput would that makes the replica to complete the fetch sooner and hence hence shorten produce request handling time? > metadata request in the new producer can be delayed > --------------------------------------------------- > > Key: KAFKA-1303 > URL: https://issues.apache.org/jira/browse/KAFKA-1303 > Project: Kafka > Issue Type: Bug > Components: core > Affects Versions: 0.8.2 > Reporter: Jun Rao > > While debugging a system test, I observed the following. > 1. A broker side configuration > (replica.fetch.wait.max.ms=500,replica.fetch.min.bytes=4096) made the time to > complete a produce request long (each taking about 500ms with ack=-1). > 2. The producer client has a bunch of outstanding produce requests queued up > on the brokers. > 3. One of the brokers fails and we force updating the metadata. > 4. The metadata request is queued up behind those outstanding producer > requests. > 5. By the time the metadata response comes back, some messages have failed > all retries because of stale metadata. -- This message was sent by Atlassian JIRA (v6.2#6252)