ttps://cwiki.apache.org/confluence/display/KAFKA/KIP-91+Provide+Intuitive+User+Timeouts+in+The+Producer
> Async producer send not retrying on TimeoutException: Batch Expired
> ---
>
> Key: KAFKA-4515
>
onse with correlation id {} on
topic-partition {}, retrying ({} attempts left). Error" items in the producer
log when enabling retry?
> Async producer send not retrying on TimeoutException: Batch Expired
> ---
>
>
rue) {
ProducerRecord record =
new ProducerRecord<>("my-topic", i.toString());
send(record);
Thread.sleep(100);
i++;
}
}
{code}
What we found is that when we set *request.timeout.ms* to a small value like
Di Shang created KAFKA-4515:
---
Summary: Async producer send not retrying on TimeoutException:
Batch Expired
Key: KAFKA-4515
URL: https://issues.apache.org/jira/browse/KAFKA-4515
Project: Kafka
pull request at:
https://github.com/apache/kafka/pull/1791
> KafkaProducer raises Batch Expired exception
> -
>
> Key: KAFKA-4089
> URL: https://issues.apache.org/jira/browse/KAFKA-4089
>
_gh...@comcast.com> wrote:
> Hi Krishna,
> Thank you for your response.
>
> Connections already made but if we increase the request timeout 5 times
> let's say request.timeout.ms= 5*60000 , then the number of 'Batch
> Expired ' exception is les
Hi Krishna,
Thank you for your response.
Connections already made but if we increase the request timeout 5 times let's
say request.timeout.ms= 5*6 , then the number of 'Batch Expired '
exception is less, so what is the recommended value for ' request.timeout.ms '
gt; What is the recommended Producer setting for Producer as I see a lot of
> Batch Expired exception even though I put request.timeout=6.
>
> Producer settings:
> acks=1
> retries=3
> batch.size=16384
> linger.ms=5
> buffer.memory=33554432
> request.timeout.ms=6000
[
https://issues.apache.org/jira/browse/KAFKA-4089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sumant Tambe reassigned KAFKA-4089:
---
Assignee: Sumant Tambe (was: Dong Lin)
> KafkaProducer raises Batch Expired except
Hi there,
What is the recommended Producer setting for Producer as I see a lot of Batch
Expired exception even though I put request.timeout=6.
Producer settings:
acks=1
retries=3
batch.size=16384
linger.ms=5
buffer.memory=33554432
request.timeout.ms=6
timeout.ms=6
Thanks
Achintya
uest:
https://github.com/apache/kafka/pull/1791
KAFKA-4089: KafkaProducer expires batch when metadata is stale
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sutambe/kafka batch-expired
Alternatively you can review and apply t
xpire batches only when the following is true
# meta-data is fresh AND
# batch remained in the queue longer than request timeout.
> KafkaProducer raises Batch Expired exception
> -
>
> Key: KAFKA-4089
> URL:
but not sufficient. It should additionally restrict ejection when
metadata is stale.
Conversely, it should expire batches only when the following is true
# !muted AND
# meta-data is fresh but leader not available
# batch remained in the queue longer than request timeout.
&
the following is true
# !muted AND
# meta-data is fresh but leader not available
# batch remained in the queue longer than request timeout.
> KafkaProducer raises Batch Expired exception
> -
>
> Key: KAFKA-4089
>
ches only when the following is true
# !muted AND
# meta-data is fresh but leader not available
> KafkaProducer raises Batch Expired exception
> -
>
> Key: KAFKA-4089
> URL: https://issues.apache.org/
meta-data is fresh but leader not available
> KafkaProducer raises Batch Expired exception
> -
>
> Key: KAFKA-4089
> URL: https://issues.apache.org/jira/browse/KAFKA-4089
> Project: Kafka
[
https://issues.apache.org/jira/browse/KAFKA-4089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dong Lin reassigned KAFKA-4089:
---
Assignee: Dong Lin
> KafkaProducer raises Batch Expired except
Sumant Tambe created KAFKA-4089:
---
Summary: KafkaProducer raises Batch Expired exception
Key: KAFKA-4089
URL: https://issues.apache.org/jira/browse/KAFKA-4089
Project: Kafka
Issue Type: Bug
18 matches
Mail list logo
