[
https://issues.apache.org/jira/browse/KAFKA-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joe Devilla updated KAFKA-7825:
-------------------------------
Description:
I am trying to reproduce production traffic on a test Kafka instance using
MirrorMaker.
I have a batch job which pulls from my Kafka brokers every 15 minutes. However,
my Kafka MirrorMaker fails intermittently with the following message:
[2019-01-15 17:00:41,215] ERROR Error when sending message to topic topic-name
with key: 24 bytes, value: 3232 bytes with error:
(org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
org.apache.kafka.common.errors.TimeoutException: Expiring 9 record(s) for
topic-name: 30934 ms has passed since last append
[2019-01-15 17:34:33,108] ERROR Error when sending message to topic topic-name
with key: 24 bytes, value: 824 bytes with error:
(org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
java.lang.IllegalStateException: Producer is closed forcefully. at
org.apache.kafka.clients.producer.internals.RecordAccumulator.abortBatches(RecordAccumulator.java:696)
at
org.apache.kafka.clients.producer.internals.RecordAccumulator.abortIncompleteBatches(RecordAccumulator.java:683)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:185) at
java.lang.Thread.run(Thread.java:748)
I looked at my kafka logs, but do not see any errors. Is there a MirrorMaker
config value that I need to set?
was:
I am trying to reproduce production traffic on a test Kafka instance using
MirrorMaker.
I have a batch job which pulls from my Kafka brokers every 15 minutes. However,
my Kafka MirrorMaker fails intermittently with the following message:
[2019-01-15 17:34:33,108] ERROR Error when sending message to topic topic-name
with key: 24 bytes, value: 824 bytes with error:
(org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
java.lang.IllegalStateException: Producer is closed forcefully. at
org.apache.kafka.clients.producer.internals.RecordAccumulator.abortBatches(RecordAccumulator.java:696)
at
org.apache.kafka.clients.producer.internals.RecordAccumulator.abortIncompleteBatches(RecordAccumulator.java:683)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:185) at
java.lang.Thread.run(Thread.java:748)
I looked at my kafka logs, but do not see any errors. Is there a MirrorMaker
config value that I need to set?
> Kafka MirrorMaker crashes unexpectedly
> --------------------------------------
>
> Key: KAFKA-7825
> URL: https://issues.apache.org/jira/browse/KAFKA-7825
> Project: Kafka
> Issue Type: Bug
> Components: mirrormaker
> Affects Versions: 1.1.0
> Reporter: Joe Devilla
> Priority: Major
>
> I am trying to reproduce production traffic on a test Kafka instance using
> MirrorMaker.
> I have a batch job which pulls from my Kafka brokers every 15 minutes.
> However, my Kafka MirrorMaker fails intermittently with the following message:
> [2019-01-15 17:00:41,215] ERROR Error when sending message to topic
> topic-name with key: 24 bytes, value: 3232 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Expiring 9 record(s) for
> topic-name: 30934 ms has passed since last append
>
> [2019-01-15 17:34:33,108] ERROR Error when sending message to topic
> topic-name with key: 24 bytes, value: 824 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> java.lang.IllegalStateException: Producer is closed forcefully. at
> org.apache.kafka.clients.producer.internals.RecordAccumulator.abortBatches(RecordAccumulator.java:696)
> at
> org.apache.kafka.clients.producer.internals.RecordAccumulator.abortIncompleteBatches(RecordAccumulator.java:683)
> at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:185)
> at java.lang.Thread.run(Thread.java:748)
>
> I looked at my kafka logs, but do not see any errors. Is there a MirrorMaker
> config value that I need to set?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
