[
https://issues.apache.org/jira/browse/KAFKA-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14093734#comment-14093734
]
Neha Narkhede commented on KAFKA-1587:
--------------------------------------
It looks like you know you are running a memory intensive application and I
suspect GC is the problem. You can do a few things -
1. Turn on verbose and monitor your GC logs. Confirm that the slowdown is
really due to GC. You should see pauses and full GCs.
2. Check the settings on the producer for request.required.acks and
queue.enqueue.timeout.ms
3. Check the producer throughput reported by the brokers and see if the
throughput is satisfactory. In other words, make sure that the brokers are not
slowing down the producers due to back pressure.
4. Upgrade to Kafka 0.8.1.1 if you already haven't.
Also, these sort of questions are best answered on the mailing list, instead of
JIRA.
> Possible Memory Leak when we use Kafka 8.0 Producer for sending messages
> ------------------------------------------------------------------------
>
> Key: KAFKA-1587
> URL: https://issues.apache.org/jira/browse/KAFKA-1587
> Project: Kafka
> Issue Type: Bug
> Affects Versions: 0.8.0
> Reporter: Gopinath Sundaram
> Priority: Critical
>
> Hi Kafka team,
> We use Kafka to send messages in an high volume/memory crazy application
> which uses Parallel GC. We send messages at the rate of 12500/min in the
> first few hours and then the number of messages drop down to 6000/min. Our
> application usually runs for a maximum of 24 hours
> What we have:
> 1) When we do not send messages through Kafka Producer 0.8, then our
> application never slows down much and our entire process completes within 24
> hours
> 2) When we use Kafka, our machines slow down in sending messages to around
> 2500/min and as time progresses, the number of messages being sent is even
> lesser
> 3) We suspect that our application spends more time in GC and hence the
> problem. The Heap Dump does not contain an leak suspect with Kafka, but this
> slowness happens only when Kafka messaging system is used.
> Any pointers that could help us resolve this issue will be highly appreciated.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
