Re: Kafka RecordAccumulator size grows beyond configured buffer.memory size

2015-08-05 Thread tao xiao
It may be possibly caused by this issue https://issues.apache.org/jira/browse/KAFKA-2281. Can you apply the patch and try again? On Thu, 6 Aug 2015 at 04:03 Liju John wrote: > Just to add more info - > > Our message size = 1.5MB , so effectively there was no batching as our > batch size is 200

Re: Kafka RecordAccumulator size grows beyond configured buffer.memory size

2015-08-05 Thread Liju John
Just to add more info - Our message size = 1.5MB , so effectively there was no batching as our batch size is 200. Is there any case when the RecordAccumulator can grow beyond the configured buffer.memory ? Regards, Liju John On Wed, Aug 5, 2015 at 12:41 PM, Liju John wrote: > Hi, > > We are

Kafka RecordAccumulator size grows beyond configured buffer.memory size

2015-08-05 Thread Liju John
Hi, We are experiencing an issue where the RecordAccumulator size is growing beyond the configured buffer.memory size . Below is the sequence of events when this issue occured - 1. One of the broker out of 10 brokers was brought down at 15:10 PM 2.Till 17:11 PM (same date) the kafka producer in