Re: Question regarding buffer.memory, max.request.size and send.buffer.bytes

As the document suggest, you should keep it same as your max.request.size. And the documentation clearly says that the system will throw exception if you are producing faster than you can send, and kept blocking until max.block.ms is reached. On 24 May 2017 at 00:51, Milind Vaidya wrote: > I a

Re: Question regarding buffer.memory, max.request.size and send.buffer.bytes

I am looking for Producer tuning as mentioned in the mail, all the properties are related to producer config. This is where the property is mentioned : https://kafka.apache.org/0100/documentation.html#producerconfigs Consumer in this case if KafkaSpout from Apache-Storm. On Tue, May 23, 2017

Re: Question regarding buffer.memory, max.request.size and send.buffer.bytes

This could be for various reasons: 1) Your consumer.property settings - if you have not been acknowledging automatically, you need to provide a sufficient polling time and commit in sync/async. 2) You are not consuming the messages how you think. I don't know how you got this buffer.memory prope

Question regarding buffer.memory, max.request.size and send.buffer.bytes

I have set the producer properties as follows (0.10.0.0) *"linger.ms "** : **"500"** ,* *"batch.size"** : **"1000"**,* *"buffer.memory"** :**"**1**"**,* *"send.buffer.bytes"** : **"512000"* *and default * * max.request.size = *1048576 If records are sent faster than