Thanks steve ! So if I understand correctly, the number of messages buffered can be greater than batch.size upto buffer.memory if the app is sending data faster than the producer i/o thread can send to broker. In this situation buffer.size becomes irrelevant. no ?
Thanks, Dhirendra. On Wed, Dec 23, 2020 at 11:36 PM Steve Howard <steve.how...@confluent.io> wrote: > Hi Dhirenda, > > As long as buffer.memory (default 32MB) has space, the producer will > continue to write here. If that is exhausted, eventually the producer will > throw... > > org.apache.kafka.common.errors.TimeoutException: Failed to allocate memory > within the configured max blocking time 60000 ms > > The 60 seconds it is given to dutifully clear some room in buffer.memory by > successfully sending messages is controlled by max.block.ms. > > Thanks, > > Steve > > On Wed, Dec 23, 2020 at 12:11 AM Dhirendra Singh <dhirendr...@gmail.com> > wrote: > > > Hi, > > I have a question related to batch.size producer configuration. > > What happens when batch.size has reached and the producer app thread > sends > > more data ? > > Does the thread block till space becomes available in the buffer > > containing the batch ? > > > > Thanks, > > Dhirendra. > > >
