Hi Team, We have a scenario where our application is processing messages at a slower rate. We want the consumer to stop fetching messages from the broker and re-fetch when an application is ready to process again.
We have fetch.max.bytes but that doesn't manage the buffer memory. If my understanding is correct then there can be multiple fetch requests and all the messages fetched must be kept in buffer memory and poll() in consumer fetches from this buffer memory. Can we have a way to control this buffer memory? For example, If we keep this memory at 10MB then it can fetch messages and keep them in the buffer but once the buffer is full then it should not fetch more and keep more in memory. Once the poll happens and messages are decreased in the buffer then it can buffer more by fetching again. Thanks, Divya
