Hi, I am currently working with a single Kafka broker and a single Kafka consumer. I am trying to get the consumer to fetch more records, so I can increase the batch size when I write the data to a DB.
Each record is about 1 KB and I am trying to fetch at least 5000 records each time. So, I changed the configurations for the following consumer parameters: * max.poll.records = 5000 * fetch.min.bytes = 5120000 For some reason, the maximum number of records fetched each time does not go above 1150. Are there any other parameters that I should look into or any changes I should make to the current configurations? Thanks, Vishnu
