Re: Relation between fetch.max.bytes, max.partition.fetch.bytes & max.poll.records

> is there any gain on number of network calls being made No basically. However, since next fetch requests are sent only when previous-fetched records are processed, setting max.poll.records to too low would negatively affect the network-call frequency depending on how you process records Because

Re: Relation between fetch.max.bytes, max.partition.fetch.bytes & max.poll.records

Can someone please clarify my below doubt? The same has been asked on stack overflow also. https://stackoverflow.com/q/77630586/785523 On Fri, 8 Dec, 2023, 21:33 Debraj Manna, wrote: > Thanks again. > > Another follow-up question, since max.poll.records has nothing to do with > fetch requests,

Re: Relation between fetch.max.bytes, max.partition.fetch.bytes & max.poll.records

Thanks again. Another follow-up question, since max.poll.records has nothing to do with fetch requests, then is there any gain on number of network calls being made between consumer & broker if max.poll.records is set to 1 as against let's say the default 500. On Wed, Dec 6, 2023 at 7:21 PM Haruk

Re: Relation between fetch.max.bytes, max.partition.fetch.bytes & max.poll.records

poll-idle-ratio-avg=1.0 doesn't immediately mean fetch throughput problem since if processing is very fast, the metric will always be near 1.0. 2023年12月4日(月) 13:09 Debraj Manna : > Thanks for the reply. > > I read KIP > < > https://cwiki.apache.org/confluence/plugins/servlet/mobile?contentId=1274

Re: Relation between fetch.max.bytes, max.partition.fetch.bytes & max.poll.records

Thanks for the reply. I read KIP . Can you let me know if I observe poll-idle-ration.avg equal to 1.0 then does that mean my fetch.max.bytes or max

Re: Relation between fetch.max.bytes, max.partition.fetch.bytes & max.poll.records

Hi. `max.poll.records` does nothing with fetch requests (refs: https://kafka.apache.org/35/documentation.html#consumerconfigs_max.poll.records ) Then, how many records will be returned for single fetch request depends on the partition-leader assignment. (note: we assume follower-fetch is not used