[ https://issues.apache.org/jira/browse/KAFKA-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15496789#comment-15496789 ]
Mickael Maison commented on KAFKA-4133: --------------------------------------- [~hachikuji] I've created KIP-80: https://cwiki.apache.org/confluence/display/KAFKA/KIP-80%3A+Provide+a+configuration+to+control+consumer+max+in-flight+fetches Can you have a quick look before I start a discussion thread ? It feels a bit short but at the same time it's a pretty straight forward change. Thanks > Provide a configuration to control consumer max in-flight fetches > ----------------------------------------------------------------- > > Key: KAFKA-4133 > URL: https://issues.apache.org/jira/browse/KAFKA-4133 > Project: Kafka > Issue Type: Improvement > Components: consumer > Reporter: Jason Gustafson > Assignee: Mickael Maison > > With KIP-74, we now have a good way to limit the size of fetch responses, but > it may still be difficult for users to control overall memory since the > consumer will send fetches in parallel to all the brokers which own > partitions that it is subscribed to. To give users finer control, it might > make sense to add a `max.in.flight.fetches` setting to limit the total number > of concurrent fetches at any time. This would require a KIP since it's a new > configuration. -- This message was sent by Atlassian JIRA (v6.3.4#6332)