[ 
https://issues.apache.org/jira/browse/KAFKA-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15496789#comment-15496789
 ] 

Mickael Maison commented on KAFKA-4133:
---------------------------------------

[~hachikuji] I've created KIP-80: 
https://cwiki.apache.org/confluence/display/KAFKA/KIP-80%3A+Provide+a+configuration+to+control+consumer+max+in-flight+fetches

Can you have a quick look before I start a discussion thread ? It feels a bit 
short but at the same time it's a pretty straight forward change.
Thanks

> Provide a configuration to control consumer max in-flight fetches
> -----------------------------------------------------------------
>
>                 Key: KAFKA-4133
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4133
>             Project: Kafka
>          Issue Type: Improvement
>          Components: consumer
>            Reporter: Jason Gustafson
>            Assignee: Mickael Maison
>
> With KIP-74, we now have a good way to limit the size of fetch responses, but 
> it may still be difficult for users to control overall memory since the 
> consumer will send fetches in parallel to all the brokers which own 
> partitions that it is subscribed to. To give users finer control, it might 
> make sense to add a `max.in.flight.fetches` setting to limit the total number 
> of concurrent fetches at any time. This would require a KIP since it's a new 
> configuration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to