[ https://issues.apache.org/jira/browse/KAFKA-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14383147#comment-14383147 ]
Rajiv Kurian commented on KAFKA-2045: ------------------------------------- Bounding the ByteBuffers and statically allocating them would be great. On consumers do we need any more than a ByteBuffer per broker that the client is talking to? Why do we need a buffer per topic/partition? Even if the leader for a topic/partition changes, we will ultimately know about it and ask the new leader for data. This data will still be after the previous data for the topic/partition that moved so to the consumer it will just look like another message set and order per topic/partition is still maintained. > Memory Management on the consumer > --------------------------------- > > Key: KAFKA-2045 > URL: https://issues.apache.org/jira/browse/KAFKA-2045 > Project: Kafka > Issue Type: Sub-task > Reporter: Guozhang Wang > > We need to add the memory management on the new consumer like we did in the > new producer. This would probably include: > 1. byte buffer re-usage for fetch response partition data. > 2. byte buffer re-usage for on-the-fly de-compression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)