absolute8511 opened a new issue, #7279: URL: https://github.com/apache/rocketmq/issues/7279
### Before Creating the Enhancement Request - [X] I have confirmed that this should be classified as an enhancement rather than a bug/feature. ### Summary Currently, the broker will open all the files include commitlog and consume queue as the mmap. While reading and writing the mmap file, the PTE will be increased (each page will use 8 bytes memory in kernel). If the total data size on disk increased to 4TB, the memory used by PTE will be 8GB which is too much in a normal pod and may cause the oom issue. I think we should control the memory used by broker. ### Motivation As most broker deployed in the cloud will be in a pod which have less memory. For large data size, most data should be old enough to ignore the latency for reading, it is not necessary to keep all files opened as mmap which make the memory out of control. ### Describe the Solution You'd Like Maybe only open the several newest data files and close the old files, only reopen for reading if request. ### Describe Alternatives You've Considered none ### Additional Context _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@rocketmq.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
