[
https://issues.apache.org/jira/browse/KUDU-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Zhiming updated KUDU-3253:
-----------------------------
Description:
LBM kept low live ratio containers' metadata for compation and punching hole in
memory. The amount may grow too large，makes the time wasted on handling page
fault.
I0223 21:30:07.741448 12842 log_block_manager.cc:2746] Opened 6200 log block
containers
I0223 21:47:32.162726 12845 log_block_manager.cc:2746] Opened 6400 log block
containers
I0224 08:29:40.393473 54898 log_block_manager.cc:2975] Compacted 2333 metadata
files (279182030063 metadata bytes)
I0224 10:34:03.299155 73062 log_block_manager.cc:2975] Compacted 2337 metadata
files (280053530024 metadata bytes)
I0224 10:47:21.935983 12825 fs_manager.cc:433] Time spent opening block
manager: real 62879.018s user 1111.182s sys 1195.374s
was:
LBM kept low live ratio containers' metadata for compation and punching hole in
memory. The amount may grow too large，makes the time wasted on handling page
fault.
I0224 08:29:40.393473 54898 log_block_manager.cc:2975] Compacted 2333 metadata
files (279182030063 metadata bytes)
I0224 10:34:03.299155 73062 log_block_manager.cc:2975] Compacted 2337 metadata
files (280053530024 metadata bytes)
I0224 10:47:21.935983 12825 fs_manager.cc:433] Time spent opening block
manager: real 62879.018s user 1111.182s sys 1195.374s
> Log block manager may consume a huge amount of memory
> -----------------------------------------------------
>
> Key: KUDU-3253
> URL: https://issues.apache.org/jira/browse/KUDU-3253
> Project: Kudu
> Issue Type: Bug
> Components: fs
> Reporter: Li Zhiming
> Priority: Major
> Attachments: process.svg
>
>
> LBM kept low live ratio containers' metadata for compation and punching hole
> in memory. The amount may grow too large，makes the time wasted on handling
> page fault.
> I0223 21:30:07.741448 12842 log_block_manager.cc:2746] Opened 6200 log block
> containers
> I0223 21:47:32.162726 12845 log_block_manager.cc:2746] Opened 6400 log block
> containers
> I0224 08:29:40.393473 54898 log_block_manager.cc:2975] Compacted 2333
> metadata files (279182030063 metadata bytes)
> I0224 10:34:03.299155 73062 log_block_manager.cc:2975] Compacted 2337
> metadata files (280053530024 metadata bytes)
> I0224 10:47:21.935983 12825 fs_manager.cc:433] Time spent opening block
> manager: real 62879.018s user 1111.182s sys 1195.374s
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
