[ 
https://issues.apache.org/jira/browse/KUDU-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17712169#comment-17712169
 ] 

Weizisheng edited comment on KUDU-3463 at 4/14/23 3:42 AM:
-----------------------------------------------------------

Reproduced: 

creating & deleting table continuously, the leader memory usage grows from xxMB 
to xGB, and it will continues to grow. Kill the leader, another one becomes the 
new leader which memory usage instantly grows to xGB.

 

e.g.  3411MB used by KuduMasterLeader,  2598MB consumed by 
TabletLoader.VisitTablet, 1999MB by kudu.master.SysTabletEntryPB.MergeFrom

 

I'm wondering it's the normal impl  or memory leak..


was (Author: weizisheng):
Reproduced: 

creating & deleting table continuously, the leader memory usage grows from xxMB 
to xGB, and it will continues to grow...

kill the leader, another one becomes leader and it;s memory usage becomes 
instantly grows to xGB, most of it's memory usage is consumed in 
TableLoader.VisitTable   and   TabletLoader.VisitTablet

I'm wondering it's the normal impl  or memory leak..

> KuduMaster leader consumes too much memory
> ------------------------------------------
>
>                 Key: KUDU-3463
>                 URL: https://issues.apache.org/jira/browse/KUDU-3463
>             Project: Kudu
>          Issue Type: Bug
>    Affects Versions: 1.12.0
>            Reporter: Weizisheng
>            Priority: Major
>         Attachments: heap321.txt
>
>
> We rarely face a suspected memory leak on a cluster with 3-master and 
> 4-tserver, 800 tables and 3000 tablets. Leader master consume 50GB memory 
> while the other two only take one tenth of it ...
> From the last 5 days, leader's memory usage grows 3%+
> attachment pprof heap
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to