[
https://issues.apache.org/jira/browse/HIVE-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282359#comment-15282359
]
Naveen Gangam commented on HIVE-13749:
--------------------------------------
I am still analyzing the heap, but appears like they are all stashed away in
HashMap, perhaps in a threadlocal. I do not have the allocation stack for these
objects so I cannot tell what part of the code creates these instances.
Just running a simple query iteratively via beeline where it connects +
disconnects every iteration, I observe the leak. Not sure if it is the same
workload as in the environment where the heap dump was generated from.
I am currently running some tests with a change to remove it from the
threadlocal at
https://github.com/apache/hive/blob/master/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java#L811
and
https://github.com/apache/hive/blob/master/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java#L483
> Memory leak in Hive Metastore
> -----------------------------
>
> Key: HIVE-13749
> URL: https://issues.apache.org/jira/browse/HIVE-13749
> Project: Hive
> Issue Type: Bug
> Components: Metastore
> Affects Versions: 1.1.0
> Reporter: Naveen Gangam
> Assignee: Naveen Gangam
> Attachments: Top_Consumers7.html
>
>
> Looking a heap dump of 10GB, a large number of Configuration objects(> 66k
> instances) are being retained. These objects along with its retained set is
> occupying about 95% of the heap space. This leads to HMS crashes every few
> days.
> I will attach an exported snapshot from the eclipse MAT.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
