[ 
https://issues.apache.org/jira/browse/HIVE-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302925#comment-15302925
 ] 

Thejas M Nair commented on HIVE-13749:
--------------------------------------

Regarding the patch
1. How do you make sure that files created by this ugi are not in use in other 
parts ? We need do the closing only after we are sure that the ugi object is no 
longer going to be used. 
2. I am not sure if this would fix the leak. As you can see we have patches 
that deal with the closing when UGI object is no longer used.
Are you able to reproduce this in your environment ? If not, you might want to 
add some debugging around code that adds entries in the cache, and see if the 
closing of files generated from those places is happening.
You might also want to see if the user is some some plugins that might be 
creating new UGI objects.



> Memory leak in Hive Metastore
> -----------------------------
>
>                 Key: HIVE-13749
>                 URL: https://issues.apache.org/jira/browse/HIVE-13749
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 1.1.0
>            Reporter: Naveen Gangam
>            Assignee: Naveen Gangam
>         Attachments: HIVE-13749.patch, Top_Consumers7.html
>
>
> Looking a heap dump of 10GB, a large number of Configuration objects(> 66k 
> instances) are being retained. These objects along with its retained set is 
> occupying about 95% of the heap space. This leads to HMS crashes every few 
> days.
> I will attach an exported snapshot from the eclipse MAT.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to