[
https://issues.apache.org/jira/browse/HIVE-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520087#comment-14520087
]
Yongzhi Chen commented on HIVE-10453:
-------------------------------------
In a session, there are possible several classloaders used (for example
different threads used for queries), at the session close time, it may not
get all the classloaders to close them which caused the leak. Fixed it by add
all the classloaders used in registerToSessionRegistry method to a set and
close them at the session close time.
> HS2 leaking open file descriptors when using UDFs
> -------------------------------------------------
>
> Key: HIVE-10453
> URL: https://issues.apache.org/jira/browse/HIVE-10453
> Project: Hive
> Issue Type: Bug
> Reporter: Yongzhi Chen
> Assignee: Yongzhi Chen
> Attachments: HIVE-10453.1.patch
>
>
> 1. create a custom function by
> CREATE FUNCTION myfunc AS 'someudfclass' using jar 'hdfs:///tmp/myudf.jar';
> 2. Create a simple jdbc client, just do
> connect,
> run simple query which using the function such as:
> select myfunc(col1) from sometable
> 3. Disconnect.
> Check open file for HiveServer2 by:
> lsof -p HSProcID | grep myudf.jar
> You will see the leak as:
> {noformat}
> java 28718 ychen txt REG 1,4 741 212977666
> /private/var/folders/6p/7_njf13d6h144wldzbbsfpz80000gp/T/1bfe3de0-ac63-4eba-a725-6a9840f1f8d5_resources/myudf.jar
> java 28718 ychen 330r REG 1,4 741 212977666
> /private/var/folders/6p/7_njf13d6h144wldzbbsfpz80000gp/T/1bfe3de0-ac63-4eba-a725-6a9840f1f8d5_resources/myudf.jar
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
