[
https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782668#comment-13782668
]
Thejas M Nair commented on HIVE-4501:
-------------------------------------
bq. Are you saying that the same FS ref. can be used across UGIs?
No, that is not happening in current code. But this patch will accumulate FS
refs that belong to different sessions and when a session is closed it can end
up closing FS objects that are associated with other sessions, and not closing
the FS handles that belong to the session being closed.
The change in TUGIContainingProcessor will just accumulate FS handles to a
thread local variable. But that thread can be used by different hive sessions.
There is no 1:1 mapping between hive server 2 threads and hive sessions. I hope
this clarifies.
> HS2 memory leak - FileSystem objects in FileSystem.CACHE
> --------------------------------------------------------
>
> Key: HIVE-4501
> URL: https://issues.apache.org/jira/browse/HIVE-4501
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Affects Versions: 0.11.0
> Reporter: Thejas M Nair
> Assignee: Thejas M Nair
> Priority: Critical
> Attachments: HIVE-4501.1.patch, HIVE-4501.1.patch, HIVE-4501.1.patch,
> HIVE-4501.trunk.patch
>
>
> org.apache.hadoop.fs.FileSystem objects are getting accumulated in
> FileSystem.CACHE, with HS2 in unsecure mode.
> As a workaround, it is possible to set fs.hdfs.impl.disable.cache and
> fs.file.impl.disable.cache to true.
> Users should not have to bother with this extra configuration.
> As a workaround disable impersonation by setting hive.server2.enable.doAs to
> false.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
