[jira] [Created] (HIVE-26509) Introduce dynamic leader election in HMS

2022-08-31 Thread Zhihua Deng (Jira)
Zhihua Deng created HIVE-26509: -- Summary: Introduce dynamic leader election in HMS Key: HIVE-26509 URL: https://issues.apache.org/jira/browse/HIVE-26509 Project: Hive Issue Type: New Feature

Re: FYI: MetaStore running out of threads

2022-08-31 Thread Rajesh Balamohan
>> In hive, FileUtils.checkFileAccessWithImpersonation can be fixed to use create UGI once to reduce the impact (suspecting this will have 50% impact). Looked closely at the method impl for "FileUtils.checkFileAccessWithImpersonation". It doesn't make 2 connections; 50% impact may not be relevant

Re: FYI: MetaStore running out of threads

2022-08-31 Thread Rajesh Balamohan
W.r.t to connection reuse issues, LLAP had a similar issue (not in HMS) https://issues.apache.org/jira/browse/HIVE-16020. It was making a connection in every task and UGI had to be persisted in the QueryInfo level to reduce the impact. In hive, FileUtils.checkFileAccessWithImpersonation can be fix

FYI: MetaStore running out of threads

2022-08-31 Thread Owen O'Malley
We're using HMS with Storage-Based Authorization and have been having trouble with the HMS running out of threads. Looking at the jstack & code, it appears to that the problem is that RPC's ConnectionId is using UGI's equal/hash, which uses the Subject's Object equals/hash. Proxy user UGI's always

[jira] [Created] (HIVE-26508) Remove netty transitive dependencies from hcatalog and hbase pom files to avoid CVEs

2022-08-31 Thread Sai Hemanth Gantasala (Jira)
Sai Hemanth Gantasala created HIVE-26508: Summary: Remove netty transitive dependencies from hcatalog and hbase pom files to avoid CVEs Key: HIVE-26508 URL: https://issues.apache.org/jira/browse/HIVE-26508

[jira] [Created] (HIVE-26507) Iceberg: In place metadata generation may not work for certain datatypes

2022-08-31 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-26507: --- Summary: Iceberg: In place metadata generation may not work for certain datatypes Key: HIVE-26507 URL: https://issues.apache.org/jira/browse/HIVE-26507 Project: