[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated HIVE-15068: ------------------------------ Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 1.3.0 Status: Resolved (was: Patch Available) Patch pushed to both branch-1 and master. > Run ClearDanglingScratchDir periodically inside HS2 > --------------------------------------------------- > > Key: HIVE-15068 > URL: https://issues.apache.org/jira/browse/HIVE-15068 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 > Reporter: Daniel Dai > Assignee: Daniel Dai > Fix For: 1.3.0, 2.2.0 > > Attachments: HIVE-15068.1.patch, HIVE-15068.2.patch, > HIVE-15068.3.patch, HIVE-15068.4.branch-1.patch, HIVE-15068.4.patch > > > In HIVE-13429, we introduce a tool which clear dangling scratch directory. In > this ticket, we want to invoke the tool automatically on a Hive cluster. > Options are: > 1. cron job, which would involve manual cron job setup > 2. As a metastore thread. However, it is possible we run metastore without > hdfs in the future (eg, managing s3 files). ClearDanglingScratchDir needs > support which only exists in hdfs, it won't work if the above scenario happens > 3. As a HS2 thread. The downside is if no HS2 is running, the tool will not > run automatically. But we expect HS2 will be a required component down the > road > Here I choose approach 3 in the implementation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)