[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated HIVE-15068: ------------------------------ Attachment: HIVE-15068.2.patch Address [~thejas]'s review comments. > Run ClearDanglingScratchDir periodically inside HS2 > --------------------------------------------------- > > Key: HIVE-15068 > URL: https://issues.apache.org/jira/browse/HIVE-15068 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 > Reporter: Daniel Dai > Assignee: Daniel Dai > Attachments: HIVE-15068.1.patch, HIVE-15068.2.patch > > > In HIVE-13429, we introduce a tool which clear dangling scratch directory. In > this ticket, we want to invoke the tool automatically on a Hive cluster. > Options are: > 1. cron job, which would involve manual cron job setup > 2. As a metastore thread. However, it is possible we run metastore without > hdfs in the future (eg, managing s3 files). ClearDanglingScratchDir needs > support which only exists in hdfs, it won't work if the above scenario happens > 3. As a HS2 thread. The downside is if no HS2 is running, the tool will not > run automatically. But we expect HS2 will be a required component down the > road > Here I choose approach 3 in the implementation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)