Eugene Koifman created HIVE-11994: ------------------------------------- Summary: SHOW COMPACTIONS should include history and meta info Key: HIVE-11994 URL: https://issues.apache.org/jira/browse/HIVE-11994 Project: Hive Issue Type: Improvement Components: Metastore, Transactions Affects Versions: 1.0.0 Reporter: Eugene Koifman Assignee: Eugene Koifman
Currently output of SHOW COMPACTIONS only has current information. it would very useful if it could retain the data for a configurable period of time after the Cleaner handles the entry. Perhaps the entry can go into 'h' state for 'historical'. Such historical data can be used to drive alert generating logic. We can add a column with a JSON doc which can include various stats about the job: number of delta files, size in MB, time taken. Also can be useful to collect job properties from Hadoop, such as RAM used for example. All of this can enhance the type/quality of alerts. -- This message was sent by Atlassian JIRA (v6.3.4#6332)