László Végh created HIVE-26059: ---------------------------------- Summary: Eventually clean compactions in "refused" state from compaction history Key: HIVE-26059 URL: https://issues.apache.org/jira/browse/HIVE-26059 Project: Hive Issue Type: Improvement Components: Hive Reporter: László Végh
Compactions in states succeeded, failed, and did not initiate have a retention threshold (example: metastore.compactor.history.retention.succeeded) and are purged from COMPLETED_COMPACTIONS if the number of compactions in this state per partition/unpartitioned table passes the threshold. This keeps the size of COMPLETED_COMPACTIONS in check. We should also purge refused compactions from COMPLETED_COMPACTIONS. See: CompactionTxnHandler#purgeCompactionHistory ! Also: REFUSED_RESPONSE should be added to org.apache.hadoop.hive.metastore.txn.TxnStore#COMPACTION_STATES so that metrics will be collected about it. -- This message was sent by Atlassian Jira (v8.20.1#820001)