László Végh created HIVE-26059:
----------------------------------

             Summary: Eventually clean compactions in "refused" state from 
compaction history
                 Key: HIVE-26059
                 URL: https://issues.apache.org/jira/browse/HIVE-26059
             Project: Hive
          Issue Type: Improvement
          Components: Hive
            Reporter: László Végh


Compactions in states succeeded, failed, and did not initiate have a retention 
threshold (example: metastore.compactor.history.retention.succeeded) and are 
purged from COMPLETED_COMPACTIONS if the number of compactions in this state 
per partition/unpartitioned table passes the threshold. This keeps the size of 
COMPLETED_COMPACTIONS in check.

We should also purge refused compactions from COMPLETED_COMPACTIONS.

See:
CompactionTxnHandler#purgeCompactionHistory

! Also: REFUSED_RESPONSE should be added to 
org.apache.hadoop.hive.metastore.txn.TxnStore#COMPACTION_STATES so that metrics 
will be collected about it.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to