Peter Varga created HIVE-24824:
----------------------------------

             Summary: Define metrics for compaction observability
                 Key: HIVE-24824
                 URL: https://issues.apache.org/jira/browse/HIVE-24824
             Project: Hive
          Issue Type: Improvement
            Reporter: Peter Varga
            Assignee: Peter Varga


Many times if there are failures in the Compaction background processes 
(Initiator, Worker, Cleaner) it is hard notice the problem until it causes 
serious performance degradation.
We should create new JMX metrics, that would make it easier to monitor the 
compaction health. Examples are:
 * number of failed / initiated compaction
 * number of aborted txns, oldest aborted txns
 * tables with disabled compactions and writes
 * Initiator and Cleaner cycle runtime
 * Size of ACID metadata tables that should have ~ constant rows 
(txn_to_writeId, completed_txns)

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to