-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/40948/
-----------------------------------------------------------

(Updated Dec. 8, 2015, 7:48 p.m.)


Review request for hive.


Changes
-------

Take the review feedback from Lenni/Jimmy to not issue periodic queries to the 
metadata store.  New strategy is to do it once at startup, and then from then 
on listen to events to get delta counts.

This change thus splits the metrics into 'init' and 'delta' counts for metadata 
and infer the total number.  It is not possible for us to give a total as there 
may be other HMS active in the cluster.


Bugs: HIVE-12499
    https://issues.apache.org/jira/browse/HIVE-12499


Repository: hive-git


Description
-------

Add separate timer thread that polls for count of database, table, partition 
entries to publish as metrics, the period is configurable.  Delay in getting 
exact number should be ok as this is for monitoring.

Implemented for HBase and DB metastores.


Diffs (updated)
-----

  
common/src/java/org/apache/hadoop/hive/common/metrics/common/MetricsConstant.java
 95e2bcf 
  common/src/test/org/apache/hadoop/hive/common/metrics/MetricsTestUtils.java 
fd420f7 
  
itests/hive-unit/src/test/java/org/apache/hadoop/hive/metastore/TestMetaStoreMetrics.java
 f571c7c 
  
itests/hive-unit/src/test/java/org/apache/hadoop/hive/metastore/hbase/TestHBaseMetastoreMetrics.java
 PRE-CREATION 
  metastore/src/java/org/apache/hadoop/hive/metastore/HMSMetricsListener.java 
PRE-CREATION 
  metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 
00602e1 
  metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 1c0ab6d 
  metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java 5b36b03 
  metastore/src/java/org/apache/hadoop/hive/metastore/hbase/HBaseReadWrite.java 
2fb3e8f 
  metastore/src/java/org/apache/hadoop/hive/metastore/hbase/HBaseStore.java 
98e6c75 
  
metastore/src/test/org/apache/hadoop/hive/metastore/DummyRawStoreControlledCommit.java
 9a1d159 
  
metastore/src/test/org/apache/hadoop/hive/metastore/DummyRawStoreForJdoConnection.java
 8dde0af 

Diff: https://reviews.apache.org/r/40948/diff/


Testing
-------

Added unit tests for HBase and Db metastores.


Thanks,

Szehon Ho

Reply via email to