[
https://issues.apache.org/jira/browse/HIVE-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107098#comment-13107098
]
Hudson commented on HIVE-2446:
------------------------------
Integrated in Hive-trunk-h0.21 #960 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/960/])
HIVE-2446. Introduction of client statistics publishers possibility (Robert
Surówka via Ning Zhang)
nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1171917
Files :
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
* /hive/trunk/conf/hive-default.xml
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/history/HiveHistory.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/ClientStatsPublisher.java
> Introduction of client statistics publishers possibility
> --------------------------------------------------------
>
> Key: HIVE-2446
> URL: https://issues.apache.org/jira/browse/HIVE-2446
> Project: Hive
> Issue Type: Improvement
> Components: Clients, Statistics
> Reporter: Robert Surówka
> Assignee: Robert Surówka
> Priority: Minor
> Fix For: 0.8.0
>
> Attachments: HIVE-2446.1.patch, HIVE-2446.1.patch, HIVE-2446.2.patch,
> HIVE-2446.2.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> The purpose of this change is to allow publication or storage of counters
> while the job is running.
> Introduced two new variables to hive-default.xml and HiveConf.java:
> "hive.client.stats.publishers" and "hive.client.stats.counters". First one
> specifies classes names, whose instances will be executed by
> HadoopJobExecHelper.java (similarly as hooks are) in its method
> progress(ExecDriverTaskHandle): MapRedStats. Second one specifies list of
> counters that any client stat publishers should publish or stored. Details
> regarding format of this list is up to a specific deployment (it is up to
> client stats publishers to parse it), yet it is required to use display names
> of counter groups and counters.
> Added interface ClientStatsPublishers in org.apache.hadoop.hive.ql.stats
> package, that must be implemented by all stats publishers.
> Added code to progress(ExecDriverTaskHandle): MapRedStats from
> HadoopJobExecHelper.java that puts counters' values to a Java map and then
> executes registered client stats publishers giving them that map and running
> job id. Added two new methods to HadoopJobExecHelper:
> extractAllCounterValues(Counters) and getClientStatsPublishers() that are
> used by code from previous sentence.
> Made cosmetic changes in two other classes
>
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
