[ https://issues.apache.org/jira/browse/HIVE-2479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120302#comment-13120302 ]
He Yongqiang commented on HIVE-2479: ------------------------------------ Let's put all job counters into a map in MapRedStats (not just the one listed above), and a hook can do anything he wants > Log more Hadoop task counter values in the MapRedStats class. > ------------------------------------------------------------- > > Key: HIVE-2479 > URL: https://issues.apache.org/jira/browse/HIVE-2479 > Project: Hive > Issue Type: Improvement > Reporter: Kevin Wilfong > Assignee: Kevin Wilfong > > We should log more of the Hadoop task tracker counters in the MapRedStats > class, in order to make them available to hooks and improve logging. > Specifically these are the counters we should add: > MAP_SPILL_CPU, > MAP_SPILL_WALLCLOCK, > MAP_SPILL_NUMBER, > MAP_SPILL_BYTES, > MAP_MEM_SORT_CPU, > MAP_MEM_SORT_WALLCLOCK, > MAP_MERGE_CPU, > MAP_MERGE_WALLCLOCK, > REDUCE_SHUFFLE_BYTES, > REDUCE_COPY_WALLCLOCK, > REDUCE_COPY_CPU, > REDUCE_SORT_WALLCLOCK, > REDUCE_SORT_CPU, > MAP_TASK_WALLCLOCK, > REDUCE_TASK_WALLCLOCK, > MAP_INPUT_BYTES -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira