Hi,all:
There is a question that how to know a MR job's cpu cost? For example,the MR log will show as following when we launch a MR job, however,the Cumulative CPU: 2949.4 sec doesn't mean the job cost of cpu core. How to define or calculate a job's cpu cost? Thank you! 2016-09-23 18:57:18,671 Stage-6 map = 90%, reduce = 0%, Cumulative CPU 2918.12 sec 2016-09-23 18:57:50,576 Stage-6 map = 100%, reduce = 0%, Cumulative CPU 2949.4 sec MapReduce Total cumulative CPU time: 49 minutes 9 seconds 400 msec Ended Job = job_1474531499351_0075 Moving data to: hdfs://cluster1/user/hive/warehouse/obd_message.db/locus_travel_cent4 Table obd_message.locus_travel_cent4 stats: [numFiles=5, numRows=6768, totalSize=389645, rawDataSize=382877] MapReduce Jobs Launched: Stage-Stage-6: Map: 5 Cumulative CPU: 2949.4 sec HDFS Read: 486892540 HDFS Write: 390061 SUCCESS
