Fantastic. Thanks !
2013/1/30 Qiang Wang <wsxy...@gmail.com> > Every hive query has a history file, and you can get these info from hive > history file > > Following java code can be an example: > > https://github.com/anjuke/hwi/blob/master/src/main/java/org/apache/hadoop/hive/hwi/util/QueryUtil.java > > Regard, > Qiang > > > 2013/1/30 Mathieu Despriee <mdespr...@octo.com> > >> Hi folks, >> >> I would like to run a list of generated HIVE queries. For each, I would >> like to retrieve the MR job_id (or ids, in case of multiple stages). And >> then, with this job_id, collect statistics from job tracker (cumulative >> CPU, read bytes...) >> >> How can I send HIVE queries from a bash or python script, and retrieve >> the job_id(s) ? >> >> For the 2nd part (collecting stats for the job), we're using a MRv1 >> Hadoop cluster, so I don't have the AppMaster REST >> API<http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/MapredAppMasterRest.html>. >> I'm about to collect data from the jobtracker web UI. Any better idea ? >> >> Mathieu >> >> >> >
