You can tail the Hive log and see what it is doing at the time.

From: air [mailto:cnwe...@gmail.com]
Sent: Tuesday, August 09, 2011 1:19 AM
To: user@hive.apache.org
Subject: Fwd: CDH3 U1 Hive Job-commit very slow


---------- Forwarded message ----------
From: air <cnwe...@gmail.com<mailto:cnwe...@gmail.com>>
Date: 2011/8/9
Subject: CDH3 U1 Hive Job-commit very slow
To: CDH Users <cdh-u...@cloudera.org<mailto:cdh-u...@cloudera.org>>


when I submit a ql to hive, it is a very long time until it really submit the 
job to the hadoop cluster, what may cause this problem ? thank you for your 
help.

hive> select count(1) from log_test where src='test' and ds='2011-08-04';
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapred.reduce.tasks=<number>              <------------------------stay 
here for a long time..

--
Knowledge Mangement .



--
Knowledge Mangement .

Reply via email to