Hi Jim, I am new to hive too so cannot suggest much on that front. However, I'm pretty sure that this error indicates that a particular class is missing in your classpath. In the sense, your hive runtime is not able to locate the class org.apache.hadoop.mapreduce.util.HostUtil. Double check your HADOOP_HOME and any other variable that will configure paths and classpaths for hive.
Hope this helps. All the best! Sunita On Mon, Jul 15, 2013 at 9:32 PM, Jim Colestock <j...@ramblingredneck.com>wrote: > Hello All, > > Has anyone been successful at running hive 0.11 with Cloudera CDH 4.3? > > I've been able to get hive to connect to my metadb (which is in Postgres). > Verified by doing a show tables.. I can run explain and describes on > tables, but when I try to run anything that fires off an M/R job, I get the > following error: > > hive>select count(*) from tableA; > Total MapReduce jobs = 1 > Launching Job 1 out of 1 > Number of reduce tasks determined at compile time: 1 > In order to change the average load for a reducer (in bytes): > set hive.exec.reducers.bytes.per.reducer=<number> > In order to limit the maximum number of reducers: > set hive.exec.reducers.max=<number> > In order to set a constant number of reducers: > set mapred.reduce.tasks=<number> > Starting Job = job_201307112247_13816, Tracking URL = > http://master:50030/jobdetails.jsp?jobid=job_201307112247_13816 > Kill Command = /usr/lib/hadoop/bin/hadoop job -kill job_201307112247_13816 > Hadoop job information for Stage-1: number of mappers: 1; number of > reducers: 1 > 2013-07-12 02:11:42,829 Stage-1 map = 0%, reduce = 0% > 2013-07-12 02:12:08,173 Stage-1 map = 100%, reduce = 100% > Ended Job = job_201307112247_13816 with errors > Error during job, obtaining debugging information... > Job Tracking URL: > http://master:50030/jobdetails.jsp?jobid=job_201307112247_13816 > Examining task ID: task_201307112247_13816_m_000002 (and more) from job > job_201307112247_13816 > Exception in thread "Thread-19" java.lang.NoClassDefFoundError: > org/apache/hadoop/mapreduce/util/HostUtil > at > org.apache.hadoop.hive.shims.Hadoop23Shims.getTaskAttemptLogUrl(Hadoop23Shims.java:61) > at > org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:186) > at > org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:142) > at java.lang.Thread.run(Thread.java:619) > Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.mapreduce.util.HostUtil > at java.net.URLClassLoader$1.run(URLClassLoader.java:202) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:190) > at java.lang.ClassLoader.loadClass(ClassLoader.java:307) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) > at java.lang.ClassLoader.loadClass(ClassLoader.java:248) > ... 4 more > FAILED: Execution Error, return code 2 from > org.apache.hadoop.hive.ql.exec.MapRedTask > MapReduce Jobs Launched: > Job 0: Map: 1 Reduce: 1 HDFS Read: 0 HDFS Write: 0 FAIL > Total MapReduce CPU Time Spent: 0 msec > > > I'm using my configs from hive 0.10, which works with no issues and this > was pretty much a drop in replacement on the machine that hadoop 0.10 was > running on.. > > I've done a bunch of googling around and have found a bunch of other folks > that have have had the same issue, but no solid answers.. > > Thanks in advance for any help.. > > JC > > >
