Whew, sorry for all the spam, maybe this can help other users but apparently I had to put HIVE on the HADOOP_CLASSPATH and continue adding the jars. Instead all I did was
Add the following to the $HADOOP_HOME/conf/Hadoop_env.sh "export HADOOP_CLASSPATH=$HIVE_HOME/lib/*" That started hive shell successfully and I can do any kind of DDL so far. Thank you all. From: Artem Ervits [mailto:are9...@nyp.org] Sent: Wednesday, October 24, 2012 4:30 PM To: user@hive.apache.org Subject: RE: Hive installation Actually I'm getting warmer, I "grepped" in the src folder for the java classes that errors were referencing and now my classpath is below. If there's a better way, I'd really like to know. export HADOOP_CLASSPATH=/usr/local/hbase/hbase-0.94.1.jar:/usr/local/hbase/hbase-0.94.1-tests.jar:/usr/local/hbase/lib/zookeeper-3.4.3.jar export HADOOP_CLASSPATH=$HIVE_HOME/lib/hive-common-0.10.0-SNAPSHOT.jar:$HIVE_HOME/lib/hive-cli-0.10.0-SNAPSHOT.jar:$HIVE_HOME/lib/hive-exec-0.10.0-SNAPSHOT.jar:$HIVE_HOME/lib/hive-service-0.10.0-SNAPSHOT.jar:$HIVE_HOME/lib/jline-0.9.94.jar Now when I try to start Hive, I think I got hit wit this bug https://issues.apache.org/jira/browse/HCATALOG-187 because my error is the exact same error as the one in the Jira: Exception in thread "main" java.lang.RuntimeException: Failed to load Hive builtin functions at org.apache.hadoop.hive.ql.session.SessionState.<init>(SessionState.java:205) at org.apache.hadoop.hive.cli.CliSessionState.<init>(CliSessionState.java:86) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:635) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:613) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:156) Caused by: java.lang.ClassNotFoundException: org.apache.hive.builtins.BuiltinUtils at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:169) at org.apache.hadoop.hive.ql.exec.Utilities.getBuiltinUtilsClass(Utilities.java:2402) at org.apache.hadoop.hive.ql.session.SessionState.<init>(SessionState.java:197) ... 8 more I am using the version from trunk. Please advise Thank you. From: Artem Ervits [mailto:are9...@nyp.org]<mailto:[mailto:are9...@nyp.org]> Sent: Wednesday, October 24, 2012 4:11 PM To: user@hive.apache.org<mailto:user@hive.apache.org> Subject: RE: Hive installation I was able to go past this error by editing $HADOOP_HOME/conf/Hadoop-env.sh and adding this line: Export HADOOP_CLASSPATH=$HIVE_HOME/lib/hive-common-x.x.x.jar:$HIVE_HOME/lib/hive-cli-0.10.0.jar but now I'm getting the error below. Am I on the right track? Should I edit the classpath elsewhere? What other jars am I missing? Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hive/ql/session/SessionState at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:247) at org.apache.hadoop.util.RunJar.main(RunJar.java:149) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.session.SessionState at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 3 more From: Ravindra [mailto:ravindra.baj...@gmail.com]<mailto:[mailto:ravindra.baj...@gmail.com]> Sent: Friday, October 19, 2012 11:01 PM To: user@hive.apache.org<mailto:user@hive.apache.org> Subject: Re: Hive installation This class is present in $HIVE_HOME/lib/hive-common-X.X.X.jar See if you have classpath set properly and this jar is in place. -- Ravi. ''We do not inherit the earth from our ancestors, we borrow it from our children.'' PROTECT IT ! On Sat, Oct 20, 2012 at 2:52 AM, Artem Ervits <are9...@nyp.org<mailto:are9...@nyp.org>> wrote: Hello all, I'm trying to install Hive on a four-node Hadoop cluster and am a bit confused by the instructions in the wiki. Am I to install Hive on one node or client and have it point to the distributed Hadoop cluster? Or is there a distributed installation of Hive that I'm missing? So far I've done everything in the wiki except for configuration, I copied the hive-default template and used it as is for hive-site.xml. I also copied hive-env default and used it as hive-env.sh I am getting this error: [hduser@NYSGBDNNVM01 hive]$ bin/hive Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hive/conf/HiveConf at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:247) at org.apache.hadoop.util.RunJar.main(RunJar.java:149) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.conf.HiveConf at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 3 more Am I supposed to copy the hive jar into the Hadoop lib folder? Thank you. Artem Ervits Data Analyst New York Presbyterian Hospital -------------------- This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you. -------------------- This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you. -------------------- This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you. -------------------- This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you. ________________________________ Confidential Information subject to NYP's (and its affiliates') information management and security policies (http://infonet.nyp.org/QA/HospitalManual). -------------------- This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you. -------------------- This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you. ________________________________ Confidential Information subject to NYP's (and its affiliates') information management and security policies (http://infonet.nyp.org/QA/HospitalManual). -------------------- This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you. -------------------- This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you.
