Hi there! I want to run hive (0.11) in embedded/standalone mode against hadoop 2 for running queries for my unit tests. I started with something similar to [1] and then used the hack in [2] to setup local hadoop for unit testing. Though simple queries like "create database ...." and "drop table ..." work fine, when running a complex query involving my own implementations, i get into errors like the following:
04:05:48,774 INFO main exec.ExecDriver - Executing: ./target/hadoop/bin/hadoop jar null org.apache.hadoop.hive.ql.exec.ExecDriver -libjars file:///testpath/target/test-example-1.0.jar -plan file:/tmp/foo/hive_2013-12-23_04-05-47_838_5177198435033083517/-local-10004/plan.xml -jobconffile file:/tmp/foo/hive_2013-12-23_04-05-47_838_5177198435033083517/-local-10003/jobconf.xml Exception in thread "main" java.io.IOException: Error opening job jar: null04:05:49,362 ERROR main exec.Task - Execution failed with exit status: 1 04:05:49,362 ERROR main exec.Task - Obtaining error information 04:05:49,362 ERROR main exec.Task - Task failed! Task ID: Stage-1 Logs: at org.apache.hadoop.util.RunJar.main(RunJar.java:135) Caused by: java.io.FileNotFoundException: null (No such file or directory) at java.util.zip.ZipFile.open(Native Method) at java.util.zip.ZipFile.<init>(ZipFile.java:215) at java.util.zip.ZipFile.<init>(ZipFile.java:145) at java.util.jar.JarFile.<init>(JarFile.java:153) at java.util.jar.JarFile.<init>(JarFile.java:90) at org.apache.hadoop.util.RunJar.main(RunJar.java:133) Execution failed with exit status: 1 Obtaining error information Task failed! Task ID: Stage-1 Logs: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask 04:05:49,363 ERROR main exec.ExecDriver - Execution failed with exit status: 1 04:05:49,372 ERROR main ql.Driver - FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask I'm not sure why the jar path is coming as null when hive determines to call the hadoop jar command; i've tried to set the log level to ALL to capture more details around this but seem stuck at this moment because of no extra details. Please note that hadoop 1 didn't require me to do any hack like in [2] and the code works fine for me just like it does for implementation in [1]. Any pointers on how to debug this would be very helpful. Thanking you in advance for any pointers, -Sumit [1] https://github.com/elasticsearch/elasticsearch-hadoop/blob/200912f1deb678d8e63e2e82dd47250559bbf2d8/src/test/java/org/elasticsearch/hadoop/integration/hive/HiveEmbeddedServer.java [2] https://github.com/cloudera/access/blob/master/sentry-tests/pom.xml
