Hi,
I have setup WebHCat that is bundled with Hive 0.11.0. I am able to kick
of map reduce jobs with the REST API successfully. However I am having
some issues with Hive commands over REST. The following is my
$TEMPLETON_HOME/webhcat-site.xml.
<?xml version="1.0" encoding="UTF-8"?>
<!-- The default settings for Templeton. -->
<!-- Edit templeton-site.xml to change settings for your local -->
<!-- install. -->
<configuration>
<property>
<name>templeton.pig.archive</name>
<value>s3n://pearson-alto-hadoop/apps/webhcat/archives/pig-0.11.1.tar.gz</value>
<description>The path to the Pig archive.</description>
</property>
<property>
<name>templeton.pig.path</name>
<value>pig-0.11.1.tar.gz/pig-0.11.1/bin/pig</value>
<description>The path to the Pig executable.</description>
</property>
<property>
<name>templeton.hive.archive</name>
<value>s3n://pearson-alto-hadoop/apps/webhcat/archives/hive-0.11.0.tar.gz</value>
<description>The path to the Hive archive.</description>
</property>
<property>
<name>templeton.hive.path</name>
<value>hive-0.11.0.tar.gz/hive-0.11.0-bin/bin/hive</value>
<description>The path to the Hive executable.</description>
</property>
</configuration>
curl -s -d user.name=hadoop \
> -d execute="show+tables;" \
> -d statusdir="s3n://pearson-alto-hadoop/webhcat/hive" \
> 'http://10.201.5.28:50111/templeton/v1/hive'
{"id":"job_201311281741_0020"}
When I check the statusdir and jobs folders I see the job had an exit
status of 1 so it wasn't successful.
hadoop fs -ls s3n://pearson-alto-hadoop/webhcat/hive
Found 1 items
-rwxrwxrwx 1 2 2013-11-29 15:15 /webhcat/hive/exit
hadoop fs -ls /templeton-hadoop/jobs/job_201311281741_0020
Found 3 items
-rw-r--r-- 1 hadoop supergroup 4 2013-11-29 15:15
/templeton-hadoop/jobs/job_201311281741_0020/completed
-rw-r--r-- 1 hadoop supergroup 1 2013-11-29 15:15
/templeton-hadoop/jobs/job_201311281741_0020/exitValue
-rw-r--r-- 1 hadoop supergroup 6 2013-11-29 15:15
/templeton-hadoop/jobs/job_201311281741_0020/user
Here is what I see in the logs.
DEBUG | 29 Nov 2013 15:15:36,133 | org.apache.hcatalog.templeton.Server |
queued job job_201311281741_0020 in 13403 ms
DEBUG | 29 Nov 2013 15:16:09,583 |
org.apache.hcatalog.templeton.tool.HDFSStorage | Couldn't find
/templeton-hadoop/jobs/job_201311281741_0020/notified: File does not exist:
/templeton-hadoop/jobs/job_201311281741_0020/notified
DEBUG | 29 Nov 2013 15:16:09,584 |
org.apache.hcatalog.templeton.tool.HDFSStorage | Couldn't find
/templeton-hadoop/jobs/job_201311281741_0020/callback: File does not exist:
/templeton-hadoop/jobs/job_201311281741_0020/callback
How do I figure out the reason for failure?
Thanks,
Jonathan
