I have a secured and HA hdfs cluster, and I have been trying to execute a
join operation with beeline CLI.
My issue is that it try to execute mapreduce localy instead by yarn. I set
parameters
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapred.job.tracker</name>
<value>anything</value>
</property>
I'm using hive 0.13 and hadoop 2.2.0
In logs I see this:
ERROR [pool-2-thread-2]: mr.MapredLocalTask
(MapredLocalTask.java:execute(282)) - Exception: Cannot run program
"/usr/lib/hadoop/bin/hadoop" (in directory "/root"): error=13, Permission
denied
2014-11-05 09:31:33,368 ERROR [pool-2-thread-2]: ql.Driver
(SessionState.java:printError(545)) - FAILED: Execution Error, return code
1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask
2014-11-05 09:31:33,368 INFO [pool-2-thread-2]: log.PerfLogger
(PerfLogger.java:PerfLogEnd(135)) - </PERFLOG method=Driver.execute
start=1415176292766 end=1415176293368 duration=602
from=org.apache.hadoop.hive.ql.Driver>
2014-11-05 09:31:33,368 INFO [pool-2-thread-2]: log.PerfLogger
(PerfLogger.java:PerfLogBegin(108)) - <PERFLOG method=releaseLocks
from=org.apache.hadoop.hive.ql.Driver>
2014-11-05 09:31:33,368 INFO [pool-2-thread-2]: ZooKeeperHiveLockManager
(ZooKeeperHiveLockManager.java:releaseLocks(254)) - about to release lock
for default/sample_08
2014-11-05 09:31:33,429 INFO [pool-2-thread-2]: ZooKeeperHiveLockManager
(ZooKeeperHiveLockManager.java:releaseLocks(254)) - about to release lock
for default/sample_07
2014-11-05 09:31:33,514 INFO [pool-2-thread-2]: ZooKeeperHiveLockManager
(ZooKeeperHiveLockManager.java:releaseLocks(254)) - about to release lock
for default
2014-11-05 09:31:33,675 INFO [pool-2-thread-2]: log.PerfLogger
(PerfLogger.java:PerfLogEnd(135)) - </PERFLOG method=releaseLocks
start=1415176293368 end=1415176293675 duration=307
from=org.apache.hadoop.hive.ql.Driver>
2014-11-05 09:31:33,815 ERROR [pool-2-thread-2]: operation.Operation
(SQLOperation.java:run(202)) - Error running hive query:
org.apache.hive.service.cli.HiveSQLException: Error while processing
statement: FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask
at
org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:146)
at
org.apache.hive.service.cli.operation.SQLOperation.access$000(SQLOperation.java:68)
at
org.apache.hive.service.cli.operation.SQLOperation$1$1.run(SQLOperation.java:199)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
at
org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:493)
at
org.apache.hive.service.cli.operation.SQLOperation$1.run(SQLOperation.java:208)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Any idea? Anyone could point me what else to check?
Regards
