Spark thrift service and Hive impersonation.

[Jagat Singh]

Hi,

I have started the Spark thrift service using spark user.

Does each user needs to start own thrift server to use it?

Using beeline i am able to connect to server and execute show tables;

However when we try to execute some real query it runs as spark user and
HDFS permissions does not allow them to be read.

The query fails with error

0: jdbc:hive2://localhost:10000> select count(*) from mytable;
Error: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch
table mytable. java.security.AccessControlException: Permission denied:
user=spark, access=READ, inode="/data/mytable":tdcprdr:tdcprdr:drwxr-x--x
at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:271)

And in thrift server we get log.


In the hive-site.xml we have impersonation enabled.

   <property>
      <name>hive.server2.enable.doAs</name>
      <value>true</value>
    </property>

    <property>
      <name>hive.server2.enable.impersonation</name>
      <value>true</value>
    </property>

Is there any other configuration to be done for it to work like normal hive
thrift server.

Thanks