Xuefu Zhang created HIVE-12708:
----------------------------------

             Summary: Hive on Spark doesn't work with Kerboresed HBase [Spark 
Branch]
                 Key: HIVE-12708
                 URL: https://issues.apache.org/jira/browse/HIVE-12708
             Project: Hive
          Issue Type: Bug
          Components: Spark
    Affects Versions: 1.1.0, 1.2.0, 2.0.0
            Reporter: Xuefu Zhang
            Assignee: Xuefu Zhang


Spark application launcher (spark-submit) acquires HBase delegation token on 
Hive user's behalf when the application is launched. This mechanism, which 
doesn't work for long-running sessions, is not in line with what Hive is doing. 
Hive actually acquires the token automatically whenever a job needs it. The 
right approach for Spark should be allowing applications to dynamically add 
whatever tokens they need to the spark context. While this needs work on Spark 
side, we provide a workaround solution in Hive.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to