Chao Sun created HIVE-10476: ------------------------------- Summary: Hive query should fail when it fails to initialize a session in SetSparkReducerParallelism [Spark Branch] Key: HIVE-10476 URL: https://issues.apache.org/jira/browse/HIVE-10476 Project: Hive Issue Type: Improvement Components: Spark Affects Versions: spark-branch Reporter: Chao Sun Assignee: Chao Sun Priority: Minor
Currently, for a Hive query HoS need to get a session a session twice, once in SparkSetReducerParallelism, and another when submitting the actual job. The issue is that sometimes there's problem when launching a Yarn application (e.g., don't have permission), then user will have to wait for two timeouts, because both session initializations will fail. This turned out to happen frequently. This JIRA proposes to fail the query in SparkSetReducerParallelism, when it cannot initialize the session. -- This message was sent by Atlassian JIRA (v6.3.4#6332)