[
https://issues.apache.org/jira/browse/HIVE-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180923#comment-14180923
]
Xuefu Zhang commented on HIVE-8528:
-----------------------------------
It's mainly for HiveSever2, where there are concurrent client sessions, each
having its SparkContext object. SparkContext is heavy, putting memory pressure
on HiveServer2, proportionally to the number of active client sessions. With
remote SparkContext, the pressure is transfered to remote process.
> Add remote Spark client to Hive [Spark Branch]
> ----------------------------------------------
>
> Key: HIVE-8528
> URL: https://issues.apache.org/jira/browse/HIVE-8528
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Marcelo Vanzin
> Assignee: Marcelo Vanzin
> Attachments: HIVE-8528.1-spark-client.patch, HIVE-8528.1-spark.patch,
> HIVE-8528.2-spark.patch, HIVE-8528.2-spark.patch
>
>
> For the time being, at least, we've decided to build the Spark client (see
> SPARK-3215) inside Hive. This task tracks merging the ongoing work into the
> Spark branch.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
