[
https://issues.apache.org/jira/browse/HIVE-18766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aihua Xu updated HIVE-18766:
----------------------------
Status: Patch Available (was: Open)
patch-1: when the RemoteDriver sends the error to the HS2, this patch adds the
logic to wait for a configured time (we reuse the same configuration
hive.spark.client.future.timeout).
[~stakiar] Can you help take a look at this? It's a simple patch so I didn't
create CR.
> Race condition during shutdown of RemoteDriver, error messages aren't always
> sent
> ---------------------------------------------------------------------------------
>
> Key: HIVE-18766
> URL: https://issues.apache.org/jira/browse/HIVE-18766
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Sahil Takiar
> Assignee: Aihua Xu
> Priority: Major
> Attachments: HIVE-18766.1.patch
>
>
> When we send an error during shutdown of the {{RemoteDriver}}, we don't wait
> for the error message to be sent. We just send it and then close the RPC
> channel. For a graceful shutdown, that doesn't seem ideal. We should at least
> wait a bit for the RPC message to be sent before shutting things down. I ran
> some tests locally and its pretty easy to hit a situation where the error
> message doesn't even get sent to the {{SparkClientImpl}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
