[
https://issues.apache.org/jira/browse/HIVE-8331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao updated HIVE-8331:
-----------------------
Attachment: HIVE-8331.1-spark.patch
We are seeing similar issue as in HIVE-8303. Especially, when I set the
{{spark.master=local[N]}} where {{N}} is greater than 1, AND set the input
format to be {{HiveInputFormat}}, the result is wrong.
This patch propose to change the {{inputNameIOContextMap}} in {{IOContext}} to
be thread-local.
> HIVE-8303 followup, investigate result diff [Spark Branch]
> ----------------------------------------------------------
>
> Key: HIVE-8331
> URL: https://issues.apache.org/jira/browse/HIVE-8331
> Project: Hive
> Issue Type: Task
> Components: Spark
> Reporter: Xuefu Zhang
> Assignee: Chao
> Attachments: HIVE-8331.1-spark.patch
>
>
> HIVE-8303 patch introduced some result diffs for some spark tests. We need to
> investigate those, including parallel_join0.q, union22.q,
> vectorized_shufflejoin.q, union_remove_18.q, and maybe more.
> Also the investigation includes the test failures related to spark.
> Specifically, union_remove_18.q demonstrated random order.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
