[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243414#comment-14243414 ]
Xuefu Zhang commented on HIVE-8913: ----------------------------------- I have moved the discussion to emails. I created HIVE-9048 to continue the investigation. > Make SparkMapJoinResolver handle runtime skew join [Spark Branch] > ----------------------------------------------------------------- > > Key: HIVE-8913 > URL: https://issues.apache.org/jira/browse/HIVE-8913 > Project: Hive > Issue Type: Improvement > Components: Spark > Reporter: Rui Li > Assignee: Rui Li > Attachments: HIVE-8913.1-spark.patch, HIVE-8913.2-spark.patch > > > Sub-task of HIVE-8406. > Now we have {{SparkMapJoinResolver}} in place. But at the moment, it doesn't > handle the map join task created by upstream SkewJoinResolver, i.e. those > wrapped in a ConditionalTask. We have to implement this part for runtime skew > join to work on spark. To do so, we can borrow logic from {{MapJoinResolver}}. -- This message was sent by Atlassian JIRA (v6.3.4#6332)