[
https://issues.apache.org/jira/browse/SPARK-18134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15612136#comment-15612136
]
Christian Zorneck commented on SPARK-18134:
-------------------------------------------
Spark was compatible in this case until Spark 1.4. How did this work until that
version?
Maps always can be compared, at least if they are serialized, to achieve this.
I think, the user should decide if he uses maps, with the drawback of
performance, because he needs this feature. The user could be warned of the
performance issue with a warning, but the feature is important to have.
> SQL: MapType in Group BY and Joins not working
> ----------------------------------------------
>
> Key: SPARK-18134
> URL: https://issues.apache.org/jira/browse/SPARK-18134
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.5.0, 1.5.1, 1.5.2, 1.6.0, 1.6.1, 1.6.2, 2.0.0, 2.0.1
> Reporter: Christian Zorneck
>
> Since version 1.5 and issue SPARK-9415, MapTypes can no longer be used in
> GROUP BY and join clauses. This makes it incompatible to HiveQL. So, a Hive
> feature was removed from Spark. This makes Spark incompatible to various
> HiveQL statements.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
