Stefan Kandic created SPARK-56031:
-------------------------------------
Summary: NATURAL JOIN ignores case-insensitive column matching
Key: SPARK-56031
URL: https://issues.apache.org/jira/browse/SPARK-56031
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 4.2.0
Reporter: Stefan Kandic
NATURAL JOIN uses case-sensitive string comparison to find common columns
between the left and right sides of the join, regardless of the
spark.sql.caseSensitive setting (which defaults to false).
This means columns that differ only in case (e.g. ID vs id) are not recognized
as common columns, and the NATURAL JOIN silently degrades to a CROSS JOIN —
returning incorrect results with duplicate columns instead of joining on the
matching column.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
