[
https://issues.apache.org/jira/browse/SPARK-60887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-60887:
-----------------------------------
Labels: pull-request-available (was: )
> Preserve option key casing in SessionState.newHadoopConfWithOptions
> -------------------------------------------------------------------
>
> Key: SPARK-60887
> URL: https://issues.apache.org/jira/browse/SPARK-60887
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 4.2.0
> Reporter: Denny Abraham Cheriyan
> Priority: Minor
> Labels: pull-request-available
>
> SessionState.newHadoopConfWithOptions iterates directly over options. When
> options is a CaseInsensitiveMap, its iterator yields lowercased keys,
> silently breaking case-sensitive Hadoop Configuration keys passed via
> DataFrameReader/DataStreamReader options. Unwrap
> CaseInsensitiveMap.originalMap (matching
> DataSourceUtils.mergeWriteOptionsIntoHadoopConf from SPARK-56414) and pass
> options.asCaseSensitiveMap in TextBasedFileScan.codecFactory.
>
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
