[
https://issues.apache.org/jira/browse/SPARK-53281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016174#comment-18016174
]
Feilong He commented on SPARK-53281:
------------------------------------
[~gurwls223], [~maxgekk] do you have any comment on this Jira? If it makes
sense, could you assign this Jira to [~ghyeong]? I assume that several subtasks
will be required to complete this work.
> Enhance JSON Parsing to Support Standard Compliance
> ---------------------------------------------------
>
> Key: SPARK-53281
> URL: https://issues.apache.org/jira/browse/SPARK-53281
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 4.1.0
> Reporter: Philo He
> Priority: Major
>
> In the current version of Spark, the JSON parser is designed to be compatible
> with Hive, which means that some behaviors may not adhere strictly to
> standard JSON compliance. For instance, SPARK-30330 permits the use of single
> quotes in JSON parsing for functions such as {{get_json_object}} and
> {{{}json_tuple{}}}. Additionally, there are other instances where the
> behavior diverges from standard JSON practices.
>
> To address these inconsistencies, we propose introducing a configuration
> option that allows users to choose between legacy behavior and standard
> compliance. This approach ensures that existing workflows remain unaffected
> while providing the flexibility to adopt standard JSON practices if desired.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
