Brij Raj Kishore created SPARK-57418:
----------------------------------------
Summary: [DOCS] Add singleVariantColumn option to CSV, JSON, and
XML data source options tables
Key: SPARK-57418
URL: https://issues.apache.org/jira/browse/SPARK-57418
Project: Spark
Issue Type: Documentation
Components: SQL
Affects Versions: 4.1.0
Reporter: Brij Raj Kishore
The singleVariantColumn read option was introduced in Spark 4.1.0 for CSV
(SPARK-51298), JSON, and XML data sources. It allows ingesting an entire record
as a single VARIANT type column instead of parsing it into individual fields.
Despite being a user-facing option, it is absent from all three data source
options reference tables:
- docs/sql-data-sources-csv.md
- docs/sql-data-sources-json.md
- docs/sql-data-sources-xml.md
The option is defined in:
- DataSourceOptions.scala (shared constant)
- CSVOptions.scala
- JSONOptions.scala
- XmlOptions.scala
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
