[
https://issues.apache.org/jira/browse/SPARK-56170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18068060#comment-18068060
]
Yang Jie commented on SPARK-56170:
----------------------------------
The first PR will be submitted as soon as possible.
> Enable V2 file write path for built-in file formats
> ---------------------------------------------------
>
> Key: SPARK-56170
> URL: https://issues.apache.org/jira/browse/SPARK-56170
> Project: Spark
> Issue Type: Umbrella
> Components: SQL
> Affects Versions: 4.2.0
> Reporter: Yang Jie
> Priority: Major
>
> All built-in file formats (parquet, orc, csv, json, text, avro) default to
> the V1 write path via `spark.sql.sources.useV1SourceList`. The V2 file write
> path (`FileWrite`) was disabled since SPARK-28396. This umbrella covers
> enabling a fully functional V2 file write path: partitioned writes, dynamic
> overwrite, catalog integration, partition management, statistics, bucketing,
> and MSCK REPAIR TABLE.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
