zhztheplayer opened a new pull request, #51690:
URL: https://github.com/apache/spark/pull/51690

   ### What changes were proposed in this pull request?
   
   The PR proposes a change to make the V1 file write API 
FileFormatWriter.write customizable via a SQL configuration option.
   
   ### Why are the changes needed?
   
   Doing this will:
   1. Allow 3rd columnar plugins (by setting this option by default) to specify 
a columnar v1 writer during plugin initialization;
   2. Allow user to specify a customized row-based writer for certain purposes, 
e.g., performance, specific handling of partitioning, etc.;
   
   ### Does this PR introduce _any_ user-facing change?
   
   The user calls to `FileFormatWriter` needs to be changed to 
`DefaultFileFormatWriter` as the former becomes a trait.
   
   For example, before:
   
   ```scala
   FileFormatWriter.write(...)
   ```
   
   After:
   
   ```scala
   DefaultFileFormatWriter.write(...)
   ```
   
   ### How was this patch tested?
   
   Existing tests. An individual test for the customization is also being added.
   
   ### Was this patch authored or co-authored using generative AI tooling?
   
   No.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to