[
https://issues.apache.org/jira/browse/SPARK-51269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiaan Geng updated SPARK-51269:
-------------------------------
Description:
Currently, the default value of spark.sql.avro.deflate.level is -1. But it
managed with the enum AvroCompressionCodec.
If developers use the config item in any other code path, there is no guarantee
for the default value.
On the other hand, users will confused, if there is no default value in SQLConf.
> Let the SQLConf control the default value for compression level
> ---------------------------------------------------------------
>
> Key: SPARK-51269
> URL: https://issues.apache.org/jira/browse/SPARK-51269
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 4.0.0
> Reporter: Jiaan Geng
> Assignee: Jiaan Geng
> Priority: Major
>
> Currently, the default value of spark.sql.avro.deflate.level is -1. But it
> managed with the enum AvroCompressionCodec.
> If developers use the config item in any other code path, there is no
> guarantee for the default value.
> On the other hand, users will confused, if there is no default value in
> SQLConf.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
