Peter Toth created SPARK-60107:
----------------------------------
Summary: Trim the storage-filter comments and conf docs
Key: SPARK-60107
URL: https://issues.apache.org/jira/browse/SPARK-60107
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 5.0.0
Reporter: Peter Toth
Trim the comments of the late-materialization storage-filter pushdown
(SPARK-59620, SPARK-60034) to the invariants and the non-obvious trade-offs.
Rewrite the user-facing doc of spark.sql.parquet.storageFilterPushdown.enabled
to what changes a user's decision or answer.
Suggested in https://github.com/apache/spark/pull/58895#issuecomment-6064730845.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
