szehon-ho commented on code in PR #50571:
URL: https://github.com/apache/spark/pull/50571#discussion_r2040395136
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##########
@@ -5260,6 +5260,15 @@ object SQLConf {
.booleanConf
.createWithDefault(false)
+ val READ_DATA_SOURCE_CACHE_IGNORE_OPTIONS =
+ buildConf("spark.sql.legacy.readDataSourceCacheIgnoreOptions")
+ .internal()
+ .doc("When set to true, reading from file source table caches the first
query plan and " +
+ "ignores subsequent changes in query options, e.g. `delimiters` option
for csv tables.")
Review Comment:
optional: not sure if the example adds much value. We ignore subsequent
change to any query option right? I guess example can be more useful where we
document the options itself.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
