Hi all, I hope you guys are enjoying the holiday season. I just wanted to have some quick feedback about this PR https://github.com/apache/spark/pull/49297
This PR allows you do set/unset SQL configurations in Pythonic way, e.g., >>> spark.conf["spark.sql.optimizer.runtime.rowLevelOperationGroupFilter.enabled"] = "false" >>> spark.conf["spark.sql.optimizer.runtime.rowLevelOperationGroupFilter.enabled"] 'false' as pandas also supports a similar way ( https://pandas.pydata.org/docs/user_guide/options.html) Any feedback on this approach would be appreciated. Thanks!
