Kimahriman commented on code in PR #50483:
URL: https://github.com/apache/spark/pull/50483#discussion_r2025474678
##########
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/RocksDB.scala:
##########
@@ -1485,11 +1485,12 @@ class RocksDB(
override def log(infoLogLevel: InfoLogLevel, logMsg: String) = {
// Map DB log level to log4j levels
// Warn is mapped to info because RocksDB warn is too verbose
+ // Info is mapped to debug because RocksDB info is too verbose
Review Comment:
Particularly because it appears to spit out the statistics at some regular
interval for every opened state store instance on the executor, which can
accumulate to a lot and then drown out the logs of what the executor is
actually doing
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
