siying commented on code in PR #50483:
URL: https://github.com/apache/spark/pull/50483#discussion_r2035895751
##########
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/RocksDB.scala:
##########
@@ -1485,11 +1485,12 @@ class RocksDB(
override def log(infoLogLevel: InfoLogLevel, logMsg: String) = {
// Map DB log level to log4j levels
// Warn is mapped to info because RocksDB warn is too verbose
+ // Info is mapped to debug because RocksDB info is too verbose
Review Comment:
@anishshri-db sorry for the late respond. Stats dump period can be adjusted
using
https://github.com/facebook/rocksdb/blob/6d802639f7dc35bf765dbe1ed6b3942e4d76375d/java/src/main/java/org/rocksdb/Options.java#L764
The default is 10 minutes, which perhaps is indeed too frequent.. I think we
can easily adjust to one hour.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
