Hi, I would like to run spark-shell without any INFO messages printed. To achieve this I edited /conf/log4j.properties and added line log4j.rootLogger=OFF that suppose to disable all logging.
However, when I run ./spark-shell I see the message 4/08/03 16:02:15 INFO SecurityManager: Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties And then spark-shell prints all INFO messages as is. What did i missed? Why spark-shell uses default log4j properties and not the one defined in /conf directory? Is there another solution to prevent spark-shell from printing INFO messages? Thanks, Gil.
