Thanks for the tip. Been wondering myself how one would do that.
On Tue, Apr 15, 2014 at 5:04 AM, Wei Da <xwd0...@gmail.com> wrote: > The solution: > Edit /opt/spark-0.9.0-incubating-bin-hadoop2/conf/log4j.properties, > changing > Spark's output to WARN. Done! > > Refer to: > > https://github.com/amplab-extras/SparkR-pkg/blob/master/pkg/src/src/main/resources/log4j.properties#L8 > > > > > eduardocalfaia wrote > > Have you already tried in conf/log4j.properties? > > log4j.rootCategory=OFF > > > > Em 4/3/14, 13:46, weida xu escreveu: > >> Hi, alll > >> > >> When I start spark in the shell. It automatically output some system > >> info every minute, see below. Can I stop or block the output of these > >> info? I tried the ":silent" comnond, but the automatical output remains. > >> > >> 14/04/03 19:34:30 INFO MetadataCleaner: Ran metadata cleaner for > >> SHUFFLE_BLOCK_MANAGER > >> 14/04/03 19:34:30 INFO BlockManager: Dropping non broadcast blocks > >> older than 1396524270698 > >> 14/04/03 19:34:30 INFO MetadataCleaner: Ran metadata cleaner for > >> BLOCK_MANAGER > >> 14/04/03 19:34:30 INFO BlockManager: Dropping broadcast blocks older > >> than 1396524270701 > >> 14/04/03 19:34:30 INFO MetadataCleaner: Ran metadata cleaner for > >> BROADCAST_VARS > >> 14/04/03 19:34:30 INFO MetadataCleaner: Ran metadata cleaner for > >> HTTP_BROADCAST > >> 14/04/03 19:34:30 INFO MetadataCleaner: Ran metadata cleaner for > >> MAP_OUTPUT_TRACKER > >> 14/04/03 19:34:31 INFO MetadataCleaner: Ran metadata cleaner for > >> SPARK_CONTEXT > >> 14/04/03 19:34:31 INFO DAGScheduler: shuffleToMapStage 0 --> 0 > >> 14/04/03 19:34:31 INFO DAGScheduler: stageIdToStage 0 --> 0 > >> 14/04/03 19:34:31 INFO DAGScheduler: stageIdToJobIds 0 --> 0 > >> 14/04/03 19:34:31 INFO DAGScheduler: pendingTasks 0 --> 0 > >> 14/04/03 19:34:31 INFO DAGScheduler: jobIdToStageIds 0 --> 0 > >> 14/04/03 19:34:31 INFO DAGScheduler: stageToInfos 0 --> 0 > >> 14/04/03 19:34:31 INFO MetadataCleaner: Ran metadata cleaner for > >> DAG_SCHEDULER > >> > >> > >> > > > > > > -- > > Informativa sulla Privacy: http://www.unibs.it/node/8155 > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/How-to-stop-system-info-output-in-spark-shell-tp3704p4266.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >
