Re: Unwanted SysOuts in Spark Parquet

2015-11-10 Thread Cheng Lian
This is because of PARQUET-369 , which prevents users or other libraries to override Parquet's JUL logging settings via SLF4J. It has been fixed in the most recent parquet-format master (PR #32

Re: Unwanted SysOuts in Spark Parquet

2015-11-09 Thread Hitoshi Ozawa
I'm not sure if following will work with Parquet output but have you tried setting sc.setLogLevel("ERROR") or setting log levels in spark's log4j.properties file? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Unwanted-SysOuts-in-Spark-Parquet-tp25325p25335