You can create log4j.properties under your SPARK_HOME/conf and set up these
properties -
log4j.rootCategory=INFO, console
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.target=System.err
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{yy/MM/dd HH:mm:ss} %p
%c{1}: %m%n
Do it across all workers/executers.
On Mon, Oct 12, 2015 at 4:09 PM, Spark Newbie <sparknewbie1...@gmail.com>
wrote:
> Hi Spark users,
>
> Is there an easy way to turn on DEBUG logs in receivers and executors?
> Setting sparkContext.setLogLevel seems to turn on DEBUG level only on the
> Driver.
>
> Thanks,
>
