Re: Control the stdout and stderr streams in a executor JVM

Hi, You can create log4j.properties for executors, and use "--files > log4j.properties" when submitting In the case when we are initializing spark context via java, how can we pass the same parameter? jsc = new JavaSparkContext(conf); Is it possible to set this parameter in spark-defaults.con

Re: Control the stdout and stderr streams in a executor JVM

You can create log4j.properties for executors, and use "--files log4j.properties" when submitting spark jobs. On Mon, Feb 29, 2016 at 1:50 PM, Niranda Perera wrote: > Hi all, > > Is there any possibility to control the stdout and stderr streams in an > executor JVM? > > I understand that there a

Control the stdout and stderr streams in a executor JVM

Hi all, Is there any possibility to control the stdout and stderr streams in an executor JVM? I understand that there are some configurations provided from the spark conf as follows spark.executor.logs.rolling.maxRetainedFiles spark.executor.logs.rolling.maxSize spark.executor.logs.rolling.strate