Re: Logging in Spark through YARN.

2014-09-24 Thread Vipul Pandey
Archit, Are you able to get it to work with 1.0.0? I tried the --files suggestion from Marcelo and it just changed logging for my client and the appmaster and executors were still the same. ~Vipul On Jul 30, 2014, at 9:59 PM, Archit Thakur wrote: > Hi Marcelo, > > Thanks for your quick comme

Re: Logging in Spark through YARN.

2014-07-30 Thread Archit Thakur
Hi Marcelo, Thanks for your quick comment. This doesn't seem working in 1.0.0. release. -Archit Thakur. On Thu, Jul 31, 2014 at 3:18 AM, Marcelo Vanzin wrote: > Hi Archit, > > Are you using spark-submit? If so, can you try adding the following to > its command line: > > --files /dir/log4j.p

Re: Logging in Spark through YARN.

2014-07-30 Thread Marcelo Vanzin
Hi Archit, Are you using spark-submit? If so, can you try adding the following to its command line: --files /dir/log4j.properties I tested that locally with the master branch and it works, but I don't have a 1.0.x install readily available for me to test at the moment. Handling of SPARK_LOG4J_