This file only exists on the master and not the slave nodes, so you are probably running into https://issues.apache.org/jira/browse/SPARK-11105, which has already been fixed in the not-yet-released Spark 1.6.0. EMR will upgrade to Spark 1.6.0 once it is released.
~ Jonathan On Thu, Nov 19, 2015 at 1:30 PM, Afshartous, Nick <nafshart...@turbine.com> wrote: > > Hi, > > On Spark 1.5 on EMR 4.1 the message below appears in stderr in the Yarn UI. > > ERROR StatusLogger No log4j2 configuration file found. Using default > configuration: logging only errors to the console. > > I do see that there is > > /usr/lib/spark/conf/log4j.properties > > Can someone please advise on how to setup log4j properly. > > Thanks, > -- > Nick > > Notice: This communication is for the intended recipient(s) only and may > contain confidential, proprietary, legally protected or privileged > information of Turbine, Inc. If you are not the intended recipient(s), > please notify the sender at once and delete this communication. > Unauthorized use of the information in this communication is strictly > prohibited and may be unlawful. For those recipients under contract with > Turbine, Inc., the information in this communication is subject to the > terms and conditions of any applicable contracts or agreements. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
