Does it still hit the memory limit for the container? An expensive transformation?
On Wed, Apr 22, 2015 at 8:45 AM, Ted Yu <yuzhih...@gmail.com> wrote: > In master branch, overhead is now 10%. > That would be 500 MB > > FYI > > > > > On Apr 22, 2015, at 8:26 AM, nsalian <neeleshssal...@gmail.com> wrote: > > > > +1 to executor-memory to 5g. > > Do check the overhead space for both the driver and the executor as per > > Wilfred's suggestion. > > > > Typically, 384 MB should suffice. > > > > > > > > -- > > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Performance-on-Yarn-tp21729p22610.html > > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > > For additional commands, e-mail: user-h...@spark.apache.org > > >
