Are you running in yarn-standalone mode or yarn-client mode? Also, what YARN scheduler and what NodeManager heartbeat?
On Sun, Mar 2, 2014 at 9:41 PM, polkosity <polkos...@gmail.com> wrote: > Thanks for the advice Mayur. > > I thought I'd report back on the performance difference... Spark > standalone > mode has executors processing at capacity in under a second :) > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Job-initialization-performance-of-Spark-standalone-mode-vs-YARN-tp2016p2243.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >
