Hi there, I'm trying to run JavaSparkPi example on YARN with master = yarn-client but I have a problem. It runs smoothly with submitting application, first container for Application Master works too. When job is starting and there are some tasks to do I'm getting this warning on console (I'm using windows cmd if this makes any difference): WARN cluster.YarnClientClusterScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient memory
When I'm checking logs for container with Application Masters it is launching containers for executors "properly", then goes with: INFO YarnAllocationHandler: Completed container container_1409217202587_0003_01_000002 (state: COMPLETE, exit status: 1) INFO YarnAllocationHandler: Container marked as failed: container_1409217202587_0003_01_000002 And tries to re-launch them. On failed container log there is only this: Error: Could not find or load main class pwd..sp...@gbv06758291.my.secret.address.net:63680.user.CoarseGrainedScheduler Any hints? I run YARN on 1 machine with 16GB RAM and 2 cores so it's definietly not case of propagation of spark assembly jar, cause without it firs container with Application Master would fail too. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SPARK-on-YARN-containers-fails-tp13024.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
