RE: Yarn Spark on EMR

2015-11-20 Thread Bozeman, Christopher
be found from the YARN Resource Manager UI (master node:8088) and it would be best to use a SOCKS proxy in order nicely resolve the URLs. Best regards, Christopher From: SURAJ SHETH [mailto:shet...@gmail.com] Sent: Sunday, November 15, 2015 8:19 AM To: user@spark.apache.org Subject: Yarn Spark

Yarn Spark on EMR

2015-11-15 Thread SURAJ SHETH
Hi, Yarn UI on 18080 stops receiving updates Spark jobs/tasks immediately after it starts. We see only one task completed in the UI while the other hasn't got any resources while in reality, more than 5 tasks would have completed. Hadoop - Amazon 2.6 Spark - 1.5 Thanks and Regards, Suraj Sheth