Looks like going with cluster mode is not a good idea:
http://azure.microsoft.com/en-us/documentation/articles/hdinsight-administer-use-management-portal/
Seems like a non-HDInsight VM might be needed to make it the Spark master
node.
Marco
On Mon, Jul 14, 2014 at 12:43 PM, Marco Shaw wrote:
I'm a Spark and HDInsight novice, so I could be wrong...
HDInsight is based on HDP2, so my guess here is that you have the option of
installing/configuring Spark in cluster mode (YARN) or in standalone mode
and package the Spark binaries with your job.
Everything I seem to look at is related to U