Cant speak to the internals of SparkSubmit and how to reproduce sans jvm, guess would depend if you want/need to support various deployment enviroments (stand-alone, mesos, yarn, etc)
If just need YARN, or looking at starting point, might want to look at capabilities of YARN API: http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/ResourceM anagerRest.html#Cluster_Applications_APISubmit_Application From: Nick Chammas [mailto:nicholas.cham...@gmail.com] Sent: Sunday, January 11, 2015 1:45 PM To: user@spark.apache.org Subject: Submit Spark applications from a machine that doesn't have Java installed Is it possible to submit a Spark application to a cluster from a machine that does not have Java installed? My impression is that many, many more computers come with Python installed by default than do with Java. I want to write a command-line utility <https://issues.apache.org/jira/browse/SPARK-3499> that submits a Spark application to a remote cluster. I want that utility to run on as many machines as possible out-of-the-box, so I want to avoid a dependency on Java (or a JRE) if possible. Nick _____ View this message in context: Submit Spark applications from a machine that doesn't have Java installed <http://apache-spark-user-list.1001560.n3.nabble.com/Submit-Spark-applicatio ns-from-a-machine-that-doesn-t-have-Java-installed-tp21085.html> Sent from the Apache Spark User List mailing list archive <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.
