RE: How to submit spark job to YARN from scala code

2015-12-17 Thread Alexander Pivovarov
ntially redeployed every time you submit a Spark job using a custom sbt > task: > https://github.com/saurfang/sbt-spark-submit/blob/master/src/main/scala/sbtsparksubmit/SparkSubmitPlugin.scala#L85 > > > -------------- > Subject: Re: How to submit spark job to YA

RE: How to submit spark job to YARN from scala code

2015-12-17 Thread Forest Fang
ubmit/SparkSubmitPlugin.scala#L85 Subject: Re: How to submit spark job to YARN from scala code From: ste...@hortonworks.com CC: user@spark.apache.org Date: Thu, 17 Dec 2015 19:45:16 + On 17 Dec 2015, at 16:50, Saiph Kappa wrote: Hi, Since it is not currently possible to submit a

Re: How to submit spark job to YARN from scala code

2015-12-17 Thread Steve Loughran
On 17 Dec 2015, at 16:50, Saiph Kappa mailto:saiph.ka...@gmail.com>> wrote: Hi, Since it is not currently possible to submit a spark job to a spark cluster running in standalone mode (cluster mode - it's not currently possible to specify this deploy mode within the code), can I do it with YAR