Re: is there any way to submit spark application from outside of spark cluster

2016-03-25 Thread Hyukjin Kwon
Hi, For RESTful API for submitting an application, please take a look at this link. http://arturmkrtchyan.com/apache-spark-hidden-rest-api On 26 Mar 2016 12:07 p.m., "vetal king" wrote: > Prateek > > It's possible to submit spark application from outside application. If you > are using java the

Re: is there any way to submit spark application from outside of spark cluster

2016-03-25 Thread vetal king
Prateek It's possible to submit spark application from outside application. If you are using java then use ProcessBuilder and execute sparksubmit. There are two other options which i have not used. There is some spark submit server and spark also provides REST api to submit job but i don't have m

Re: is there any way to submit spark application from outside of spark cluster

2016-03-25 Thread sunil m
Hi Prateek! You might want to have a look at spark job server: https://github.com/spark-jobserver/spark-jobserver Warm regards, Sunil Manikani. On 25 March 2016 at 23:34, Ted Yu wrote: > Do you run YARN in your production environment (and plan to run Spark jobs > on YARN) ? > > If that is t

Re: is there any way to submit spark application from outside of spark cluster

2016-03-25 Thread Ted Yu
Do you run YARN in your production environment (and plan to run Spark jobs on YARN) ? If that is the case, hadoop configuration is needed. Cheers On Fri, Mar 25, 2016 at 11:01 AM, prateek arora wrote: > Hi > > Thanks for the information . it will definitely solve my problem > > I have one mor

Re: is there any way to submit spark application from outside of spark cluster

2016-03-25 Thread prateek arora
Hi Thanks for the information . it will definitely solve my problem I have one more question .. if i want to launch a spark application in production environment so is there any other way so multiple users can submit there job without having hadoop configuration . Regards Prateek On Fri, Ma

Re: is there any way to submit spark application from outside of spark cluster

2016-03-25 Thread Ted Yu
See this thread: http://search-hadoop.com/m/q3RTtAvwgE7dEI02 On Fri, Mar 25, 2016 at 10:39 AM, prateek arora wrote: > Hi > > I want to submit spark application from outside of spark clusters . so > please help me to provide a information regarding this. > > Regards > Prateek > > > > > -- > Vi