Why do't you explore Livy. You can use the Rest API to submit the jobs -
https://community.hortonworks.com/articles/151164/how-to-submit-spark-application-through-livy-rest.html
On Thu, Nov 1, 2018 at 12:52 PM 崔苗(数据与人工智能产品开发部) <0049003...@znv.com> wrote:
> Hi,
> we want to use spark in our java
turns result to your application Sent using Zoho Mail
Forwarded message From : 崔苗(数据与人工智能产品开发部) <0049003...@znv.com> To
: "user" Date : Thu, 01 Nov 2018 10:52:15 +0330 Subject
: use spark cluster in java web service Forwarded message
Hi,
we want to use spark in our java web service , compute data in spark cluster according to request,now we have two probles:1、 how to get sparkSession of remote spark cluster (spark on yarn mode) , we want to keep one sparkSession to execute all data compution;