Re: use spark cluster in java web service

2018-11-01 Thread hemant singh
Why do't you explore Livy. You can use the Rest API to submit the jobs - https://community.hortonworks.com/articles/151164/how-to-submit-spark-application-through-livy-rest.html On Thu, Nov 1, 2018 at 12:52 PM 崔苗(数据与人工智能产品开发部) <0049003...@znv.com> wrote: > Hi, > we want to use spark in our java

Fwd: use spark cluster in java web service

2018-11-01 Thread onmstester onmstester
turns result to your application Sent using Zoho Mail Forwarded message From : 崔苗(数据与人工智能产品开发部) <0049003...@znv.com> To : "user" Date : Thu, 01 Nov 2018 10:52:15 +0330 Subject : use spark cluster in java web service Forwarded message

use spark cluster in java web service

2018-11-01 Thread 数据与人工智能产品开发部
Hi, we want to use spark in our java web service , compute data in spark cluster according to request,now we have two probles:1、 how to get sparkSession of remote spark cluster (spark on yarn mode) , we want to keep one sparkSession to execute all data compution;