Re: RESTful Operations

2020-01-20 Thread hamishberridge
I see. Thanks for the advice! Jan 20, 2020, 09:47 by hemant2...@gmail.com: > Livy has both statement based(scala) as well as batch processing(code jar > packaged). I think first statement based approach is what you might want to > look at. > Data has to residing in some source. > > Thanks, >

Re: RESTful Operations

2020-01-20 Thread hemant singh
Livy has both statement based(scala) as well as batch processing(code jar packaged). I think first statement based approach is what you might want to look at. Data has to residing in some source. Thanks, Hemant On Mon, 20 Jan 2020 at 2:04 PM, wrote: > Sorry didn't explain well. Livy seems to me

Re: RESTful Operations

2020-01-20 Thread hamishberridge
Sorry didn't explain well. Livy seems to me similar to job server by interacting through restful api interface forĀ  job submission. The task I want to achieve is more like general restful api interface where user would provide some parameters for business operations (a bit like readText or a cus

Re: RESTful Operations

2020-01-19 Thread Chris Teoh
Maybe something like Livy, otherwise roll your own REST API and have it start a Spark job. On Mon, 20 Jan 2020 at 06:55, wrote: > I am new to Spark. The task I want to accomplish is let client send http > requests, then spark process that request for further operations. However > searching Spark