Re: RESTful Endpoint and Spark

2016-10-07 Thread Benjamin Kim
It would appear the simple answer is to use the JDBC thriftserver in Spark. Thanks, Ben > On Oct 6, 2016, at 9:38 PM, Matei Zaharia wrote: > > This is exactly what the Spark SQL Thrift server does, if you just want to > access it using JDBC. > > Matei > >> On Oct 6, 2016, at 4:27 PM, Benjami

Re: RESTful Endpoint and Spark

2016-10-06 Thread Matei Zaharia
This is exactly what the Spark SQL Thrift server does, if you just want to access it using JDBC. Matei > On Oct 6, 2016, at 4:27 PM, Benjamin Kim wrote: > > Has anyone tried to integrate Spark with a server farm of RESTful API > endpoints or even HTTP web-servers for that matter? I know it’s

Re: RESTful Endpoint and Spark

2016-10-06 Thread Ofer Eliassaf
there are 2 main projects for that: livy(https://github.com/cloudera/livy) and spark job server(https://github.com/spark-jobserver/spark-jobserver). On Fri, Oct 7, 2016 at 2:27 AM, Benjamin Kim wrote: > Has anyone tried to integrate Spark with a server farm of RESTful API > endpoints or even HTT

RESTful Endpoint and Spark

2016-10-06 Thread Benjamin Kim
Has anyone tried to integrate Spark with a server farm of RESTful API endpoints or even HTTP web-servers for that matter? I know it’s typically done using a web farm as the presentation interface, then data flows through a firewall/router to direct calls to a JDBC listener that will SELECT, INSE