Have you looked at job server?

https://github.com/spark-jobserver/spark-jobserver
https://www.youtube.com/watch?v=8k9ToZ4m6os
http://planetcassandra.org/blog/post/fast-spark-queries-on-in-memory-datasets/

All the best,


[image: datastax_logo.png] <http://www.datastax.com/>

Sebastián Estévez

Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com

[image: linkedin.png] <https://www.linkedin.com/company/datastax> [image:
facebook.png] <https://www.facebook.com/datastax> [image: twitter.png]
<https://twitter.com/datastax> [image: g+.png]
<https://plus.google.com/+Datastax/about>
<http://feeds.feedburner.com/datastax>

<http://cassandrasummit-datastax.com/>

DataStax is the fastest, most scalable distributed database technology,
delivering Apache Cassandra to the world’s most innovative enterprises.
Datastax is built to be agile, always-on, and predictably scalable to any
size. With more than 500 customers in 45 countries, DataStax is the
database technology and transactional backbone of choice for the worlds
most innovative companies such as Netflix, Adobe, Intuit, and eBay.

On Mon, Jun 1, 2015 at 8:13 AM, Mohammed Guller <moham...@glassbeam.com>
wrote:

>  Brian,
>
> We haven’t open sourced the REST server, but not  opposed to doing it.
> Just need to carve out some time to clean up the code and carve it out from
> all the other stuff that we do in that REST server.  Will try to do it in
> the next few weeks. If you need it sooner, let me know.
>
>
>
> I did consider the option of writing our own Spark SQL JDBC driver for C*,
> but it is lower on the priority list right now.
>
>
>
> Mohammed
>
>
>
> *From:* Brian O'Neill [mailto:boneil...@gmail.com] *On Behalf Of *Brian
> O'Neill
> *Sent:* Saturday, May 30, 2015 3:12 AM
>
> *To:* user@cassandra.apache.org
> *Subject:* Re: Spark SQL JDBC Server + DSE
>
>
>
>
>
> Any chance you open-sourced, or could open-source the REST server? ;)
>
>
>
> In thinking about it…
>
> It doesn’t feel like it would be that hard to write a Spark SQL JDBC
> driver against Cassandra, akin to what they have for hive:
>
>
> https://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server
>
>
>
> I wouldn’t mind collaborating on that, if you are headed in that direction.
>
> (and then I could write the REST server on top of that)
>
>
>
> LMK,
>
>
>
> -brian
>
>
>
> ---
>
> *Brian O'Neill *
>
> Chief Technology Officer
>
> Health Market Science, a LexisNexis Company
>
> 215.588.6024 Mobile • @boneill42 <http://www.twitter.com/boneill42>
>
>
>
> This information transmitted in this email message is for the intended
> recipient only and may contain confidential and/or privileged material. If
> you received this email in error and are not the intended recipient, or the
> person responsible to deliver it to the intended recipient, please contact
> the sender at the email above and delete this email and any attachments and
> destroy any copies thereof. Any review, retransmission, dissemination,
> copying or other use of, or taking any action in reliance upon, this
> information by persons or entities other than the intended recipient is
> strictly prohibited.
>
>
>
>
>
> *From: *Mohammed Guller <moham...@glassbeam.com>
> *Reply-To: *<user@cassandra.apache.org>
> *Date: *Friday, May 29, 2015 at 2:15 PM
> *To: *"user@cassandra.apache.org" <user@cassandra.apache.org>
> *Subject: *RE: Spark SQL JDBC Server + DSE
>
>
>
> Brian,
>
> I implemented a similar REST server last year and it works great. Now we
> have a requirement to support JDBC connectivity in addition to the REST
> API. We want to allow users to use tools like Tableau to connect to C*
> through the Spark SQL JDBC/Thift server.
>
>
>
> Mohammed
>
>
>
> *From:* Brian O'Neill [mailto:boneil...@gmail.com <boneil...@gmail.com>] *On
> Behalf Of *Brian O'Neill
> *Sent:* Thursday, May 28, 2015 6:16 PM
> *To:* user@cassandra.apache.org
> *Subject:* Re: Spark SQL JDBC Server + DSE
>
>
>
> Mohammed,
>
>
>
> This doesn’t really answer your question, but I’m working on a new REST
> server that allows people to submit SQL queries over REST, which get
> executed via Spark SQL.   Based on what I started here:
>
>
> http://brianoneill.blogspot.com/2015/05/spark-sql-against-cassandra-example.html
>
>
>
> I assume you need JDBC connectivity specifically?
>
>
>
> -brian
>
>
>
> ---
>
> *Brian O'Neill *
>
> Chief Technology Officer
>
> Health Market Science, a LexisNexis Company
>
> 215.588.6024 Mobile • @boneill42 <http://www.twitter.com/boneill42>
>
>
>
> This information transmitted in this email message is for the intended
> recipient only and may contain confidential and/or privileged material. If
> you received this email in error and are not the intended recipient, or the
> person responsible to deliver it to the intended recipient, please contact
> the sender at the email above and delete this email and any attachments and
> destroy any copies thereof. Any review, retransmission, dissemination,
> copying or other use of, or taking any action in reliance upon, this
> information by persons or entities other than the intended recipient is
> strictly prohibited.
>
>
>
>
>
> *From: *Mohammed Guller <moham...@glassbeam.com>
> *Reply-To: *<user@cassandra.apache.org>
> *Date: *Thursday, May 28, 2015 at 8:26 PM
> *To: *"user@cassandra.apache.org" <user@cassandra.apache.org>
> *Subject: *RE: Spark SQL JDBC Server + DSE
>
>
>
> Anybody out there using DSE + Spark SQL JDBC server?
>
>
>
> Mohammed
>
>
>
> *From:* Mohammed Guller [mailto:moham...@glassbeam.com
> <moham...@glassbeam.com>]
> *Sent:* Tuesday, May 26, 2015 6:17 PM
> *To:* user@cassandra.apache.org
> *Subject:* Spark SQL JDBC Server + DSE
>
>
>
> Hi –
>
> As I understand, the Spark SQL Thrift/JDBC server cannot be used with the
> open source C*. Only DSE supports  the Spark SQL JDBC server.
>
>
>
> We would like to find out whether how many organizations are using this
> combination. If you do use DSE + Spark SQL JDBC server, it would be great
> if you could share your experience. For example, what kind of issues you
> have run into? How is the performance? What reporting tools you are using?
>
>
>
> Thank  you!
>
>
>
> Mohammed
>
>
>

Reply via email to