Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Serega Sheypak
we use vanilla spark right now. Here is an ansible script to install spark: https://github.com/seregasheypak/ansible-vagrant-dse-spark/blob/master/roles/spark_configuration/tasks/main.yml and cassandra dse: https://github.com/seregasheypak/ansible-vagrant-dse-spark/blob/master/roles/dse-install/ta

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Sebastian Estevez
Oh sorry Jay mentioned DSE and you said we already use it. I think the answer to your question is Brian's response. These are the dse docs if you want to read about it: http://docs.datastax.com/en/datastax_enterprise/4.6/datastax_enterprise/spark/sparkTOC.html On Apr 22, 2015 2:05 PM, "Serega Sh

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Serega Sheypak
What is "embedded" spark? Where can I read about it? Right now we just install spark 1.2 built fro hadoop 2.4 and use it to query data from cassandra. 2015-04-22 19:56 GMT+02:00 Sebastian Estevez : > There is no supported way to replace the embedded spark that comes in DSE > with something else.

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Sebastian Estevez
There is no supported way to replace the embedded spark that comes in DSE with something else. However you could probably read or write from/to DSE / Cassandra from a cloudera spark cluster using the open source DataStax connector. Are you looking for a particular feature that is not available in

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Brian O'Neill
or entities other than the intended recipient is strictly prohibited. From: Serega Sheypak Reply-To: Date: Wednesday, April 22, 2015 at 1:48 PM To: user Subject: Re: cassandra and spark from cloudera distirbution We already use it. Would like to use Spark from cloudera distribution. Sho

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Serega Sheypak
We already use it. Would like to use Spark from cloudera distribution. Should it work? 2015-04-22 19:43 GMT+02:00 Jay Ken : > There is a Enerprise Edition from Datastax; where they have Spark and > Cassandra Integration. > > http://www.datastax.com/what-we-offer/products-services/datastax-enterpr

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Jay Ken
There is a Enerprise Edition from Datastax; where they have Spark and Cassandra Integration. http://www.datastax.com/what-we-offer/products-services/datastax-enterprise Thanks, Jay On Wed, Apr 22, 2015 at 6:41 AM, Serega Sheypak wrote: > Hi, are Cassandra and Spark from Cloudera compatible? >

cassandra and spark from cloudera distirbution

2015-04-22 Thread Serega Sheypak
Hi, are Cassandra and Spark from Cloudera compatible? Where can I find these compatilibity notes?