Re: cassandra + spark / pyspark

2014-09-12 Thread Francisco Madrid-Salvador
Hi Oleg, Connectors don't deal with HA, they rely on Spark for that, so neither the Datastax connector, Stratio Deep nor Calliope have anything to do with Spark's HA. You should have previously configured Spark so that it meets your high availability needs. Furthermore, as I mentioned in a pr

cassandra + spark / pyspark

2014-09-10 Thread Francisco Madrid-Salvador
Hi Oleg, Stratio Deep is just a library you must include in your Spark deployment so it doesn't guarantee any high availability at all. To achieve HA you must use Mesos or any other 3rd party resource manager. Stratio doesn't currently support PySpark, just Scala and Java. Perhaps in the fut

cassandra + spark / pyspark

2014-09-10 Thread Francisco Madrid-Salvador
Hi Oleg, If you want to use cassandra+spark without hadoop, perhaps Stratio Deep is your best choice (https://github.com/Stratio/stratio-deep). It's an open-source Spark + Cassandra connector that doesn't make any use of Hadoop or Hadoop component. http://docs.openstratio.org/deep/0.3.3/abou