SaveToCassandra executed when I stop Spark

2016-07-23 Thread Fernando Avalos
> Hi Spark guys, > > I am getting the information from Streaming and I transform the information: > > questionStream.filter(_.getEntity.isEmpty).mapPartitions[Choice](questionHandler(_)).saveToCassandra("test","question" > > I am getting the information from Streaming, I do some filtering and I tra

SaveToCassandra executed when I stop Spark

2016-07-23 Thread Fernando Avalos
Hi Spark guys, I am getting the information from Streaming and I transform the information: questionStream.filter(_.getEntity.isEmpty).mapPartitions[Choice](questionHandler(_)).saveToCassandra("test","question" I am getting the information from Streaming, I do some filtering and I transform to C

Node guardian implementation and Spark standalone process

2017-01-24 Thread Fernando Avalos
Hi, We were taking a look to https://github.com/killrweather/killrweather. This application is deployed on a akka cluster and looks like a ref app from Datastax. Is this the best approach for spark stream? Or should we go with spark standalone? What are the pros and cons? Thanks,