Re: RDD for Storm Streaming in Spark

2014-12-23 Thread Ajay
Right. I contacted the SummingBird users as well. It doesn't support Spark streaming currently. We are heading towards Storm as it is mostly widely used. Is Spark streaming production ready? Thanks Ajay On Tue, Dec 23, 2014 at 3:47 PM, Gerard Maas wrote: > I'm not aware of a project trying to

Re: RDD for Storm Streaming in Spark

2014-12-23 Thread Gerard Maas
I'm not aware of a project trying to achieve this integration. At some point Summingbird had the intention of adding an Spark port, and that could potentially bridge Storm and Spark. Not sure if that evolved into something concrete. In any case, an attempt to bring Storm and Spark together will co

Re: RDD for Storm Streaming in Spark

2014-12-23 Thread Ajay
Hi, The question is to do streaming in Spark with Storm (not using Spark Streaming). The idea is to use Spark as a in-memory computation engine and static data coming from Cassandra/Hbase and streaming data from Storm. Thanks Ajay On Tue, Dec 23, 2014 at 2:03 PM, Gerard Maas wrote: > Hi, > >

Re: RDD for Storm Streaming in Spark

2014-12-23 Thread Gerard Maas
Hi, I'm not sure what you are asking: Whether we can use spouts and bolts in Spark (=> no) or whether we can do streaming in Spark: http://spark.apache.org/docs/latest/streaming-programming-guide.html -kr, Gerard. On Tue, Dec 23, 2014 at 9:03 AM, Ajay wrote: > Hi, > > Can we use Storm Stre

RDD for Storm Streaming in Spark

2014-12-23 Thread Ajay
Hi, Can we use Storm Streaming as RDD in Spark? Or any way to get Spark work with Storm? Thanks Ajay