RE: SQL with Spark Streaming

Regards, Grace （Huang Jie) From: Jason Dai [mailto:jason@gmail.com] Sent: Wednesday, March 11, 2015 10:45 PM To: Irfan Ahmad Cc: Tobias Pfeiffer; Cheng, Hao; Mohit Anchlia; user@spark.apache.org; Shao, Saisai; Dai, Jason; Huang, Jie Subject: Re: SQL with Spark Streaming Sorry typo; should

Re: SQL with Spark Streaming

Hi, On Thu, Mar 12, 2015 at 12:08 AM, Huang, Jie wrote: > > According to my understanding, your approach is to register a series of > tables by using transformWith, right? And then, you can get a new Dstream > (i.e., SchemaDstream), which consists of lots of SchemaRDDs. > Yep, it's basically the

Re: SQL with Spark Streaming

Sorry typo; should be https://github.com/intel-spark/stream-sql Thanks, -Jason On Wed, Mar 11, 2015 at 10:19 PM, Irfan Ahmad wrote: > Got a 404 on that link: https://github.com/Intel-bigdata/spark-streamsql > > > *Irfan Ahmad* > CTO | Co-Founder | *CloudPhysics* >

Re: SQL with Spark Streaming

Got a 404 on that link: https://github.com/Intel-bigdata/spark-streamsql *Irfan Ahmad* CTO | Co-Founder | *CloudPhysics* Best of VMworld Finalist Best Cloud Management Award NetworkWorld 10 Startups to Watch EMA Most Notable Vendor On Wed, Mar 11, 2015 at 6:41 AM, J

Re: SQL with Spark Streaming

Yes, a previous prototype is available https://github.com/Intel-bigdata/spark-streamsql, and a talk is given at last year's Spark Summit ( http://spark-summit.org/2014/talk/streamsql-on-spark-manipulating-streams-by-sql-using-spark ) We are currently porting the prototype to use the latest DataFra

Re: SQL with Spark Streaming

Hi, On Wed, Mar 11, 2015 at 9:33 AM, Cheng, Hao wrote: > Intel has a prototype for doing this, SaiSai and Jason are the authors. > Probably you can ask them for some materials. > The github repository is here: https://github.com/intel-spark/stream-sql Also, what I did is writing a wrapper cla

RE: SQL with Spark Streaming

Intel has a prototype for doing this, SaiSai and Jason are the authors. Probably you can ask them for some materials. From: Mohit Anchlia [mailto:mohitanch...@gmail.com] Sent: Wednesday, March 11, 2015 8:12 AM To: user@spark.apache.org Subject: SQL with Spark Streaming Does Spark Streaming also

SQL with Spark Streaming

Does Spark Streaming also supports SQLs? Something like how Esper does CEP.