Yes, even though we dont have immediate plans, I definitely would like to see it happen some time in not-so-distant future.
TD On Thu, Jul 10, 2014 at 7:55 PM, Shao, Saisai <[email protected]> wrote: > No specific plans to do so, since there has some functional loss like > time based windowing function which is important for streaming sql. Also > keep compatible with fast growing SparkSQL is quite hard. So no clear plans > to submit to upstream. > > > > -Jerry > > > > *From:* Tobias Pfeiffer [mailto:[email protected]] > *Sent:* Friday, July 11, 2014 10:47 AM > > *To:* [email protected] > *Subject:* Re: Some question about SQL and streaming > > > > Hi, > > > > On Fri, Jul 11, 2014 at 11:38 AM, Shao, Saisai <[email protected]> > wrote: > > Actually we have a POC project which shows the power of combining Spark > Streaming and Catalyst, it can manipulate SQL on top of Spark Streaming and > get SchemaDStream. You can take a look at it: > https://github.com/thunderain-project/StreamSQL > > > > Wow, that looks great! Any plans to get this code (or functionality) > merged into Spark? > > > > Tobias > > >
