when there is something new, it's also cool to let imagination fly far away ;)
On Thu, Mar 27, 2014 at 2:20 PM, andy petrella <andy.petre...@gmail.com>wrote: > Yes it could, of course. I didn't say that there is no tool to do it, > though ;-). > > Andy > > > On Thu, Mar 27, 2014 at 12:49 PM, yana <yana.kadiy...@gmail.com> wrote: > >> Does Shark not suit your needs? That's what we use at the moment and it's >> been good >> >> >> Sent from my Samsung Galaxy S®4 >> >> >> -------- Original message -------- >> From: andy petrella >> Date:03/27/2014 6:08 AM (GMT-05:00) >> To: user@spark.apache.org >> Subject: Re: Announcing Spark SQL >> >> nope (what I said :-P) >> >> >> On Thu, Mar 27, 2014 at 11:05 AM, Pascal Voitot Dev < >> pascal.voitot....@gmail.com> wrote: >> >>> >>> >>> >>> On Thu, Mar 27, 2014 at 10:22 AM, andy petrella <andy.petre...@gmail.com >>> > wrote: >>> >>>> I just mean queries sent at runtime ^^, like for any RDBMS. >>>> In our project we have such requirement to have a layer to play with >>>> the data (custom and low level service layer of a lambda arch), and >>>> something like this is interesting. >>>> >>>> >>> Ok that's what I thought! But for these runtime queries, is a macro >>> useful for you? >>> >>> >>>> >>>> >>>> On Thu, Mar 27, 2014 at 10:15 AM, Pascal Voitot Dev < >>>> pascal.voitot....@gmail.com> wrote: >>>> >>>>> >>>>> Le 27 mars 2014 09:47, "andy petrella" <andy.petre...@gmail.com> a >>>>> écrit : >>>>> >>>>> > >>>>> > I hijack the thread, but my2c is that this feature is also important >>>>> to enable ad-hoc queries which is done at runtime. It doesn't remove >>>>> interests for such macro for precompiled jobs of course, but it may not be >>>>> the first use case envisioned with this Spark SQL. >>>>> > >>>>> >>>>> I'm not sure to see what you call "ad- hoc queries"... Any sample? >>>>> >>>>> > Again, only my0.2c (ok I divided by 10 after writing my thoughts ^^) >>>>> > >>>>> > Andy >>>>> > >>>>> > On Thu, Mar 27, 2014 at 9:16 AM, Pascal Voitot Dev < >>>>> pascal.voitot....@gmail.com> wrote: >>>>> >> >>>>> >> Hi, >>>>> >> Quite interesting! >>>>> >> >>>>> >> Suggestion: why not go even fancier & parse SQL queries at >>>>> compile-time with a macro ? ;) >>>>> >> >>>>> >> Pascal >>>>> >> >>>>> >> >>>>> >> >>>>> >> On Wed, Mar 26, 2014 at 10:58 PM, Michael Armbrust < >>>>> mich...@databricks.com> wrote: >>>>> >>> >>>>> >>> Hey Everyone, >>>>> >>> >>>>> >>> This already went out to the dev list, but I wanted to put a >>>>> pointer here as well to a new feature we are pretty excited about for >>>>> Spark >>>>> 1.0. >>>>> >>> >>>>> >>> >>>>> http://databricks.com/blog/2014/03/26/Spark-SQL-manipulating-structured-data-using-Spark.html >>>>> >>> >>>>> >>> Michael >>>>> >> >>>>> >> >>>>> > >>>>> >>>> >>>> >>> >> >