Re: [BEAM-301] Add a Beam SQL DSL

2017-02-28 Thread Mingmin Xu
Thanks @Tyler, @JB. The first question for me is how it's used, a SQL prompt like StormSQL, or the DSL API in Flink. In my project, it goes with the 1st one as it's targeted on self-service for analyst. looks odd for me to mix Java code and SQL string. Regarding to the scope, that's a good point t

Re: [BEAM-301] Add a Beam SQL DSL

2017-02-28 Thread Neelesh Salian
Hi Mingmin, Thanks for writing it up. I haven't had the chance to start work on it. Happy to help on tasks for building it. Feel free to assign BEAN-301 to yourself. On Tue, Feb 28, 2017 at 9:38 AM, Tyler Akidau wrote: > Hi Mingmin, > > Thanks for your interest in helping out on this task, a

Re: [BEAM-301] Add a Beam SQL DSL

2017-02-28 Thread Tyler Akidau
Hi Mingmin, Thanks for your interest in helping out on this task, and for your initial proposal. I'm also very happy to work with you on this, and excited to see some progress made here. Added a few more comments on the doc, but will summarize them below as well. As far as the DSL point goes, I a

Re: [BEAM-301] Add a Beam SQL DSL

2017-02-27 Thread Jean-Baptiste Onofré
Hi Mingmin, The idea is actual both: 1. an interactive SQL prompt where we can express pipeline directly using SQL. 2. a SQL DSL to describe a pipeline in SQL and create the corresponding Java code under the hood. I provided couple of comments on the doc. Ready and happy to help you on this