Re: Welcoming Tejas Patil as a Spark committer

2017-09-29 Thread Takeshi Yamamuro
Congrats! best, takeshi On Sat, Sep 30, 2017 at 8:47 AM, vaquar khan wrote: > Congrats Tejas > > Regards, > Vaquar khan > > On Fri, Sep 29, 2017 at 4:33 PM, Mridul Muralidharan > wrote: > >> Congratulations Tejas ! >> >> Regards, >> Mridul >> >> On Fri, Sep 29, 2017 at 12:58 PM, Matei Zaharia

Re: [VOTE] Spark 2.1.2 (RC2)

2017-09-29 Thread vaquar khan
+1 (non-binding) Regards, Vaquar khan On Fri, Sep 29, 2017 at 1:52 PM, Ryan Blue wrote: > +1 (non-binding) > > Checked all signatures/checksums for binaries and source, spot-checked > maven artifacts. Thanks for fixing the signatures, Holden! > > On Fri, Sep 29, 2017 at 8:25 AM, Holden Karau >

Re: Welcoming Tejas Patil as a Spark committer

2017-09-29 Thread vaquar khan
Congrats Tejas Regards, Vaquar khan On Fri, Sep 29, 2017 at 4:33 PM, Mridul Muralidharan wrote: > Congratulations Tejas ! > > Regards, > Mridul > > On Fri, Sep 29, 2017 at 12:58 PM, Matei Zaharia > wrote: > > Hi all, > > > > The Spark PMC recently added Tejas Patil as a committer on the > > pr

Re: Welcoming Tejas Patil as a Spark committer

2017-09-29 Thread Mridul Muralidharan
Congratulations Tejas ! Regards, Mridul On Fri, Sep 29, 2017 at 12:58 PM, Matei Zaharia wrote: > Hi all, > > The Spark PMC recently added Tejas Patil as a committer on the > project. Tejas has been contributing across several areas of Spark for > a while, focusing especially on scalability issue

Re: Welcoming Tejas Patil as a Spark committer

2017-09-29 Thread shane knapp
congrats, and welcome! :) On Fri, Sep 29, 2017 at 12:58 PM, Matei Zaharia wrote: > Hi all, > > The Spark PMC recently added Tejas Patil as a committer on the > project. Tejas has been contributing across several areas of Spark for > a while, focusing especially on scalability issues and SQL. Ple

Welcoming Tejas Patil as a Spark committer

2017-09-29 Thread Matei Zaharia
Hi all, The Spark PMC recently added Tejas Patil as a committer on the project. Tejas has been contributing across several areas of Spark for a while, focusing especially on scalability issues and SQL. Please join me in welcoming Tejas! Matei -

Re: [discuss] Data Source V2 write path

2017-09-29 Thread Ryan Blue
> Spark doesn't know how to create a table in external systems like Cassandra, and that's why it's currently done inside the data source writer. This isn't a valid argument for doing this task in the writer for v2. If we want to fix the problems with v1, we shouldn't continue to mix write operatio

Re: [VOTE] Spark 2.1.2 (RC2)

2017-09-29 Thread Ryan Blue
+1 (non-binding) Checked all signatures/checksums for binaries and source, spot-checked maven artifacts. Thanks for fixing the signatures, Holden! On Fri, Sep 29, 2017 at 8:25 AM, Holden Karau wrote: > As a follow up the JIRA for this is at https://issues.apache.org/ > jira/browse/SPARK-22167 >

Re: [VOTE] Spark 2.1.2 (RC2)

2017-09-29 Thread Holden Karau
As a follow up the JIRA for this is at https://issues.apache.org/jira/browse/SPARK-22167 On Fri, Sep 29, 2017 at 2:50 AM, Holden Karau wrote: > This vote is canceled and will be replaced with an RC3 once Felix and I > figure out the R packaging issue. > > On Fri, Sep 29, 2017 at 1:03 AM Felix Ch

Re: [VOTE] Spark 2.1.2 (RC2)

2017-09-29 Thread Holden Karau
This vote is canceled and will be replaced with an RC3 once Felix and I figure out the R packaging issue. On Fri, Sep 29, 2017 at 1:03 AM Felix Cheung wrote: > -1 > > (Sorry) spark-2.1.2-bin-hadoop2.7.tgz is missing the R directory, not sure > why yet. > > Tested on multiple platform as source p

Structured Streaming and Hive

2017-09-29 Thread HanPan
Hi guys, I'm new to spark structured streaming. I'm using 2.1.0 and my scenario is reading specific topic from kafka and do some data mining tasks, then save the result dataset to hive. While writing data to hive, somehow it seems like not supported yet and I tried this: It run