Re: [VOTE] Spark 2.3.0 (RC2)

2018-02-06 Thread Sameer Agarwal
FYI -- Thanks to a big community-wide effort over the last few days, we're now down to just one last remaining code blocker again: https://issues.apache.org/jira/browse/SPARK-23309 I'll cut an RC3 as soon as that's resolved. On 4 February 2018 at 00:02, Xingbo Jiang wrote: > I filed another NPE

Re: SQL logical plans and DataSourceV2 (was: data source v2 online meetup)

2018-02-06 Thread Ryan Blue
Instead of exploring possible operations ourselves, I think we should follow the SQL standard. Most of these do. We should make conscious decisions with the standard in mind for the SQL API. But we also have the Scala API (and versions of it in other languages) and need to consider how these opera