Re: [VOTE] SPIP: Spark API for Table Metadata

2019-02-27 Thread Russell Spitzer
+1 (non-binding) On Wed, Feb 27, 2019, 6:28 PM Ryan Blue wrote: > Hi everyone, > > In the last DSv2 sync, the consensus was that the table metadata SPIP was > ready to bring up for a vote. Now that the multi-catalog identifier SPIP > vote has passed, I'd like to start one for the table metadata

Re: [DISCUSS] Spark 3.0 and DataSourceV2

2019-02-27 Thread Wenchen Fan
I'm good with the list from Ryan, thanks! On Thu, Feb 28, 2019 at 1:00 AM Ryan Blue wrote: > I think that's a good plan. Let's get the functionality done, but mark it > experimental pending a new row API. > > So is there agreement on this set of work, then? > > On Tue, Feb 26, 2019 at 6:30 PM Ma

[VOTE] SPIP: Spark API for Table Metadata

2019-02-27 Thread Ryan Blue
Hi everyone, In the last DSv2 sync, the consensus was that the table metadata SPIP was ready to bring up for a vote. Now that the multi-catalog identifier SPIP vote has passed, I'd like to start one for the table metadata API, TableCatalog. The proposal is for adding a TableCatalog interface that

Re: [DISCUSS] SPIP: .NET bindings for Apache Spark

2019-02-27 Thread Holden Karau
I’m +1 with Seans comment on the JIRA initially starting outside of Spark is probably the easiest way forward. On Wed, Feb 27, 2019 at 10:04 AM Sriram Sundaresan < sriram.sundare...@imaginea.com> wrote: > I am interested to take this up. Please let me know how to > proceed/contribute to this. >

Re: [DISCUSS] SPIP: .NET bindings for Apache Spark

2019-02-27 Thread Sriram Sundaresan
I am interested to take this up. Please let me know how to proceed/contribute to this. On Wed, Feb 27, 2019 at 11:27 PM Terry Kim wrote: > Hi, > > I have posted a SPIP to JIRA: > https://issues.apache.org/jira/browse/SPARK-27006. > > I look forward to your feedback. > > Thanks, > Terry > --

[DISCUSS] SPIP: .NET bindings for Apache Spark

2019-02-27 Thread Terry Kim
Hi, I have posted a SPIP to JIRA: https://issues.apache.org/jira/browse/SPARK-27006. I look forward to your feedback. Thanks, Terry

Re: [DISCUSS] Spark 3.0 and DataSourceV2

2019-02-27 Thread Ryan Blue
I think that's a good plan. Let's get the functionality done, but mark it experimental pending a new row API. So is there agreement on this set of work, then? On Tue, Feb 26, 2019 at 6:30 PM Matei Zaharia wrote: > To add to this, we can add a stable interface anytime if the original one > was m

Spark-History ACLS

2019-02-27 Thread G, Ajay (Nokia - IN/Bangalore)
Hello, I was trying spark-history acl security on spark-2.4. I have written a authentication filter which handles user authentication. This is the spark-config I have used. spark.ui.filters com.ag.spark.AuthenticationFilter spark.acls.enable true spark.history.ui.acls.enable true spark.history