Clarification on the commit protocol

2020-02-26 Thread rahul c
Hi team, Just wanted to understand. Is DBIO commit protocol available in open source spark version ?

Re: 'spark-master-docs' job missing in Jenkins

2020-02-26 Thread shane knapp ☠
+1 On Wed, Feb 26, 2020 at 3:14 PM Hyukjin Kwon wrote: > Sounds good to me! > > On Thu, 27 Feb 2020, 02:36 Dongjoon Hyun, wrote: > >> Instead of adding another Jenkins job, adding GitHub Action job will be a >> better solution because we can share the long-term workload of maintenance. >> >> I'

Re: 'spark-master-docs' job missing in Jenkins

2020-02-26 Thread Hyukjin Kwon
Sounds good to me! On Thu, 27 Feb 2020, 02:36 Dongjoon Hyun, wrote: > Instead of adding another Jenkins job, adding GitHub Action job will be a > better solution because we can share the long-term workload of maintenance. > > I'll make a PR for that. > > Bests, > Dongjoon. > > > On Tue, Feb 25,

Re: [Proposal] Modification to Spark's Semantic Versioning Policy

2020-02-26 Thread Jules Damji
+1 Well said! Sent from my iPhone Pardon the dumb thumb typos :) > On Feb 24, 2020, at 3:03 PM, Michael Armbrust wrote: > >  > Hello Everyone, > > As more users have started upgrading to Spark 3.0 preview (including myself), > there have been many discussions around APIs that have been br

Re: [Proposal] Modification to Spark's Semantic Versioning Policy

2020-02-26 Thread Michel Miotto Barbosa
+1 *_* *Michel Miotto Barbosa*, *Data Science/Software Engineer* Learn MBA Global Financial Broker at IBMEC SP, Learn Economic Science at PUC SP MBA in Project Management, Graduate i n S oftware E ngineering phone: +55 11 984 342 347, @

Re: 'spark-master-docs' job missing in Jenkins

2020-02-26 Thread Dongjoon Hyun
Instead of adding another Jenkins job, adding GitHub Action job will be a better solution because we can share the long-term workload of maintenance. I'll make a PR for that. Bests, Dongjoon. On Tue, Feb 25, 2020 at 9:10 PM Hyukjin Kwon wrote: > Hm, we should still run this I believe. PR buil

Re: [Proposal] Modification to Spark's Semantic Versioning Policy

2020-02-26 Thread John Zhuge
Well written, Michael! Believe it or not, I read through the entire email, very rare for emails of such length. Happy to see healthy discussions on this tough subject. Definitely need perspectives form both the users and the contributors. On Tue, Feb 25, 2020 at 9:09 PM Xiao Li wrote: > +1 > >

[SPARK-30957][SQL] Null-safe variant of Dataset.join(Dataset[_], Seq[String])

2020-02-26 Thread Enrico Minack
I have created a jira to track this request: https://issues.apache.org/jira/browse/SPARK-30957 Enrico Am 08.02.20 um 16:56 schrieb Enrico Minack: Hi Devs, I am forwarding this from the user mailing list. I agree that the <=> version of join(Dataset[_], Seq[String]) would be useful. Does a