Re: Unable to resolve dependency of sbt-mima-plugin since yesterday

2019-10-22 Thread Xiao Li
Thank you, Dongjoon! Xiao On Tue, Oct 22, 2019 at 5:08 PM Dongjoon Hyun wrote: > Hi, All. > > This is fixed in master/branch-2.4. > > Bests, > Dongjoon. > > On Tue, Oct 22, 2019 at 12:19 Sean Owen wrote: > >> Weird. Let's discuss at https://issues.apache.org/jira/browse/SPARK-29560 >> >> On Tu

Re: Unable to resolve dependency of sbt-mima-plugin since yesterday

2019-10-22 Thread Dongjoon Hyun
Hi, All. This is fixed in master/branch-2.4. Bests, Dongjoon. On Tue, Oct 22, 2019 at 12:19 Sean Owen wrote: > Weird. Let's discuss at https://issues.apache.org/jira/browse/SPARK-29560 > > On Tue, Oct 22, 2019 at 2:06 PM Xingbo Jiang > wrote: > > > > Hi, > > > > Do you have any idea why the `

Question about in subquery

2019-10-22 Thread zhangliyun
Hi all: i used in subquery like following in spark 2.3.1 {code} set spark.sql.autoBroadcastJoinThreshold=-1; explain select * from testdata where key1 not in (select key1 from testdata as b); = Physical Plan == BroadcastNestedLoopJoin BuildRight, LeftAnti, ((key1#60 = key1#62) || isnu

[DISCUSS] commit to ExpressionEncoder?

2019-10-22 Thread Erik Erlandson
Currently the design of Encoder implies the possibility that encoders might be customized, or at least that there are other internal alternatives to ExpressionEncoder. However there are both implicit and explicit restrictions in spark-sql, such that ExpressionEncoder is the only functional option,

Re: Unable to resolve dependency of sbt-mima-plugin since yesterday

2019-10-22 Thread Sean Owen
Weird. Let's discuss at https://issues.apache.org/jira/browse/SPARK-29560 On Tue, Oct 22, 2019 at 2:06 PM Xingbo Jiang wrote: > > Hi, > > Do you have any idea why the `./dev/lint-scala` check are failure with the > following message since yesterday ? > >> WARNING: An illegal reflective access op

Unable to resolve dependency of sbt-mima-plugin since yesterday

2019-10-22 Thread Xingbo Jiang
Hi, Do you have any idea why the `./dev/lint-scala` check are failure with the following message since yesterday ? WARNING: An illegal reflective access operation has occurred > 9 > WARNING: > Illegal reflective ac

Re: [PMCs] Any project news or announcements this week?

2019-10-22 Thread Sally Khudairi
Thank you, Xingbo! I'll add you to the list 😀 - - - Vice President Marketing & Publicity Vice President Sponsor Relations The Apache Software Foundation Tel +1 617 921 8656 | s...@apache.org On Tue, Oct 22, 2019, at 03:49, Xingbo Jiang wrote: > I'm working with Wenchen to make a release candida

Re: [PMCs] Any project news or announcements this week?

2019-10-22 Thread Xingbo Jiang
I'm working with Wenchen to make a release candidate, but haven't been successful with our release script. I think we shall be able to make a Spark 3.0 preview release this week, though. cc @Sally Cheers, Xingbo Sean Owen 于2019年10月20日周日 下午11:04写道: > I wonder if we are likely to have a Spark 3