[SPARK SQL] Make max multi table join limit configurable in OptimizeSkewedJoin

2020-09-12 Thread Alfie Davidson
Hi All, First time contributing, so reaching out by email before creating a JIRA ticket and PR. I would like to propose a small change/enhancement to OptimizeSkewedJoin. Currently, OptimizeSkewedJoin has a hardcoded limit for multi table joins (limit = 2). For processes that have multiple join

Re: [VOTE][RESULT] Release Spark 2.4.7 (RC3)

2020-09-12 Thread Prashant Sharma
You are welcome, Dongjoon - just did my part. Thanks to everyone who contributed in various ways. Thanks, On Sat, Sep 12, 2020 at 9:29 AM Dongjoon Hyun wrote: > Thank you, Prashant! > > Bests, > Dongjoon. > > On Fri, Sep 11, 2020 at 7:02 PM Prashant Sharma > wrote: > >> The vote passes. Thanks

[ANNOUNCE] Announcing Apache Spark 2.4.7

2020-09-12 Thread Prashant Sharma
Hello Folks, We are happy to announce the availability of Spark 2.4.7! Spark 2.4.7 is a maintenance release containing stability fixes. This release is based on the branch-2.4 maintenance branch of Spark. We strongly recommend all 2.4 users to upgrade to this stable release. To download Spark 2.4