Re: [ANNOUNCE] Announcing Apache Spark 2.4.5

Happy to hear the release news! Bests, Takeshi On Sun, Feb 9, 2020 at 10:28 AM Dongjoon Hyun wrote: > There was a typo in one URL. The correct release note URL is here. > > https://spark.apache.org/releases/spark-release-2-4-5.html > > > > On Sat, Feb 8, 2020 at 5:22 PM Dongjoon Hyun > wrote:

Re: [ANNOUNCE] Announcing Apache Spark 2.4.5

There was a typo in one URL. The correct release note URL is here. https://spark.apache.org/releases/spark-release-2-4-5.html On Sat, Feb 8, 2020 at 5:22 PM Dongjoon Hyun wrote: > We are happy to announce the availability of Spark 2.4.5! > > Spark 2.4.5 is a maintenance release containing sta

[ANNOUNCE] Announcing Apache Spark 2.4.5

We are happy to announce the availability of Spark 2.4.5! Spark 2.4.5 is a maintenance release containing stability fixes. This release is based on the branch-2.4 maintenance branch of Spark. We strongly recommend all 2.4 users to upgrade to this stable release. To download Spark 2.4.5, head over

Re: Initial Decom PR for Spark 3?

I'd be willing to pull this in, unless others have concerns post branch-cut. On Tue, Feb 4, 2020 at 2:51 PM Holden Karau wrote: > Hi Y’all, > > I’ve got a K8s graceful decom PR ( > https://github.com/apache/spark/pull/26440 > ) I’d love to try and get in for Spark 3, but I don’t want to push on

Re: Incorrect param in Doc ref url:https://spark.apache.org/docs/latest/ml-datasource

Thanks Sean. I have just opened a pull request: Branch 2.4 #27500. On Sat, 8 Feb 2020, 8:54 pm Sean Owen, wrote: > To be clear, you're referring to the Python version of the example. > Yes it should be True. > Can you open a pull request to fix it? the docs are under docs/ in the > apache/spar

Fwd: dataframe null safe joins given a list of columns

Hi Devs, I am forwarding this from the user mailing list. I agree that the <=> version of join(Dataset[_], Seq[String]) would be useful. Does any PMC consider this useful enough to be added to the Dataset API? I'd be happy to create a PR in that case. Enrico Weitergeleitete Nach

Re: Incorrect param in Doc ref url:https://spark.apache.org/docs/latest/ml-datasource

To be clear, you're referring to the Python version of the example. Yes it should be True. Can you open a pull request to fix it? the docs are under docs/ in the apache/spark github repo. That's how we normally take fixes. On Sat, Feb 8, 2020 at 9:14 AM Tanay Banerjee wrote: > > >> Hi Team, >> >>

Re: Incorrect param in Doc ref url:https://spark.apache.org/docs/latest/ml-datasource

> Hi Team, > > I have found out below incorrect code which will lead to error "NameError: > name 'true' is not defined". As true is the the parameter required but > 'True' > > All the details are provided below. > > URL: https://spark.apache.org/docs/latest/ml-datasource > > Issue: > > true -> TRUE