Re: Initial Decom PR for Spark 3?

2020-06-22 Thread Hyukjin Kwon
See https://spark.apache.org/improvement-proposals.html On Tue, 23 Jun 2020, 07:01 Stephen Boesch, wrote: > I guess I missed that "community decision" where the existing design > document that had been reviewed was put aside and a new SPIP document was > required. > > On Sun, 21 Jun 2020 at 19:

Re: Initial Decom PR for Spark 3?

2020-06-22 Thread Stephen Boesch
I guess I missed that "community decision" where the existing design document that had been reviewed was put aside and a new SPIP document was required. On Sun, 21 Jun 2020 at 19:05, Hyukjin Kwon wrote: > Yeah, I believe the community decided to do a SPIP for such significant > changes. It woul

CVE-2020-9480: Apache Spark RCE vulnerability in auth-enabled standalone master

2020-06-22 Thread Sean Owen
Severity: Important Vendor: The Apache Software Foundation Versions Affected: Apache Spark 2.4.5 and earlier Description: In Apache Spark 2.4.5 and earlier, a standalone resource manager's master may be configured to require authentication (spark.authenticate) via a shared secret. When enabled,

[Spark Core] Merging PR #23340 for New Executor Memory Metrics

2020-06-22 Thread Alex Scammon
Hi there devs, Congrats on Spark 3.0.0, that's great to see. I'm hoping to get some eyes on something old, however: * https://github.com/apache/spark/pull/23340 I'm really just trying to get some eyes on this PR and see if we can still move it forward. I reached out to the reviewers of th