graceful shutdown for slave host for Spark Standalone Cluster

Hi, We use ec2 to run batch spark jobs to filter and process our data and sometimes we need to replace the host or deploy a new fleet. Since we run the driver in cluster mode and if the host goes down it will be detrimental. We also use some native code to make sure our table is modified by only

Re: Getting the ball started on a 2.4.6 release

Yes. This one got merged yesterday. Thanks! Xiao On Mon, Apr 20, 2020 at 10:51 AM Sean Owen wrote: > Looks like we have 1 marked for 2.4.6: > https://issues.apache.org/jira/projects/SPARK/versions/12346781 > > https://issues.apache.org/jira/browse/SPARK-31234 ResetCommand should > not wipe out

Re: Getting the ball started on a 2.4.6 release

Looks like we have 1 marked for 2.4.6: https://issues.apache.org/jira/projects/SPARK/versions/12346781 https://issues.apache.org/jira/browse/SPARK-31234 ResetCommand should not wipe out all configs Xiao might be able to comment on that one. On Mon, Apr 20, 2020 at 11:31 AM Holden Karau wrote: >

Getting the ball started on a 2.4.6 release

Hi folks, I’m going to get started on putting together a 2.4.6 release to come out hopefully around the same time as 3.0. Are there any changes in master folks think we should be considering backporting to a 2.4.6 release? Cheers, Holden :) -- Twitter: https://twitter.com/holdenkarau Books (Lea