For follow up while I've backported this in some internal releases I'm not considering a candidate for backporting to Spark 3 anymore. I should have updated the thread with that. The design doc is linked in the PR.
On Thu, Jun 18, 2020 at 6:05 PM Hyukjin Kwon <gurwls...@gmail.com> wrote: > Looks it had to be with SPIP and a proper design doc to discuss. > > 2020년 2월 9일 (일) 오전 1:23, Erik Erlandson <eerla...@redhat.com>님이 작성: > >> I'd be willing to pull this in, unless others have concerns post >> branch-cut. >> >> On Tue, Feb 4, 2020 at 2:51 PM Holden Karau <hol...@pigscanfly.ca> wrote: >> >>> Hi Y’all, >>> >>> I’ve got a K8s graceful decom PR ( >>> https://github.com/apache/spark/pull/26440 >>> ) I’d love to try and get in for Spark 3, but I don’t want to push on >>> it if folks don’t think it’s worth it. I’ve been working on it since 2017 >>> and it was really close in November but then I had the crash and had to >>> step back for awhile. >>> >>> It’s effectiveness is behind a feature flag and it’s been outstanding >>> for awhile so those points are in its favour. It does however change things >>> in core which is not great. >>> >>> Cheers, >>> >>> Holden >>> -- >>> Twitter: https://twitter.com/holdenkarau >>> Books (Learning Spark, High Performance Spark, etc.): >>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>> >> -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
