Re: [Spark-Core] Improving Reliability of spark when Executors OOM

Hi, what about supporting for solving the disk space problem of "device space isn't enough"? I think it's same as OOM exception. kalyan 于2024年1月27日周六 13:00写道： > Hi all, > > Sorry for the delay in getting the first draft of (my first) SPIP out. > > https://docs.google.com/document/d/1hxEPUirf3eYw

Re: A proposal for creating a Knowledge Sharing Hub for Apache Spark Community

+1. It sounds awesome! Kiran Kumar Dusi 于2024年3月21日周四 14:16写道： > +1 > > On Thu, 21 Mar 2024 at 7:46 AM, Farshid Ashouri < > farsheed.asho...@gmail.com> wrote: > >> +1 >> >> On Mon, 18 Mar 2024, 11:00 Mich Talebzadeh, >> wrote: >> >>> Some of you may be aware that Databricks community Home | Dat

Request Review for [SPARK-46992]Fix cache consistency

Hi community, I've fixed the issue about consistency of cache: SPARK-46992 long time ago. I'll appreciate if someone could help review this pr! -- Best, Jay

[Question] Why driver doesn't shutdown executors gracefully on k8s?

Hi spark community, I have such a question: Why driver doesn't shutdown executors gracefully on k8s. For instance, kubernetesClient.pods().withGracePeriod(100).delete(). -- Best, Jay

Re: [Question] Why driver doesn't shutdown executors gracefully on k8s?

sion.enabled. And the question was even >>>>>> "k8s" >>>>>> and none of the information for the vendor was mentioned from the >>>>>> question. >>>>>> I don't even think these configs are on the internet - simply sayi