Re: [ANNOUNCE] Apache Spark 3.5.3 released

2024-09-24 Thread Yang Zhang
Hi, I find download page does not contain 3.5.3 link, but release notes link exists. 3.5.3 release notes contains some commits that does not exists in tag/v3.5.3, e.g `[SPARK-49628]` exists in branch-3.5 but not in tag/v3.5.3, would you help explain more about that? Thank you On 2024/09/25 0

Can Spark avoid Container killed by Yarn?

2018-11-09 Thread Yang Zhang
I'm always suffering Spark SQL job fails with error "Container exited with a non-zero exit code 143". I know that it was casused by the memory used execeeds the limits of spark.yarn.executor.memoryOverhead. As shown below, memory allocation request was failed at 18/11/08 17:36:05, then it RECEIVED