+1 On Mon, Sep 21, 2026 at 5:48 PM Hyukjin Kwon <[email protected]> wrote:
> +1 > > On Tue, 22 Sept 2026 at 08:57, Szehon Ho <[email protected]> wrote: > >> Hi all, >> >> I'd like to start a discussion about releasing Apache Spark 4.2.1. >> >> I'm particularly interested in getting SPARK-59572 >> <https://issues.apache.org/jira/browse/SPARK-59572> into 4.2.1. It fixes >> a correctness issue introduced in 4.2.0 where failures to evaluate a DSv2 >> PartitionPredicate can be treated as matches, leading to incorrect query >> results. >> >> It's been over two months since Spark 4.2.0 was released in July. The changes >> on branch-4.2 since 4.2.0 >> <https://github.com/apache/spark/compare/v4.2.0...branch-4.2> now >> include 99 PRs covering 97 JIRA issues. Besides SPARK-59572, these include >> correctness and stability fixes across SQL, Core, Streaming, PySpark, and >> Kubernetes, with several addressing storage-partitioned joins. >> >> I'm happy to volunteer to drive the release to learn the process! >> >> Would folks be in favor of moving forward with a 4.2.1 release? Are there >> any other fixes or blockers we should address first? >> >> Thanks, >> Szehon >> >
