Thank you all. Apache Spark website is officially updated in order to share Apache Spark 4.1 release plan.
https://spark.apache.org/versioning-policy.html Dongjoon. On 2025/09/11 16:42:14 Peter Toth wrote: > Hi, > > Yeah, as we will have 3 preview releases out before the first RC, hopefully > the RC period won't take that long. > > Best, > Peter > > On Tue, Sep 9, 2025 at 7:35 AM Dongjoon Hyun <[email protected]> wrote: > > > Hi, Xiao. > > > > Apache Spark project has a world-wide community which is working on > > November and the community already decided to put more efforts via the > > monthly releases. Let me rephrase the community schedule. > > > > Apache Spark 4.1.0-preview1 (2025-09-02) > > Apache Spark 4.1.0-preview2 (2025-10-02) > > Apache Spark 4.1.0-preview3 (2025-11-02) > > Apache Spark 4.1.0 Feature Freeze (2025-11-02) > > Apache Spark 4.1.0 RC1 (2025-11-23) > > > > I'm sure that we have a sufficient plan to handle Spark 4.1.0 for > > November. So, please don't worry. > > > > Dongjoon. > > > > On 2025/09/09 05:23:21 Xiao Li wrote: > > > I have the same concerns as Holden regarding the release timeline. Would > > it > > > make sense to shift our RC to January? > > > > > > Just to clarify, this isn’t an issue with the release manager. The > > > challenge is more about the level of community involvement during the RC > > > stage, and we’ll need stronger engagement from the community to properly > > > test it in different environment and production for higher quality. > > > > > > On Mon, Sep 8, 2025 at 11:32 AM Dongjoon Hyun <[email protected]> > > > wrote: > > > > > > > Thank you, Holden. Yes, it's true and I agree with all your comments. > > > > > > > > At this time, we are in a much better situation because we have Apache > > > > Spark 4.1.0-preview1 already. > > > > > > > > In addition, I expect Apache Spark 4.1.0-preview2 in October. So, the > > > > 4.1.0 release will be smoother than ever. > > > > > > > > I will volunteer as the release manager of Apache Spark 4.1.0 to > > finish it > > > > on time. > > > > > > > > Dongjoon. > > > > > > > > > > > > On Mon, Sep 8, 2025 at 11:25 AM Holden Karau <[email protected]> > > > > wrote: > > > > > > > >> I like that, I think it’s a little tight but if we scope down it > > should > > > >> be fine. Our history of trying to do releases in December is not > > great so > > > >> getting the first RC out the door before then makes sense to me. > > > >> > > > >> Twitter: https://twitter.com/holdenkarau > > > >> Fight Health Insurance: https://www.fighthealthinsurance.com/ > > > >> <https://www.fighthealthinsurance.com/?q=hk_email> > > > >> Books (Learning Spark, High Performance Spark, etc.): > > > >> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> > > > >> YouTube Live Streams: https://www.youtube.com/user/holdenkarau > > > >> Pronouns: she/her > > > >> > > > >> > > > >> On Mon, Sep 8, 2025 at 11:21 AM Dongjoon Hyun < > > [email protected]> > > > >> wrote: > > > >> > > > >>> Hi, All. > > > >>> > > > >>> As of now, the Apache Spark Versioning Policy page is a little > > outdated > > > >>> because it still shows only the delivered Spark 4.0.0 release window. > > > >>> > > > >>> https://spark.apache.org/versioning-policy.html > > > >>> > > > >>> Since Apache Spark 4.0.0 was announced on May 23rd, I believe we can > > > >>> release 4.1.0 after 6 months from that, which means November 23, > > 2025. > > > >>> > > > >>> So, I'd like to propose to update the Apache Spark Versioning Policy > > > >>> page to show 4.1.0 release windows like the following PR. > > > >>> > > > >>> https://github.com/apache/spark-website/pull/627 > > > >>> > > > >>> 2025-11-01 Code Freeze. Release branch cut. > > > >>> 2025-11-15 QA Period. > > > >>> 2025-11-23 Release candidates (RC) > > > >>> > > > >>> For Apache Spark 4.1.0 progress, you can refer to the umbrella JIRA > > > >>> issue and its subtasks. In addition, you can add your on-going JIRA > > issues > > > >>> there too. > > > >>> > > > >>> https://issues.apache.org/jira/browse/SPARK-51166 > > > >>> (SPARK-51166 Prepare Apache Spark 4.1.0) > > > >>> > > > >>> WDYT? > > > >>> > > > >>> Thanks, > > > >>> Dongjoon. > > > >>> > > > >> > > > > > > -- > > > > > > > --------------------------------------------------------------------- > > To unsubscribe e-mail: [email protected] > > > > > --------------------------------------------------------------------- To unsubscribe e-mail: [email protected]
