Hi,

Yeah, as we will have 3 preview releases out before the first RC, hopefully
the RC period won't take that long.

Best,
Peter

On Tue, Sep 9, 2025 at 7:35 AM Dongjoon Hyun <[email protected]> wrote:

> Hi, Xiao.
>
> Apache Spark project has a world-wide community which is working on
> November and the community already decided to put more efforts via the
> monthly releases. Let me rephrase the community schedule.
>
> Apache Spark 4.1.0-preview1 (2025-09-02)
> Apache Spark 4.1.0-preview2 (2025-10-02)
> Apache Spark 4.1.0-preview3 (2025-11-02)
> Apache Spark 4.1.0 Feature Freeze (2025-11-02)
> Apache Spark 4.1.0 RC1 (2025-11-23)
>
> I'm sure that we have a sufficient plan to handle Spark 4.1.0 for
> November. So, please don't worry.
>
> Dongjoon.
>
> On 2025/09/09 05:23:21 Xiao Li wrote:
> > I have the same concerns as Holden regarding the release timeline. Would
> it
> > make sense to shift our RC to January?
> >
> > Just to clarify, this isn’t an issue with the release manager. The
> > challenge is more about the level of community involvement during the RC
> > stage, and we’ll need stronger engagement from the community to properly
> > test it in different environment and production for higher quality.
> >
> > On Mon, Sep 8, 2025 at 11:32 AM Dongjoon Hyun <[email protected]>
> > wrote:
> >
> > > Thank you, Holden. Yes, it's true and I agree with all your comments.
> > >
> > > At this time, we are in a much better situation because we have Apache
> > > Spark 4.1.0-preview1 already.
> > >
> > > In addition, I expect Apache Spark 4.1.0-preview2 in October. So, the
> > > 4.1.0 release will be smoother than ever.
> > >
> > > I will volunteer as the release manager of Apache Spark 4.1.0 to
> finish it
> > > on time.
> > >
> > > Dongjoon.
> > >
> > >
> > > On Mon, Sep 8, 2025 at 11:25 AM Holden Karau <[email protected]>
> > > wrote:
> > >
> > >> I like that, I think it’s a little tight but if we scope down it
> should
> > >> be fine. Our history of trying to do releases in December is not
> great so
> > >> getting the first RC out the door before then makes sense to me.
> > >>
> > >> Twitter: https://twitter.com/holdenkarau
> > >> Fight Health Insurance: https://www.fighthealthinsurance.com/
> > >> <https://www.fighthealthinsurance.com/?q=hk_email>
> > >> Books (Learning Spark, High Performance Spark, etc.):
> > >> https://amzn.to/2MaRAG9  <https://amzn.to/2MaRAG9>
> > >> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
> > >> Pronouns: she/her
> > >>
> > >>
> > >> On Mon, Sep 8, 2025 at 11:21 AM Dongjoon Hyun <
> [email protected]>
> > >> wrote:
> > >>
> > >>> Hi, All.
> > >>>
> > >>> As of now, the Apache Spark Versioning Policy page is a little
> outdated
> > >>> because it still shows only the delivered Spark 4.0.0 release window.
> > >>>
> > >>> https://spark.apache.org/versioning-policy.html
> > >>>
> > >>> Since Apache Spark 4.0.0 was announced on May 23rd, I believe we can
> > >>> release 4.1.0 after 6 months from that, which means November 23,
> 2025.
> > >>>
> > >>> So, I'd like to propose to update the Apache Spark Versioning Policy
> > >>> page to show 4.1.0 release windows like the following PR.
> > >>>
> > >>> https://github.com/apache/spark-website/pull/627
> > >>>
> > >>> 2025-11-01 Code Freeze. Release branch cut.
> > >>> 2025-11-15 QA Period.
> > >>> 2025-11-23 Release candidates (RC)
> > >>>
> > >>> For Apache Spark 4.1.0 progress, you can refer to the umbrella JIRA
> > >>> issue and its subtasks. In addition, you can add your on-going JIRA
> issues
> > >>> there too.
> > >>>
> > >>> https://issues.apache.org/jira/browse/SPARK-51166
> > >>> (SPARK-51166 Prepare Apache Spark 4.1.0)
> > >>>
> > >>> WDYT?
> > >>>
> > >>> Thanks,
> > >>> Dongjoon.
> > >>>
> > >>
> >
> > --
> >
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: [email protected]
>
>

Reply via email to