Following up on Manu's question, why not just remove Spark 3.4 for the next 1.11 release? Or do we usually wait for one more release and remove it in the 1.12 release after marking 3.4 as deprecated in the engine status doc page?
On Fri, Sep 19, 2025 at 9:12 AM Kevin Liu <kevinjq...@apache.org> wrote: > > Given the many +1's here, I've moved the PR to deprecate 3.4 to "ready for > review", https://github.com/apache/iceberg/pull/14099 > > > Does it mean we will stop back-porting PRs to Spark 3.4 for 1.11? > > Not necessarily. There's a lot of Spark 3.4 backports already, > https://github.com/apache/iceberg/commits/main/spark/v3.4 > I suggest we continue to backport for consistency and then stop right > after the 1.11 release. > > Best, > Kevin Liu > > On Fri, Sep 19, 2025 at 6:18 AM Amogh Jahagirdar <2am...@gmail.com> wrote: > >> +1 >> >> On Fri, Sep 19, 2025 at 2:03 AM Péter Váry <peter.vary.apa...@gmail.com> >> wrote: >> >>> +1 >>> >>> Eduard Tudenhöfner <etudenhoef...@apache.org> ezt írta (időpont: 2025. >>> szept. 19., P, 8:56): >>> >>>> +1 on deprecating Spark 3.4 >>>> >>>> On Thu, Sep 18, 2025 at 8:36 AM Steve <hongyue.apa...@gmail.com> wrote: >>>> >>>>> +1 >>>>> >>>>> On Wed, Sep 17, 2025 at 22:52 Jean-Baptiste Onofré <j...@nanthrax.net> >>>>> wrote: >>>>> >>>>>> +1 >>>>>> >>>>>> I agree about the plan to "announce" the deprecation in 1.11 and >>>>>> remove 1.12, it gives time for users to "adapt". >>>>>> >>>>>> Regards >>>>>> JB >>>>>> >>>>>> On Wed, Sep 17, 2025 at 10:31 PM Kevin Liu <kevinjq...@apache.org> >>>>>> wrote: >>>>>> > >>>>>> > Hi everyone, >>>>>> > >>>>>> > I’d like to bring up the topic of deprecating Spark 3.4 in an >>>>>> upcoming release. Anton initially suggested this during our previous dev >>>>>> list discussion about maintaining feature parity across the Spark >>>>>> versions >>>>>> we support for 1.10. >>>>>> > >>>>>> > Currently, we support two different Spark 3.x versions, 3.4 and >>>>>> 3.5. Spark 3.4’s last maintenance release was in October 2024, and it is >>>>>> now considered end-of-life. >>>>>> > >>>>>> > What are your thoughts on marking Spark 3.4 as deprecated in 1.11 >>>>>> and removing it in 1.12? >>>>>> > >>>>>> > For reference, here's the previous discussion thread on deprecating >>>>>> Spark 3.3. >>>>>> > >>>>>> > Best, >>>>>> > >>>>>> > Kevin Liu >>>>>> >>>>>
