What may seem like 1 hr of work is actually quite complicated. I am sure Manu dedicated a lot of time in setting the new module and validating all failed tests, not to mention fixes that were made after testing Spark RCs.
Anyway, a new Spark release is always a rare opportunity to deprecate/improve something fundamentally. In Spark 4.1, one of these things is the new version framework in DSv2 that requires us to rethink a large chunk of the connector. We shouldn't rush this. We will see pre-requisite PRs this week. Help with reviews is always appreciated. сб, 17 січ. 2026 р. о 01:02 Romain Manni-Bucau <[email protected]> пише: > Hi JB, > > As said it is 100% an user standpoint and since enbling it is literally 1h > I think it is worth if next week is missed but still happy to avoir. > > > Romain Manni-Bucau > @rmannibucau <https://x.com/rmannibucau> | .NET Blog > <https://dotnetbirdie.github.io/> | Blog <https://rmannibucau.github.io/> | > Old Blog <http://rmannibucau.wordpress.com> | Github > <https://github.com/rmannibucau> | LinkedIn > <https://www.linkedin.com/in/rmannibucau> | Book > <https://www.packtpub.com/en-us/product/java-ee-8-high-performance-9781788473064> > Javaccino founder (Java/.NET service - contact via linkedin) > > Le sam. 17 janv. 2026, 06:21, Jean-Baptiste Onofré <[email protected]> a > écrit : > >> Hi Romain >> >> I'm not in favor of 1.10.2 with Spark 4.1 support. >> >> As I think we are pretty close to having the cleanup/enhancement done on >> main, by chance, it will be included in 1.11.0, so worth to wait for it. >> >> Regards >> JB >> >> On Fri, Jan 16, 2026 at 10:06 PM Romain Manni-Bucau < >> [email protected]> wrote: >> >>> @Steven sure, my point was just that delaying Spark 4.1 support to get >>> new feature can not be the best so branch latest 1.10 tag and just fixing >>> the 2-3 compilation issues to get a 1.10.2 and Spark 4.1 working can be an >>> intermediate step. >>> >>> let's see next week what Anton comes back with :) >>> >>> Romain Manni-Bucau >>> @rmannibucau <https://x.com/rmannibucau> | .NET Blog >>> <https://dotnetbirdie.github.io/> | Blog >>> <https://rmannibucau.github.io/> | Old Blog >>> <http://rmannibucau.wordpress.com> | Github >>> <https://github.com/rmannibucau> | LinkedIn >>> <https://www.linkedin.com/in/rmannibucau> | Book >>> <https://www.packtpub.com/en-us/product/java-ee-8-high-performance-9781788473064> >>> Javaccino founder (Java/.NET service - contact via linkedin) >>> >>> >>> Le ven. 16 janv. 2026 à 20:28, Steven Wu <[email protected]> a >>> écrit : >>> >>>> Romain, patch releases (like 1.10.2) are only for bug fixes. New >>>> features (like Spark 4.1) would have to happen in minor version releases >>>> (like 1.11.0) >>>> >>>> On Mon, Jan 12, 2026 at 9:22 AM Romain Manni-Bucau < >>>> [email protected]> wrote: >>>> >>>>> Ok, good news Anton, if it is longer than expected (hoping not) maybe >>>>> a 1.10.2 with the new module be a compromise, impatient to get your >>>>> feedback next week. >>>>> >>>>> Thanks for the hard work. >>>>> >>>>> Romain Manni-Bucau >>>>> @rmannibucau <https://x.com/rmannibucau> | .NET Blog >>>>> <https://dotnetbirdie.github.io/> | Blog >>>>> <https://rmannibucau.github.io/> | Old Blog >>>>> <http://rmannibucau.wordpress.com> | Github >>>>> <https://github.com/rmannibucau> | LinkedIn >>>>> <https://www.linkedin.com/in/rmannibucau> | Book >>>>> <https://www.packtpub.com/en-us/product/java-ee-8-high-performance-9781788473064> >>>>> Javaccino founder (Java/.NET service - contact via linkedin) >>>>> >>>>> >>>>> Le lun. 12 janv. 2026 à 17:54, Anton Okolnychyi <[email protected]> >>>>> a écrit : >>>>> >>>>>> We already have a module for Spark 4.1 in main. That said, Spark 4.1 >>>>>> has introduced substantial improvements in table lifecycle that should >>>>>> let >>>>>> us remove some legacy hacks that may cause data correctness issues. Given >>>>>> that this work may result in some properties being no longer supported, >>>>>> we >>>>>> can do that only in the first Iceberg release for Spark 4.1. I would >>>>>> strongly oppose releasing support for Spark 4.1 prior to embracing the >>>>>> new >>>>>> version framework in DSv2. >>>>>> >>>>>> Good news, it still shouldn't take too long. I am working on a >>>>>> prototype as we speak. It should be available next week. >>>>>> >>>>>> - Anton >>>>>> >>>>>> >>>>>> >>>>>> пн, 12 січ. 2026 р. о 07:33 Romain Manni-Bucau <[email protected]> >>>>>> пише: >>>>>> >>>>>>> Hi everyone, >>>>>>> >>>>>>> I wonder if you do have some plan to release Iceberg 1.11 (I assume >>>>>>> next one?) with Spark 4.1 support. >>>>>>> The datasource v2 API breakage was very localized but is just >>>>>>> blocking to upgrade and some spark 4.1 features are game changers (like >>>>>>> the >>>>>>> SQL enhancement) so I'm really looking forward being able to move on it >>>>>>> with iceberg support. >>>>>>> If you need some help please let me know. >>>>>>> >>>>>>> Romain Manni-Bucau >>>>>>> @rmannibucau <https://x.com/rmannibucau> | .NET Blog >>>>>>> <https://dotnetbirdie.github.io/> | Blog >>>>>>> <https://rmannibucau.github.io/> | Old Blog >>>>>>> <http://rmannibucau.wordpress.com> | Github >>>>>>> <https://github.com/rmannibucau> | LinkedIn >>>>>>> <https://www.linkedin.com/in/rmannibucau> | Book >>>>>>> <https://www.packtpub.com/en-us/product/java-ee-8-high-performance-9781788473064> >>>>>>> Javaccino founder (Java/.NET service - contact via linkedin) >>>>>>> >>>>>>
