We already have a module for Spark 4.1 in main. That said, Spark 4.1 has
introduced substantial improvements in table lifecycle that should let us
remove some legacy hacks that may cause data correctness issues. Given that
this work may result in some properties being no longer supported, we can
do that only in the first Iceberg release for Spark 4.1. I would strongly
oppose releasing support for Spark 4.1 prior to embracing the new version
framework in DSv2.

Good news, it still shouldn't take too long. I am working on a prototype as
we speak. It should be available next week.

- Anton



пн, 12 січ. 2026 р. о 07:33 Romain Manni-Bucau <[email protected]> пише:

> Hi everyone,
>
> I wonder if you do have some plan to release Iceberg 1.11 (I assume next
> one?) with Spark 4.1 support.
> The datasource v2 API breakage was very localized but is just blocking to
> upgrade and some spark 4.1 features are game changers (like the SQL
> enhancement) so I'm really looking forward being able to move on it with
> iceberg support.
> If you need some help please let me know.
>
> Romain Manni-Bucau
> @rmannibucau <https://x.com/rmannibucau> | .NET Blog
> <https://dotnetbirdie.github.io/> | Blog <https://rmannibucau.github.io/> |
> Old Blog <http://rmannibucau.wordpress.com> | Github
> <https://github.com/rmannibucau> | LinkedIn
> <https://www.linkedin.com/in/rmannibucau> | Book
> <https://www.packtpub.com/en-us/product/java-ee-8-high-performance-9781788473064>
> Javaccino founder (Java/.NET service - contact via linkedin)
>

Reply via email to