Hi folks, I'm happy to share that we fixed the gradle-revapi with Gradle 8.2+ and we did a fork and a new release. It means that we will be able to upgrade to Gradle 8.8 for iceberg-java 1.6.0 release (see https://github.com/apache/iceberg/pull/8486). After this merge, we will be able to merge Parquet 1.14.0 upgrade (https://github.com/apache/iceberg/pull/10209).
We also need review/merge on the following PRs: - I reviewed the Kafka connect commits coordinator PR and it looks good to me: https://github.com/apache/iceberg/pull/10351 - I reviewed Flink 1.19 run without Hadoop PR (https://github.com/apache/iceberg/pull/10209) I will be able to start the release process when all of these PRs will be merged. Thanks ! Regards JB On Thu, Jun 13, 2024 at 8:59 PM Jean-Baptiste Onofré <j...@nanthrax.net> wrote: > > Hi Alex > > Sure no problem. We can flag the PR to 1.6.0 release. > > Regards > JB > > Le jeu. 13 juin 2024 à 17:14, Alex Dutra <alex.du...@dremio.com.invalid> a > écrit : >> >> Hi JB, >> >> Thank you for putting up the 1.6 release proposal. >> >> I also would like to bump the Nessie version to its next release, which is >> due today and should be available in a few hours from now. My understanding >> is that the Renovate bot would immediately pick up the new version and >> automatically create a PR for it, but it doesn't hurt to mention it here so >> that it does not go under our radar. There is no breaking change in this >> release, FYI. >> >> Regards, >> >> Alex >> >> On Wed, Jun 12, 2024 at 4:33 PM Jean-Baptiste Onofré <j...@nanthrax.net> >> wrote: >>> >>> Hi Fokko >>> >>> Thanks for the feedback. >>> >>> About Avro, I'm updating my PR about trusted packages, it "has to be" >>> included in the next Avro releases. Let me send a message on Avro >>> mailing list. >>> >>> Good point about Flink, let me see if Peter can help there. >>> >>> Regards >>> JB >>> >>> On Wed, Jun 12, 2024 at 3:44 PM Fokko Driesprong <fo...@apache.org> wrote: >>> > >>> > Hi JB, thanks for raising this. >>> > >>> >> - With the Gradle version update, we will be able to upgrade to Parquet >>> >> 1.14.0 >>> > >>> > We might want to defer this until Parquet 1.14.1 gets released. There is >>> > an issue found with Jackson that prohibits Spark from upgrading to >>> > 1.14.0. It might be that this is also the case with other query engines. >>> > Gang already started a DISCUSS thread on running the minor release. >>> > >>> >> - Depending of the timing, I will include new Avro releases >>> > >>> > I would love that! With the release it allows us to use the >>> > BlockingDirectBinaryEncoder, which will allow efficient skipping of lists >>> > and maps in the file. This will speed up operations like expire snapshots >>> > quite a bit because we can jump easily over all the statistics. >>> > >>> > It would be great if there were some Flink reviewers to get some eyes on >>> > this PR to run Flink without Hadoop. We have to change some APIs and with >>> > the introduction of Flink 1.19 in Iceberg 1.16.0 this is a great moment. >>> > >>> > Kind regards, >>> > Fokko >>> > >>> > Op ma 10 jun 2024 om 00:24 schreef Jean-Baptiste Onofré >>> > <j...@nanthrax.net>: >>> >> >>> >> Hi folks, >>> >> >>> >> As discussed during the last community meeting, we are heading to the >>> >> Apache Iceberg 1.6.0 release. >>> >> >>> >> The Iceberg 1.6.0 milestone is present for both GitHub Issues and PRs. >>> >> >>> >> I'm targeting major updates for this release: >>> >> - the Kafka commit coordinator (PR is in review) >>> >> - Revapi "fix" to be able to upgrade to latest Gradle version (I have >>> >> one PR ready and I have another exploring a new option) >>> >> - With the Gradle version update, we will be able to upgrade to Parquet >>> >> 1.14.0 >>> >> - Depending of the timing, I will include new Avro releases >>> >> >>> >> Please, if you have anything you want to include in the 1.6.0 release, >>> >> please let me know and create an issue on GitHub with the "Iceberg >>> >> 1.6.0" milestone. >>> >> >>> >> Thanks ! >>> >> >>> >> Regards >>> >> JB
