Hi Colin, Thanks for the explanation. And I agree with Mickael that if there are such limitations, we should clearly document it. So far, in the v3.9 document <https://kafka.apache.org/39/documentation.html>, I can't see anything about it. Also, it seems metrics are still not added, we should document it, too.
Thanks. Luke On Fri, Oct 25, 2024 at 3:20 AM Mickael Maison <mickael.mai...@gmail.com> wrote: > Hi Colin, > > This is a major caveat. We've advertised KRaft as production ready and > anyone who has already migrated is now stuck with a static quorum. The > whole point of 3.9.0 was to reach "feature parity" with ZooKeeper, > this is now true for only a subset of users (users that have not > already migrated, or created new KRaft clusters). > > I think at this point 3.9.0 has to go through. At the very least we > should make sure it's clearly explained, I didn't see anything about > this limitation in our docs or release notes. > > Anyway, thanks for the new RC, I plan to test it tomorrow. > > Thanks, > Mickael > > > On Thu, Oct 24, 2024 at 7:49 PM Colin McCabe <cmcc...@apache.org> wrote: > > > > Hi Luke, > > > > Unfortunately, we don't have a way to upgrade from static quorums to > dynamic quorums yet. We are hoping to include this in the next release. > We're trakcing it under https://issues.apache.org/jira/browse/KAFKA-16538 > . > > > > best, > > Colin > > > > > > On Thu, Oct 24, 2024, at 05:25, Luke Chen wrote: > > > Hi Colin, > > > > > > I found I cannot upgrade to v3.9.0 and then successfully add a new > > > controller or remove a controller. I've opened KAFKA-17866 > > > <https://issues.apache.org/jira/browse/KAFKA-17866>. Please take a > look. > > > > > > Thanks. > > > Luke > > > > > > On Thu, Oct 24, 2024 at 2:27 PM TengYao Chi <kiting...@gmail.com> > wrote: > > > > > >> Hi Colin, > > >> > > >> Thanks for handling the release of the new RC. > > >> > > >> I built from source and ran all the unit and integration tests on each > > >> combination of different LTS JDK versions and distributions in Docker > (Zulu > > >> and Corretto). > > >> > > >> +1 (non-binding) > > >> > > >> Thanks, > > >> TengYao > > >> > > >> Justine Olshan <jols...@confluent.io.invalid> 於 2024年10月24日 週四 > 下午2:24寫道： > > >> > > >> > Hey Colin, > > >> > > > >> > Thanks for running the release. > > >> > > > >> > I checked the keys and scanned the docs > > >> > I built from source, used kraft quickstart, ran a transactions > workload, > > >> > played around with a few other things including running some of the > > >> feature > > >> > version commands. > > >> > > > >> > I noticed that some of the KIP-1022 work that was meant to make it > in > > >> this > > >> > release was removed. > > >> > Without any specifications, the cluster is meant to take the latest > > >> version > > >> > of all available features. The code to do that was removed. Perhaps > there > > >> > is a reason, but we should either change the KIP or remedy this. > > >> > Not only that, but the ability to configure a feature via the > --feature > > >> > flag in the storage tool also seems to be removed but the text > remains > > >> when > > >> > running with no arguments. I don't think it is a blocker, but this > should > > >> > be fixed for 4.0. > > >> > > > >> > I looked at two runs of the system tests and they looked fine to me. > > >> > > > >> > +1 (binding) from me, > > >> > > > >> > Justine > > >> > > > >> > On Tue, Oct 22, 2024 at 1:21 PM Bill Bejeck <bbej...@apache.org> > wrote: > > >> > > > >> > > Hi Colin, > > >> > > > > >> > > Thanks for running the release. > > >> > > > > >> > > I did the following verification steps: > > >> > > > > >> > > 1. Built from source > > >> > > 2. Validated all checksums > > >> > > 3. Ran all the unit tests > > >> > > 4. Pulled both docker images and started up Kafka > > >> > > 5. Ran the KRaft quick start > > >> > > 6. Ran the ZK quick start > > >> > > 7. Ran the Kafka Streams quick start > > >> > > 8. Spot checked the documentation > > >> > > 9. Spot checked the javadocs > > >> > > > > >> > > +1(binding) > > >> > > > > >> > > Thanks, > > >> > > Bill > > >> > > > > >> > > > > >> > > > > >> > > On Tue, Oct 22, 2024 at 9:08 AM Federico Valeri < > fedeval...@gmail.com> > > >> > > wrote: > > >> > > > > >> > > > Hi, I did the following tests: > > >> > > > > > >> > > > - Ran all unit and integration tests > > >> > > > - Spot checked the documentation > > >> > > > - Tried out new Maven dependencies > > >> > > > - Tested KIP-853, KIP-950, KIP-956 and KIP-1057 > > >> > > > > > >> > > > +1 (non binding) > > >> > > > > > >> > > > Thanks > > >> > > > Fede > > >> > > > > > >> > > > > > >> > > > On Mon, Oct 21, 2024 at 11:12 PM Colin McCabe < > cmcc...@apache.org> > > >> > > wrote: > > >> > > > > > > >> > > > > This is the third candidate for the release of Apache Kafka > 3.9.0. > > >> I > > >> > > > have titled it rc3 since I had an rc1 which got very far, even > to the > > >> > > point > > >> > > > of pushing tags and docker images, before I spotted an issue. So > > >> rather > > >> > > > than mutate the tags, I decided to skip over rc1. > > >> > > > > > > >> > > > > - This is a major release, the final one in the 3.x line. > (There > > >> may > > >> > of > > >> > > > course be other minor releases in this line, such as 3.9.1.) > > >> > > > > - Tiered storage will be considered production-ready in this > > >> release. > > >> > > > > - This will be the final major release to feature the > deprecated > > >> > > > ZooKeeper mode. > > >> > > > > > > >> > > > > This release includes the following KIPs: > > >> > > > > - KIP-853: Support dynamically changing KRaft controller > membership > > >> > > > > - KIP-1057: Add remote log metadata flag to the dump log tool > > >> > > > > - KIP-1049: Add config log.summary.interval.ms to Kafka > Streams > > >> > > > > - KIP-1040: Improve handling of nullable values in > InsertField, > > >> > > > ExtractField, and other transformations > > >> > > > > - KIP-1031: Control offset translation in > MirrorSourceConnector > > >> > > > > - KIP-1033: Add Kafka Streams exception handler for exceptions > > >> > > occurring > > >> > > > during processing > > >> > > > > - KIP-1017: Health check endpoint for Kafka Connect > > >> > > > > - KIP-1025: Optionally URL-encode clientID and clientSecret in > > >> > > > authorization header > > >> > > > > - KIP-1005: Expose EarliestLocalOffset and TieredOffset > > >> > > > > - KIP-950: Tiered Storage Disablement > > >> > > > > - KIP-956: Tiered Storage Quotas > > >> > > > > > > >> > > > > Release notes for the 3.9.0 release: > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > https://dist.apache.org/repos/dist/dev/kafka/3.9.0-rc3/RELEASE_NOTES.html > > >> > > > > > > >> > > > > *** Please download, test and vote by October 24, 2024. > > >> > > > > > > >> > > > > Kafka's KEYS file containing PGP keys we use to sign the > release: > > >> > > > > https://kafka.apache.org/KEYS > > >> > > > > > > >> > > > > * Release artifacts to be voted upon (source and binary): > > >> > > > > https://dist.apache.org/repos/dist/dev/kafka/3.9.0-rc3/ > > >> > > > > > > >> > > > > * Docker release artifacts to be voted upon: > > >> > > > > apache/kafka:3.9.0-rc3 > > >> > > > > apache/kafka-native:3.9.0-rc3 > > >> > > > > > > >> > > > > * Maven artifacts to be voted upon: > > >> > > > > > > >> > > https://repository.apache.org/content/groups/staging/org/apache/kafka/ > > >> > > > > > > >> > > > > * Javadoc: > > >> > > > > > https://dist.apache.org/repos/dist/dev/kafka/3.9.0-rc3/javadoc/ > > >> > > > > > > >> > > > > * Documentation: > > >> > > > > https://kafka.apache.org/39/documentation.html > > >> > > > > > > >> > > > > * Protocol: > > >> > > > > https://kafka.apache.org/39/protocol.html > > >> > > > > > > >> > > > > * Tag to be voted upon (off 3.9 branch) is the 3.9.0-rc3 tag: > > >> > > > > https://github.com/apache/kafka/releases/tag/3.9.0-rc3 > > >> > > > > > > >> > > > > * Successful Docker Image Github Actions Pipeline for 3.9 > branch: > > >> > > > > Docker Build Test Pipeline (JVM): > > >> > > > https://github.com/apache/kafka/actions/runs/11448325059 > > >> > > > > Docker Build Test Pipeline (Native): > > >> > > > https://github.com/apache/kafka/actions/runs/11448338981 > > >> > > > > > > >> > > > > Thanks to everyone who helped with this release candidate, > either > > >> by > > >> > > > contributing code, testing, or documentation. > > >> > > > > > > >> > > > > Regards, > > >> > > > > Colin > > >> > > > > > >> > > > > >> > > > >> >
