> Apache Kafka 3.9 uses ducktape 0.8.14, which is well behind what trunk seems > to be using now (ducktape 0.11.4) We will not advance the version of ducktape > in the 3.x branch, I think.
Yes, I agree not to advance the version of Ducktape, but the Ducktape version was unpinned from 3.2 (see https://github.com/apache/kafka/commit/7e683852b46c0fe70f5100e953e3cd61d1697c06), so I suspect 3.9 hasn't been using Ducktape 0.8.14 for a while. The PR (https://github.com/apache/kafka/pull/17481) locks Ducktape to version 0.11.4, which is the latest release that works well with the 3.9 Dockerfile (and it is waiting for your review). Additionally, the trunk can use Ducktape 0.12.0, which supports newer Python versions, allowing us to upgrade the base image without relying on outdated Python versions. Best, Chia-Ping On 2024/10/14 15:08:06 Colin McCabe wrote: > Hi Chia-Ping Tsai, > > Apache Kafka 3.9 uses ducktape 0.8.14, which is well behind what trunk seems > to be using now (ducktape 0.11.4) We will not advance the version of ducktape > in the 3.x branch, I think. > > cheers, > Colin > > > On Sat, Oct 12, 2024, at 01:49, Chia-Ping Tsai wrote: > > hi Colin > > > > I'm sending this email to remind developers who plan to test E2E for RC2. > > > > There is an issue with the E2E tests due to the new release of > > Ducktape. I've filed KAFKA-17781 to address it. Only developers who > > recently rebuilt the E2E image will encounter this issue, so I assume > > it is NOT a blocker for RC2. > > > > Best, > > Chia-Ping > > > > > > On 2024/10/10 21:14:55 Colin McCabe wrote: > >> This is the second candidate for the release of Apache Kafka 3.9.0. I have > >> titled it rc2 since I had an rc1 which got very far, even to the point of > >> pushing tags and docker images, before I spotted an issue. So rather than > >> mutate the tags, I decided to skip over rc1. > >> > >> - This is a major release, the final one in the 3.x line. (There may of > >> course be other minor releases in this line, such as 3.9.1.) > >> - Tiered storage will be considered production-ready in this release. > >> - This will be the final major release to feature the deprecated ZooKeeper > >> mode. > >> > >> This release includes the following KIPs: > >> - KIP-853: Support dynamically changing KRaft controller membership > >> - KIP-1057: Add remote log metadata flag to the dump log tool > >> - KIP-1049: Add config log.summary.interval.ms to Kafka Streams > >> - KIP-1040: Improve handling of nullable values in InsertField, > >> ExtractField, and other transformations > >> - KIP-1031: Control offset translation in MirrorSourceConnector > >> - KIP-1033: Add Kafka Streams exception handler for exceptions occurring > >> during processing > >> - KIP-1017: Health check endpoint for Kafka Connect > >> - KIP-1025: Optionally URL-encode clientID and clientSecret in > >> authorization header > >> - KIP-1005: Expose EarliestLocalOffset and TieredOffset > >> - KIP-950: Tiered Storage Disablement > >> - KIP-956: Tiered Storage Quotas > >> > >> Release notes for the 3.9.0 release: > >> https://dist.apache.org/repos/dist/dev/kafka/3.9.0-rc2/RELEASE_NOTES.html > >> > >> *** Please download, test and vote by October 16, 2024. > >> > >> Kafka's KEYS file containing PGP keys we use to sign the release: > >> https://kafka.apache.org/KEYS > >> > >> * Release artifacts to be voted upon (source and binary): > >> https://dist.apache.org/repos/dist/dev/kafka/3.9.0-rc2/ > >> > >> * Docker release artifacts to be voted upon: > >> apache/kafka:3.9.0-rc2 > >> apache/kafka-native:3.9.0-rc2 > >> > >> * Maven artifacts to be voted upon: > >> https://repository.apache.org/content/groups/staging/org/apache/kafka/ > >> > >> * Javadoc: > >> https://dist.apache.org/repos/dist/dev/kafka/3.9.0-rc2/javadoc/ > >> > >> * Documentation: > >> https://kafka.apache.org/39/documentation.html > >> > >> * Protocol: > >> https://kafka.apache.org/39/protocol.html > >> > >> * Tag to be voted upon (off 3.9 branch) is the 3.9.0-rc2 tag: > >> https://github.com/apache/kafka/releases/tag/3.9.0-rc2 > >> > >> * Successful Docker Image Github Actions Pipeline for 3.9 branch: > >> Docker Build Test Pipeline (JVM): > >> https://github.com/apache/kafka/actions/runs/11281563007 > >> Docker Build Test Pipeline (Native): > >> https://github.com/apache/kafka/actions/runs/11281608809 > >> > >> Thanks to everyone who helped with this release candidate, either by > >> contributing code, testing, or documentation. > >> > >> Regards, > >> Colin > >> >
