The latest system test build completed successfully - https://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/system-test-kafka-branch-builder--1708250728--apache--3.7--02197edaaa/2024-02-18--001./2024-02-18--001./report.html
*System tests are therefore all good*. We just have some flakes On Sun, Feb 18, 2024 at 10:45 AM Stanislav Kozlovski <stanis...@confluent.io> wrote: > The upgrade test passed -> > https://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/system-test-kafka-branch-builder--1708103771--apache--3.7--bb6990114b/2024-02-16--001./2024-02-16--001./report.html > > The replica verification test succeeded in ZK mode, but failed in > ISOLATED_KRAFT. It just seems to be very flaky. > https://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/system-test-kafka-branch-builder--1708100119--apache--3.7--bb6990114b/2024-02-16--001./2024-02-16--001./report.html > > Scheduling another run in > https://jenkins.confluent.io/job/system-test-kafka-branch-builder/6062/ > > On Fri, Feb 16, 2024 at 6:39 PM Stanislav Kozlovski < > stanis...@confluent.io> wrote: > >> Thanks all for the help in verifying. >> >> I have updated >> https://gist.github.com/stanislavkozlovski/820976fc7bfb5f4dcdf9742fd96a9982 >> with the system tests. >> There were two builds ran, and across those - the following tests failed >> two times in a row: >> >> >> *kafkatest.tests.tools.replica_verification_test.ReplicaVerificationToolTest#test_replica_lagsArguments:{ >> "metadata_quorum": "ZK"}*Fails with the same error of >> *`TimeoutError('Timed out waiting to reach non-zero number of replica >> lags.')`* >> I have scheduled a re-run of this specific test here -> >> https://jenkins.confluent.io/job/system-test-kafka-branch-builder/6057 >> >> *kafkatest.tests.core.upgrade_test.TestUpgrade#test_upgradeArguments:{ >> "compression_types": [ "zstd" ], "from_kafka_version": "2.4.1", >> "to_message_format_version": null}* >> Fails with the same error of >> *`TimeoutError('Producer failed to produce messages for 20s.')`* >> *kafkatest.tests.core.upgrade_test.TestUpgrade#test_upgradeArguments:{ >> "compression_types": [ "lz4" ], "from_kafka_version": "3.0.2", >> "to_message_format_version": null}* >> Fails with the same error of *`TimeoutError('Producer failed to produce >> messages for 20s.')`* >> >> I have scheduled a re-run of this test here -> >> https://jenkins.confluent.io/job/system-test-kafka-branch-builder/6058/ >> >> On Fri, Feb 16, 2024 at 12:15 PM Vedarth Sharma <vedarth.sha...@gmail.com> >> wrote: >> >>> Hey Stanislav, >>> >>> Thanks for the release candidate. >>> >>> +1 (non-binding) >>> >>> I tested and verified the docker image artifact apache/kafka:3.7.0-rc4:- >>> - verified create topic, produce messages and consume messages flow when >>> running the docker image with >>> - default configs >>> - configs provided via env variables >>> - configs provided via file input >>> - verified the html documentation for docker image. >>> - ran the example docker compose files successfully. >>> >>> All looks good for the docker image artifact! >>> >>> Thanks and regards, >>> Vedarth >>> >>> >>> On Thu, Feb 15, 2024 at 10:58 PM Mickael Maison < >>> mickael.mai...@gmail.com> >>> wrote: >>> >>> > Hi Stanislav, >>> > >>> > Thanks for running the release. >>> > >>> > I did the following testing: >>> > - verified the check sums and signatures >>> > - ran ZooKeeper and KRaft quickstarts with Scala 2.13 binaries >>> > - ran a successful migration from ZooKeeper to KRaft >>> > >>> > We seem to be missing the upgrade notes for 3.7.0 in the docs. See >>> > https://kafka.apache.org/37/documentation.html#upgrade that still >>> > points to 3.6.0 >>> > Before voting I'd like to see results from the system tests too. >>> > >>> > Thanks, >>> > Mickael >>> > >>> > On Thu, Feb 15, 2024 at 6:06 PM Andrew Schofield >>> > <andrew_schofield_j...@outlook.com> wrote: >>> > > >>> > > +1 (non-binding). I used the staged binaries with Scala 2.13. I tried >>> > the new group coordinator >>> > > and consumer group protocol which is included with the Early Access >>> > release of KIP-848. >>> > > Also verified the availability of the new APIs. All working as >>> expected. >>> > > >>> > > Thanks, >>> > > Andrew >>> > > >>> > > > On 15 Feb 2024, at 05:07, Paolo Patierno <paolo.patie...@gmail.com >>> > >>> > wrote: >>> > > > >>> > > > +1 (non-binding). I used the staged binaries with Scala 2.13 and >>> mostly >>> > > > focused on the ZooKeeper to KRaft migration with multiple tests. >>> > Everything >>> > > > works fine. >>> > > > >>> > > > Thanks >>> > > > Paolo >>> > > > >>> > > > On Mon, 12 Feb 2024, 22:06 Jakub Scholz, <ja...@scholz.cz> wrote: >>> > > > >>> > > >> +1 (non-binding). I used the staged binaries with Scala 2.13 and >>> the >>> > staged >>> > > >> Maven artifacts to run my tests. All seems to work fine. Thanks. >>> > > >> >>> > > >> Jakub >>> > > >> >>> > > >> On Fri, Feb 9, 2024 at 4:20 PM Stanislav Kozlovski >>> > > >> <stanis...@confluent.io.invalid> wrote: >>> > > >> >>> > > >>> Hello Kafka users, developers and client-developers, >>> > > >>> >>> > > >>> This is the second candidate we are considering for release of >>> Apache >>> > > >> Kafka >>> > > >>> 3.7.0. >>> > > >>> >>> > > >>> Major changes include: >>> > > >>> - Early Access to KIP-848 - the next generation of the consumer >>> > rebalance >>> > > >>> protocol >>> > > >>> - Early Access to KIP-858: Adding JBOD support to KRaft >>> > > >>> - KIP-714: Observability into Client metrics via a standardized >>> > interface >>> > > >>> >>> > > >>> Release notes for the 3.7.0 release: >>> > > >>> >>> > > >>> >>> > > >> >>> > >>> https://home.apache.org/~stanislavkozlovski/kafka-3.7.0-rc4/RELEASE_NOTES.html >>> > > >>> >>> > > >>> *** Please download, test and vote by Thursday, February 15th, >>> 9AM >>> > PST >>> > > >> *** >>> > > >>> >>> > > >>> Kafka's KEYS file containing PGP keys we use to sign the release: >>> > > >>> https://kafka.apache.org/KEYS >>> > > >>> >>> > > >>> * Release artifacts to be voted upon (source and binary): >>> > > >>> https://home.apache.org/~stanislavkozlovski/kafka-3.7.0-rc4/ >>> > > >>> >>> > > >>> * Docker release artifact to be voted upon: >>> > > >>> apache/kafka:3.7.0-rc4 >>> > > >>> >>> > > >>> * Maven artifacts to be voted upon: >>> > > >>> >>> > https://repository.apache.org/content/groups/staging/org/apache/kafka/ >>> > > >>> >>> > > >>> * Javadoc: >>> > > >>> >>> https://home.apache.org/~stanislavkozlovski/kafka-3.7.0-rc4/javadoc/ >>> > > >>> >>> > > >>> * Tag to be voted upon (off 3.7 branch) is the 3.7.0 tag: >>> > > >>> https://github.com/apache/kafka/releases/tag/3.7.0-rc4 >>> > > >>> >>> > > >>> * Documentation: >>> > > >>> https://kafka.apache.org/37/documentation.html >>> > > >>> >>> > > >>> * Protocol: >>> > > >>> https://kafka.apache.org/37/protocol.html >>> > > >>> >>> > > >>> * Successful Jenkins builds for the 3.7 branch: >>> > > >>> >>> > > >>> Unit/integration tests: I am in the process of running and >>> analyzing >>> > > >> these. >>> > > >>> System tests: I am in the process of running these. >>> > > >>> >>> > > >>> Expect a follow-up over the weekend >>> > > >>> >>> > > >>> * Successful Docker Image Github Actions Pipeline for 3.7 branch: >>> > > >>> Docker Build Test Pipeline: >>> > > >>> https://github.com/apache/kafka/actions/runs/7845614846 >>> > > >>> >>> > > >>> /************************************** >>> > > >>> >>> > > >>> Best, >>> > > >>> Stanislav >>> > > >>> >>> > > >> >>> > > >>> > >>> >> >> >> -- >> Best, >> Stanislav >> > > > -- > Best, > Stanislav > -- Best, Stanislav