kirktrue commented on PR #18795: URL: https://github.com/apache/kafka/pull/18795#issuecomment-2649451285
@junrao—here's a breakdown of the flaky tests from the latest run: * `AbstractCoordinatorTest.testWakeupAfterSyncGroupReceivedExternalCompletion()`: [35% flaky](https://develocity.apache.org/scans/tests?search.names=Git%20branch&search.relativeStartTime=P28D&search.rootProjectNames=kafka&search.values=trunk&tests.container=org.apache.kafka.clients.consumer.internals.AbstractCoordinatorTest&tests.sortField=FLAKY) * `DelayedFutureTest.testDelayedFuture()`: [2% flaky](https://develocity.apache.org/scans/tests?search.names=Git%20branch&search.relativeStartTime=P28D&search.rootProjectNames=kafka&search.values=trunk&tests.container=integration.kafka.server.DelayedFutureTest&tests.sortField=FLAKY) * `MetricsDuringTopicCreationDeletionTest.testMetricsDuringTopicCreateDelete()`: [6% flaky](https://develocity.apache.org/scans/tests?search.names=Git%20branch&search.relativeStartTime=P28D&search.rootProjectNames=kafka&search.timeZoneId=America%2FLos_Angeles&search.values=trunk&tests.container=kafka.integration.MetricsDuringTopicCreationDeletionTest&tests.sortField=FLAKY) * `OffloadAndTxnConsumeFromLeaderTest.executeTieredStorageTest()`: [2% flaky](https://develocity.apache.org/scans/tests?search.names=Git%20branch&search.relativeStartTime=P28D&search.rootProjectNames=kafka&search.timeZoneId=America%2FLos_Angeles&search.values=trunk&tests.container=*OffloadAndTxnConsumeFromLeaderTest*&tests.sortField=FLAKY) * [`ReplicationQuotasTest`](https://develocity.apache.org/scans/tests?search.names=Git%20branch&search.relativeStartTime=P28D&search.rootProjectNames=kafka&search.timeZoneId=America%2FLos_Angeles&search.values=trunk&tests.container=*ReplicationQuotasTest*&tests.sortField=FLAKY) and [`RequestQuotaTest`](https://develocity.apache.org/scans/tests?search.names=Git%20branch&search.relativeStartTime=P28D&search.rootProjectNames=kafka&search.timeZoneId=America%2FLos_Angeles&search.values=trunk&tests.container=*RequestQuotaTest*&tests.sortField=FLAKY) are both 19% flaky, mostly because they're failing the pre-test spurious thread check. Of these tests, only `OffloadAndTxnConsumeFromLeaderTest` creates a `KafkaConsumer` as part of its execution. Therefore it shouldn't be possible for the new fetch logic to be at the root of any flakiness. The latest build passed with Java 17, but only Java 23 had the above flaky issues. Lastly, I've noticed that only [8 of the 25 most recently merged PRs](https://github.com/apache/kafka/pulls?q=sort%3Aupdated-desc+is%3Apr+is%3Amerged) are passing with green builds. Many of the above flaky tests appear in those PRs’ builds too. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
