mumrah commented on PR #18681: URL: https://github.com/apache/kafka/pull/18681#issuecomment-2620038393
We have trunk builds set to retry tests once with no more than 3 total failures per module. This is equivalent to ``` develocity { testRetry { maxRetries = 1 maxFailures = 3 } } ``` If a test fails twice in the build, the task will fail which prevents the task output from being cached. So, as long as a test doesn't fail twice on trunk, and no more than three tests fail across the module, it can be cached. > Will previously failed unaffected tests be rerun? Only if the task actually failed. So, for example, if ":core:test" fails on trunk then a streams PR will end up re-running the core tests. --- > Also, new tests in a PR are automatically quarantined for 7 days. Could we fail the build if any new test is flaky? This is possible, but probably a bit too complex to add to this PR. I think we could load the test catalog from trunk at HEAD to determine which tests are being added by the PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org