mumrah commented on PR #18681:
URL: https://github.com/apache/kafka/pull/18681#issuecomment-2620038393

   We have trunk builds set to retry tests once with no more than 3 total 
failures per module. This is equivalent to
   ```
       develocity {
         testRetry {
           maxRetries = 1
           maxFailures = 3
         }
       }
   ```
   
   If a test fails twice in the build, the task will fail which prevents the 
task output from being cached. So, as long as a test doesn't fail twice on 
trunk, and no more than three tests fail across the module, it can be cached.
   
   > Will previously failed unaffected tests be rerun?
   
   Only if the task actually failed. So, for example, if ":core:test" fails on 
trunk then a streams PR will end up re-running the core tests.   
   
   ---
   
   > Also, new tests in a PR are automatically quarantined for 7 days. Could we 
fail the build if any new test is flaky?
   
   This is possible, but probably a bit too complex to add to this PR. I think 
we could load the test catalog from trunk at HEAD to determine which tests are 
being added by the PR. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to