dsmiley commented on PR #2665: URL: https://github.com/apache/solr/pull/2665#issuecomment-2532620288
I was hoping to visit Gradle Enterprise today to browse the failures, differentiated from flaky tests. But some failures were deemed such after executing the test only one time. For example see: https://ge.apache.org/s/qcptlo6laqo5g/tests/task/:solr:core:test/details/org.apache.solr.search.TestThinCache/testSimple?top-execution=1 Do you have any insights @iamsanjay on why this is? If we could ensure we repeat failures to differentiate failure from flaky, it'd be a major step forward to get to the point on notifying people/the-project for repeatable failures. We don't do this today because we don't yet differentiate, and too many are flaky. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org For additional commands, e-mail: issues-h...@solr.apache.org
