On Mon, Jul 18, 2022 at 11:42 PM Josh McKenzie <jmcken...@apache.org> wrote:
> [CI Trends] > https://butler.cassandra.apache.org/#/ > > The last three weeks show us this delightful trend: > > 3.0: 10 -> 10 > 3.11: 23 -> 15 > 4.0: 2 -> 1 > 4.1: 8 -> 10 -> 5 > trunk: 20 -> 5 > > That's 36 total failures across all our branches! This is a new low > watermark for us; we're getting close to both a 4.1 RC as well as needing > to start serious discussions about potential improvements to our workflows > to keep these test boards green. Knocking down flaky test failures > continues to be a high-investment activity for the project; thank you as > always to everyone taking the time to drive CI back to health! > <https://www.datastax.com/> > This is exciting to see and thanks Josh for summarizing the stats in your email. Thanks to all the hard working engineers who's joint efforts are now seen in those numbers! And thanks again Tomek for your 2+ years of personal dedication to Butler. This is yet another example of how a good tool will help its users to understand what they need to do, and then makes it easy to go and do it. Once those numbers go down to 0 I look forward to a discussion on how to lock ourselves into some process where it will also stay that way. Butler includes functionality that can help with various blocking merge policies, otoh once you get to a truly green build, you might not need Butler even. henrik
