On 13/02/2021 04:49, Seth Arnold wrote: > Could we build a retriggerbot that smashes the retry button three times > before bothering any humans about failed tests? > > Hitting retry is often the first troubleshooting step people take; I've > heard tests may be retried something like ten times by different people, > each of whom was taking a reasonable enough "first debugging step" > without noticing that other people have also done the same.
Not an Ubuntu developer but I do work as a quality manager. Not sure whether my list post will be accepted, so I'm copying you. The assumption underlying your suggestion is that tests that intermittently fail do so because of intermittent failures in the test environment rather than due to actual bugs that manifest themselves only intermittently (such as race conditions). This is fine if you have evidence that the assumption holds in a sufficiently large majority of cases. HTH, Jan -- ubuntu-devel mailing list ubuntu-devel@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel
