Paul Gevers <[email protected]> writes: >> If we mark the (apparently) flaky tests with 'flaky', would it still be >> 'Serious'? > > If the test isn't marked as FAILED, it's no longer serious. So yes, > marking a test flaky will lower the severity of this bug report.
Ok. Let's see if 1.3.1-8 improves things, it marks tests as flaky that I've witnessed flip-flop on some archs. I may have missed some, we'll see: I queued a couple of debci runs of it on all archs. I am hoping that flaky tests won't result in FAILED even on failure, but end up in some other state that is ignored by people who keep debci running. I suggest to use this bug report to discuss (and tag) flaky tests in Debian, but reports to FIX the tests to not fail at all in the first place should go upstream. I am hoping Ludo' has some cycles to look into these reports, or at least push out a new upstream release shortly to see if anything applied since the last release already address this. /Simon
signature.asc
Description: PGP signature
