On Sat, 2025-02-15 at 16:25 +0100, František Šumšal wrote: > > On 2/15/25 15:54, Zbigniew Jędrzejewski-Szmek wrote: > > On Fri, Feb 14, 2025 at 02:40:29PM -0800, Adam Williamson wrote: > > > On Fri, 2025-02-14 at 16:31 -0500, Dusty Mabe wrote: > > > > IMO the bar would only need to be that high if the user had no way to > > > > ignore the test results. > > > > All gating does here (IIUC) is require them to do an extra step before > > > > it automatically flows > > > > into the next rawhide compose. > > > > > > again, technically, yes, but *please* let's not train people to have a > > > pavlovian reaction to waive failures, that is not the way. > > > > IMO, the bar for *gating* tests needs to be high. I think 95% true > > positives would be a reasonable threshold. > > > > I know this is hard to achieve, but gating failures are very disruptive > > to packagers. And false positives are even more disruptime: a person > > not intimately familiar with the CI needs to spend a considerable > > amount of time jumping through not-very-easy-to-read pages. > > *If* I can be almost certain that the report is real and with enough > > digging I'll figure out a bug, I'm ready to spend the time. But if > > there's a considerable chance of a false positive _and_ the effort to > > figure out if the report is real is also quite high, I'll just learn > > to waive any failures. > > > > -- > > > > I cannot find it right now, but I hope it's still there somewhere… > > Bodhi updates have (had?) a message that said someting like "for failing > > update.* tests, contact <this channel>, for failing fedora-ci.* tests > > contact > > <that channel>". Is something like that planned for the coreos.* tests? > > I assume you mean this message: > > For help debugging failed Fedora CI tests (fedora-ci.*), contact the Fedora > CI team. > For help debugging failed Fedora CoreOS tests (coreos.*), contact the Fedora > CoreOS team. > For help debugging failed openQA tests (update.*), contact the Fedora Quality > team, who will usually investigate and diagnose all failures within 24 hours. > > (Taken from https://bodhi.fedoraproject.org/updates/FEDORA-2025-2e8fcbdfba) > > I guess it shows up only when some of the required fail? And it looks like it > already contains a link for the coreos.* tests.
Yes, that's right. It only shows up if the update's gating status is failed. -- Adam Williamson (he/him/his) Fedora QA Fedora Chat: @adamwill:fedora.im | Mastodon: @ad...@fosstodon.org https://www.happyassassin.net -- _______________________________________________ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
