On 2/15/25 15:54, Zbigniew Jędrzejewski-Szmek wrote:
On Fri, Feb 14, 2025 at 02:40:29PM -0800, Adam Williamson wrote:
On Fri, 2025-02-14 at 16:31 -0500, Dusty Mabe wrote:
IMO the bar would only need to be that high if the user had no way to ignore
the test results.
All gating does here (IIUC) is require them to do an extra step before it
automatically flows
into the next rawhide compose.
again, technically, yes, but *please* let's not train people to have a
pavlovian reaction to waive failures, that is not the way.
IMO, the bar for *gating* tests needs to be high. I think 95% true
positives would be a reasonable threshold.
I know this is hard to achieve, but gating failures are very disruptive
to packagers. And false positives are even more disruptime: a person
not intimately familiar with the CI needs to spend a considerable
amount of time jumping through not-very-easy-to-read pages.
*If* I can be almost certain that the report is real and with enough
digging I'll figure out a bug, I'm ready to spend the time. But if
there's a considerable chance of a false positive _and_ the effort to
figure out if the report is real is also quite high, I'll just learn
to waive any failures.
--
I cannot find it right now, but I hope it's still there somewhere…
Bodhi updates have (had?) a message that said someting like "for failing
update.* tests, contact <this channel>, for failing fedora-ci.* tests contact
<that channel>". Is something like that planned for the coreos.* tests?
I assume you mean this message:
For help debugging failed Fedora CI tests (fedora-ci.*), contact the Fedora CI
team.
For help debugging failed Fedora CoreOS tests (coreos.*), contact the Fedora
CoreOS team.
For help debugging failed openQA tests (update.*), contact the Fedora Quality
team, who will usually investigate and diagnose all failures within 24 hours.
(Taken from https://bodhi.fedoraproject.org/updates/FEDORA-2025-2e8fcbdfba)
I guess it shows up only when some of the required fail? And it looks like it
already contains a link for the coreos.* tests.
Zbyszek
--
_______________________________________________
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct:
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives:
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam, report it:
https://pagure.io/fedora-infrastructure/new_issue
