Re: Gating Fedora updates on Fedora CoreOS CI

On 2/28/25 11:47 AM, Clement Verna wrote: > > On Fri, 28 Feb 2025 at 17:35, Adam Williamson > wrote: > > On Fri, 2025-02-28 at 08:56 -0500, Dusty Mabe wrote: > > Last Wednesday there was a grub2-2.12-24.fc43 update [1] that came in > that completely

Re: Gating Fedora updates on Fedora CoreOS CI

On 2/28/25 9:56 AM, Zbigniew Jędrzejewski-Szmek wrote: > On Fri, Feb 28, 2025 at 08:56:33AM -0500, Dusty Mabe wrote: >> >> >> On 2/13/25 3:32 AM, Clement Verna wrote: >> >>> Given our experience running these tests, we would like to propose making >>> the coreos.cosa.build-and-testa required g

Re: Gating Fedora updates on Fedora CoreOS CI

On Fri, Feb 28, 2025 at 11:53:06AM -0800, Adam Williamson wrote: > On Fri, 2025-02-28 at 12:04 -0500, Dusty Mabe wrote: > > > @Dusty Mabe  , how about doing this for the > > > F43 development cycle? This give us a good way to "protect" to CoreOS > > > builds as well as

Re: Gating Fedora updates on Fedora CoreOS CI

On Fri, 2025-02-28 at 12:05 -0500, Dusty Mabe wrote: > > On 2/28/25 9:56 AM, Zbigniew Jędrzejewski-Szmek wrote: > > On Fri, Feb 28, 2025 at 08:56:33AM -0500, Dusty Mabe wrote: > > > > > > > > > On 2/13/25 3:32 AM, Clement Verna wrote: > > > > > > > Given our experience running these tests, we

Re: Gating Fedora updates on Fedora CoreOS CI

On Fri, 2025-02-28 at 12:04 -0500, Dusty Mabe wrote: > > @Dusty Mabe  , how about doing this for the F43 > > development cycle? This give us a good way to "protect" to CoreOS builds as > > well as getting more data for turning on "real" gating as adamw mentioned. > > W

Re: Gating Fedora updates on Fedora CoreOS CI

On Fri, 28 Feb 2025 at 17:35, Adam Williamson wrote: > On Fri, 2025-02-28 at 08:56 -0500, Dusty Mabe wrote: > > Last Wednesday there was a grub2-2.12-24.fc43 update [1] that came in > that completely broke booting > > in CoreOS. For whatever reason this same update didn't break testing in > OpenQ

Re: Gating Fedora updates on Fedora CoreOS CI

On Fri, 2025-02-28 at 08:56 -0500, Dusty Mabe wrote: > Last Wednesday there was a grub2-2.12-24.fc43 update [1] that came in that > completely broke booting > in CoreOS. For whatever reason this same update didn't break testing in > OpenQA of other editions, > but we knew immediately [2] that it

Re: Gating Fedora updates on Fedora CoreOS CI

On Fri, Feb 28, 2025 at 08:56:33AM -0500, Dusty Mabe wrote: > > > On 2/13/25 3:32 AM, Clement Verna wrote: > > > Given our experience running these tests, we would like to propose making > > the coreos.cosa.build-and-testa required gate for package updates in > > rawhide. We've already been s

Re: Gating Fedora updates on Fedora CoreOS CI

On 2/13/25 3:32 AM, Clement Verna wrote: > Given our experience running these tests, we would like to propose making the > coreos.cosa.build-and-testa required gate for package updates in rawhide. > We've already been successfully gating packages owned by the Fedora CoreOS > working group [3

Re: Gating Fedora updates on Fedora CoreOS CI

On Mon, 2025-02-17 at 21:22 -0500, Dusty Mabe wrote: > > On 2/17/25 1:35 PM, Adam Williamson wrote: > > On Mon, 2025-02-17 at 10:35 -0500, Dusty Mabe wrote: > > > > > > > > One more question: are packagers able to restart the tests? > > > > > > > > > > > > @Dusty Mabe

Re: Gating Fedora updates on Fedora CoreOS CI

On 2/17/25 1:35 PM, Adam Williamson wrote: > On Mon, 2025-02-17 at 10:35 -0500, Dusty Mabe wrote: >>> >>> One more question: are packagers able to restart the tests? >>> >>> >>> @Dusty Mabe  will know better, but I don't >>> think packagers can restart the tests c

Re: Gating Fedora updates on Fedora CoreOS CI

On 2/17/25 1:32 PM, Adam Williamson wrote: > On Mon, 2025-02-17 at 11:06 +0100, Clement Verna wrote: >> On Sat, 15 Feb 2025 at 20:51, Adam Williamson >> wrote: >> >>> On Sat, 2025-02-15 at 14:54 +, Zbigniew Jędrzejewski-Szmek wrote: On Fri, Feb 14, 2025 at 02:40:29PM -0800, Adam William

Re: Gating Fedora updates on Fedora CoreOS CI

On 2/17/25 5:12 AM, Clement Verna wrote: > > > On Sun, 16 Feb 2025 at 13:52, Zbigniew Jędrzejewski-Szmek > wrote: > > On Sat, Feb 15, 2025 at 11:11:49AM -0500, Dusty Mabe wrote: > > On 2/15/25 9:54 AM, Zbigniew Jędrzejewski-Szmek wrote: > > > On Fri, Feb

Re: Gating Fedora updates on Fedora CoreOS CI

On Mon, 2025-02-17 at 11:06 +0100, Clement Verna wrote: > On Sat, 15 Feb 2025 at 20:51, Adam Williamson > wrote: > > > On Sat, 2025-02-15 at 14:54 +, Zbigniew Jędrzejewski-Szmek wrote: > > > On Fri, Feb 14, 2025 at 02:40:29PM -0800, Adam Williamson wrote: > > > > On Fri, 2025-02-14 at 16:31 -

Re: Gating Fedora updates on Fedora CoreOS CI

On Mon, 2025-02-17 at 10:35 -0500, Dusty Mabe wrote: > > > > One more question: are packagers able to restart the tests? > > > > > > @Dusty Mabe  will know better, but I don't > > think packagers can restart the tests currently. > > No. Not currently. But it is

Re: Gating Fedora updates on Fedora CoreOS CI

On Sun, 16 Feb 2025 at 13:52, Zbigniew Jędrzejewski-Szmek wrote: > On Sat, Feb 15, 2025 at 11:11:49AM -0500, Dusty Mabe wrote: > > On 2/15/25 9:54 AM, Zbigniew Jędrzejewski-Szmek wrote: > > > On Fri, Feb 14, 2025 at 02:40:29PM -0800, Adam Williamson wrote: > > >> On Fri, 2025-02-14 at 16:31 -0500

Re: Gating Fedora updates on Fedora CoreOS CI

On Sat, 15 Feb 2025 at 20:51, Adam Williamson wrote: > On Sat, 2025-02-15 at 14:54 +, Zbigniew Jędrzejewski-Szmek wrote: > > On Fri, Feb 14, 2025 at 02:40:29PM -0800, Adam Williamson wrote: > > > On Fri, 2025-02-14 at 16:31 -0500, Dusty Mabe wrote: > > > > IMO the bar would only need to be th

Re: Gating Fedora updates on Fedora CoreOS CI

On Sat, Feb 15, 2025 at 11:11:49AM -0500, Dusty Mabe wrote: > On 2/15/25 9:54 AM, Zbigniew Jędrzejewski-Szmek wrote: > > On Fri, Feb 14, 2025 at 02:40:29PM -0800, Adam Williamson wrote: > >> On Fri, 2025-02-14 at 16:31 -0500, Dusty Mabe wrote: > >>> IMO the bar would only need to be that high if th

Re: Gating Fedora updates on Fedora CoreOS CI

On Sat, 2025-02-15 at 14:54 +, Zbigniew Jędrzejewski-Szmek wrote: > On Fri, Feb 14, 2025 at 02:40:29PM -0800, Adam Williamson wrote: > > On Fri, 2025-02-14 at 16:31 -0500, Dusty Mabe wrote: > > > IMO the bar would only need to be that high if the user had no way to > > > ignore the test result

Re: Gating Fedora updates on Fedora CoreOS CI

On Sat, 2025-02-15 at 16:25 +0100, František Šumšal wrote: > > On 2/15/25 15:54, Zbigniew Jędrzejewski-Szmek wrote: > > On Fri, Feb 14, 2025 at 02:40:29PM -0800, Adam Williamson wrote: > > > On Fri, 2025-02-14 at 16:31 -0500, Dusty Mabe wrote: > > > > IMO the bar would only need to be that high if

Re: Gating Fedora updates on Fedora CoreOS CI

On 2/15/25 9:54 AM, Zbigniew Jędrzejewski-Szmek wrote: > On Fri, Feb 14, 2025 at 02:40:29PM -0800, Adam Williamson wrote: >> On Fri, 2025-02-14 at 16:31 -0500, Dusty Mabe wrote: >>> IMO the bar would only need to be that high if the user had no way to >>> ignore the test results. >>> All gating

Re: Gating Fedora updates on Fedora CoreOS CI

On 2/15/25 15:54, Zbigniew Jędrzejewski-Szmek wrote: On Fri, Feb 14, 2025 at 02:40:29PM -0800, Adam Williamson wrote: On Fri, 2025-02-14 at 16:31 -0500, Dusty Mabe wrote: IMO the bar would only need to be that high if the user had no way to ignore the test results. All gating does here (IIUC

Re: Gating Fedora updates on Fedora CoreOS CI

On Fri, Feb 14, 2025 at 02:40:29PM -0800, Adam Williamson wrote: > On Fri, 2025-02-14 at 16:31 -0500, Dusty Mabe wrote: > > IMO the bar would only need to be that high if the user had no way to > > ignore the test results. > > All gating does here (IIUC) is require them to do an extra step before

Re: Gating Fedora updates on Fedora CoreOS CI

On Fri, 2025-02-14 at 16:31 -0500, Dusty Mabe wrote: > IMO the bar would only need to be that high if the user had no way to ignore > the test results. > All gating does here (IIUC) is require them to do an extra step before it > automatically flows > into the next rawhide compose. again, techni

Re: Gating Fedora updates on Fedora CoreOS CI

On 2/14/25 5:07 AM, Pierre-Yves Chibon wrote: > On Fri, Feb 14, 2025 at 10:34:51AM +0100, Clement Verna wrote: >>On Thu, 13 Feb 2025 at 17:44, Kevin Fenzi <[1]ke...@scrye.com> wrote: >> >> I agree with downthread folks that that seems like way too high a >> failure rate to enable ga

Re: Gating Fedora updates on Fedora CoreOS CI

On Fri, 2025-02-14 at 10:34 +0100, Clement Verna wrote: > On Thu, 13 Feb 2025 at 17:44, Kevin Fenzi wrote: > > > I agree with downthread folks that that seems like way too high a > > failure rate to enable gating on. However, a few questions if I can: > > > > Yes the failure rate is quite high

Re: Gating Fedora updates on Fedora CoreOS CI

On Fri, Feb 14, 2025 at 10:34:51AM +0100, Clement Verna wrote: >On Thu, 13 Feb 2025 at 17:44, Kevin Fenzi <[1]ke...@scrye.com> wrote: > > I agree with downthread folks that that seems like way too high a > failure rate to enable gating on. However, a few questions if I can: > >Y

Re: Gating Fedora updates on Fedora CoreOS CI

On Fri, 14 Feb 2025 at 02:00, Kevin Fenzi wrote: > On Thu, Feb 13, 2025 at 12:15:16PM -0500, Dusty Mabe wrote: > > > > > > On 2/13/25 11:42 AM, Kevin Fenzi wrote: > > > I agree with downthread folks that that seems like way too high a > > > failure rate to enable gating on. However, a few questio

Re: Gating Fedora updates on Fedora CoreOS CI

On Thu, 13 Feb 2025 at 21:46, Adam Williamson wrote: > On Thu, 2025-02-13 at 11:46 +0100, Clement Verna wrote: > > If with all of this a critical update > > is still blocked because of a false positive, it is fairly easy to waive > > the test in Bodhi ( > > > https://docs.fedoraproject.org/en-US/

Re: Gating Fedora updates on Fedora CoreOS CI

On Thu, 13 Feb 2025 at 17:44, Kevin Fenzi wrote: > I agree with downthread folks that that seems like way too high a > failure rate to enable gating on. However, a few questions if I can: > Yes the failure rate is quite high and most of these are real failures, that we deal with in Fedora CoreOS

Re: Gating Fedora updates on Fedora CoreOS CI

On Thu, 2025-02-13 at 16:59 -0800, Kevin Fenzi wrote: > On Thu, Feb 13, 2025 at 12:15:16PM -0500, Dusty Mabe wrote: > > > > > Is there an example where you think the test should have reported results > > to bodhi, but didn't? It's probably what I mentioned above. > > I looked again and I missed

Re: Gating Fedora updates on Fedora CoreOS CI

On Thu, Feb 13, 2025 at 12:15:16PM -0500, Dusty Mabe wrote: > > > On 2/13/25 11:42 AM, Kevin Fenzi wrote: > > I agree with downthread folks that that seems like way too high a > > failure rate to enable gating on. However, a few questions if I can: > > > > Is this reporting to bodhi for all thes

Re: Gating Fedora updates on Fedora CoreOS CI

On Thu, 2025-02-13 at 11:46 +0100, Clement Verna wrote: > If with all of this a critical update > is still blocked because of a false positive, it is fairly easy to waive > the test in Bodhi ( > https://docs.fedoraproject.org/en-US/rawhide-gating/faq/#_how_do_i_unblock_an_update > ) I try to disco

Re: Gating Fedora updates on Fedora CoreOS CI

On Thu, 13 Feb 2025 at 14:53, Neal Gompa wrote: > On Thu, Feb 13, 2025 at 8:32 AM Clement Verna > wrote: > > > > > > > > On Thu, 13 Feb 2025 at 13:04, Neal Gompa wrote: > >> > >> On Thu, Feb 13, 2025 at 5:46 AM Clement Verna > wrote: > >> > > >> > > >> > > >> > On Thu, 13 Feb 2025 at 10:13, Da

Re: Gating Fedora updates on Fedora CoreOS CI

On 2/13/25 11:42 AM, Kevin Fenzi wrote: > I agree with downthread folks that that seems like way too high a > failure rate to enable gating on. However, a few questions if I can: > > Is this reporting to bodhi for all these components? > Off hand checking a few I don't see any results from this?

Re: Gating Fedora updates on Fedora CoreOS CI

On 2/13/25 7:01 AM, Neal Gompa wrote: > On Thu, Feb 13, 2025 at 5:46 AM Clement Verna > wrote: >> >> >> >> On Thu, 13 Feb 2025 at 10:13, Dan Horák wrote: >>> >>> On Thu, 13 Feb 2025 09:32:06 +0100 >>> Clement Verna wrote: >>> cross posting from https://discussion.fedoraproject.org/t

Re: Gating Fedora updates on Fedora CoreOS CI

I agree with downthread folks that that seems like way too high a failure rate to enable gating on. However, a few questions if I can: Is this reporting to bodhi for all these components? Off hand checking a few I don't see any results from this? Wouldn't a good first step be to enable (non gating

Re: Gating Fedora updates on Fedora CoreOS CI

On Thu, Feb 13, 2025 at 8:32 AM Clement Verna wrote: > > > > On Thu, 13 Feb 2025 at 13:04, Neal Gompa wrote: >> >> On Thu, Feb 13, 2025 at 5:46 AM Clement Verna >> wrote: >> > >> > >> > >> > On Thu, 13 Feb 2025 at 10:13, Dan Horák wrote: >> >> >> >> On Thu, 13 Feb 2025 09:32:06 +0100 >> >> Cle

Re: Gating Fedora updates on Fedora CoreOS CI

On Thu, 13 Feb 2025 at 13:04, Neal Gompa wrote: > On Thu, Feb 13, 2025 at 5:46 AM Clement Verna > wrote: > > > > > > > > On Thu, 13 Feb 2025 at 10:13, Dan Horák wrote: > >> > >> On Thu, 13 Feb 2025 09:32:06 +0100 > >> Clement Verna wrote: > >> > >> > cross posting from > >> > > https://discuss

Re: Gating Fedora updates on Fedora CoreOS CI

On Thu, Feb 13, 2025 at 5:46 AM Clement Verna wrote: > > > > On Thu, 13 Feb 2025 at 10:13, Dan Horák wrote: >> >> On Thu, 13 Feb 2025 09:32:06 +0100 >> Clement Verna wrote: >> >> > cross posting from >> > https://discussion.fedoraproject.org/t/gating-fedora-updates-on-fedora-coreos-ci/144566 >>

Re: Gating Fedora updates on Fedora CoreOS CI

On Thu, 13 Feb 2025 at 10:13, Dan Horák wrote: > On Thu, 13 Feb 2025 09:32:06 +0100 > Clement Verna wrote: > > > cross posting from > > > https://discussion.fedoraproject.org/t/gating-fedora-updates-on-fedora-coreos-ci/144566 > > > > Hi all, > > > > Last year, the Fedora CoreOS working group imp

Re: Gating Fedora updates on Fedora CoreOS CI

On Thu, 13 Feb 2025 09:32:06 +0100 Clement Verna wrote: > cross posting from > https://discussion.fedoraproject.org/t/gating-fedora-updates-on-fedora-coreos-ci/144566 > > Hi all, > > Last year, the Fedora CoreOS working group implemented CI testing [1] for > Bodhi updates on a set of critical p