On Wed, 29 Nov 2023 at 11:46, Daniel P. Berrangé <berra...@redhat.com> wrote: > > On Wed, Nov 29, 2023 at 10:53:00AM -0500, Stefan Hajnoczi wrote: > > To give a picture of the state of the CI, I'd say it fails 80% of the > > time. Usually 2 or 3 of the tests fail randomly from a group of <10 > > tests that commonly fail randomly. > > > > In order for the CI to be usable to submaintainers I think it should > > _pass_ at least 90% of the time. > > > > There is still some way to go but I think this goal is achievable in > > the next 2 or 3 months because the set of problematic tests is not > > that large. > > FWIW, also bear in mind that when a pipeline fails, it is advisible to > *NOT* re-run the pipeline, as that increases your odds of hitting another > non-deterministic bug. Instead re-run only the individual job(s) that > failed.
Yes, that's the approach I take. It's way to risky to re-run the pipeline because it will probably fail again somewhere else :-). Stefan
