Re: Hundreds of gcc.dg/guality failures on both 14 and 13.1 branches

2023-07-16 Thread Frank Ch. Eigler via Gcc
Hi - Hi - > (CC Frank, the fedrawhide builder doesn't seem to include guality.exp, > do you know why?) Good question. The gcc.log testsuite file appears to be truncated as it arrived into bunsen. The test does appear to be running on the bot. Maybe the gcc's own dg* log processing scripts are

Re: Hundreds of gcc.dg/guality failures on both 14 and 13.1 branches

2023-07-16 Thread Mark Wielaard
Hi, On Sun, Jul 16, 2023 at 09:50:24AM +0200, FX Coudert via Gcc wrote: > > Which is why people should just compare testsuite results from earlier run > > on the same configuration to watch for regressions, especially in the > > guality testsuite. > > All this gives the idea of a test framework t

Re: Hundreds of gcc.dg/guality failures on both 14 and 13.1 branches

2023-07-16 Thread Richard Sandiford via Gcc
Martin Jambor writes: > Hi, > > On Sat, Jul 15 2023, FX Coudert via Gcc wrote: >> Hi, >> >> I am finding it very hard to reliably compare test results and regressions >> with the very large number of gcc.dg/guality test failures that are >> apparently the new norm on x86_64-linux: more than one

Re: Hundreds of gcc.dg/guality failures on both 14 and 13.1 branches

2023-07-16 Thread FX Coudert via Gcc
Hi, > Which is why people should just compare testsuite results from earlier run > on the same configuration to watch for regressions, especially in the > guality testsuite. All this gives the idea of a test framework that is too rigid, or tests that are too fragile. I mean, The accumulation of

Re: Hundreds of gcc.dg/guality failures on both 14 and 13.1 branches

2023-07-15 Thread Jakub Jelinek via Gcc
On Sat, Jul 15, 2023 at 10:58:40PM +0200, Martin Jambor wrote: > Hi, > > On Sat, Jul 15 2023, FX Coudert via Gcc wrote: > > Hi, > > > > I am finding it very hard to reliably compare test results and regressions > > with the very large number of gcc.dg/guality test failures that are > > apparentl

Re: Hundreds of gcc.dg/guality failures on both 14 and 13.1 branches

2023-07-15 Thread Martin Jambor
Hi, On Sat, Jul 15 2023, FX Coudert via Gcc wrote: > Hi, > > I am finding it very hard to reliably compare test results and regressions > with the very large number of gcc.dg/guality test failures that are > apparently the new norm on x86_64-linux: more than one hundred on 13.1, and > several h

Re: Hundreds of gcc.dg/guality failures on both 14 and 13.1 branches

2023-07-15 Thread Andreas Schwab
On Jul 15 2023, FX Coudert via Gcc wrote: > I am finding it very hard to reliably compare test results and regressions > with the very large number of gcc.dg/guality test failures that are > apparently the new norm on x86_64-linux: more than one hundred on 13.1, and > several hundreds on 14. Is