Re: [PATCH] compare_tests: distinguish c-c++-common results by tool

2023-12-20 Thread Jeff Law
and log files). Thus if you have a test in there which passes in one context, but fails in the other, comparison tools like contrib/compare_tests may erroneously report the tests as both a test which now fails, but passed before and a test which now passes but failed before. It looks like

[PATCH] compare_tests: distinguish c-c++-common results by tool

2023-12-19 Thread Alexandre Oliva
s if you have a test in there which passes in one context, but > fails in the other, comparison tools like contrib/compare_tests may > erroneously report the tests as both a test which now fails, but > passed before and a test which now passes but failed before. > It looks like

Re: [contrib] compare_tests: Print number of tests

2018-07-12 Thread Jeff Law
ch does that. > > OK? > > Thanks, > > Christophe > > > compare_tests.chlog.txt > > > contrib/ChangeLog: > > 2018-07-12 Christophe Lyon > > * compare_tests: Print number of tests in each category. OK jeff

[contrib] compare_tests: Print number of tests

2018-07-12 Thread Christophe Lyon
tophe Lyon * compare_tests: Print number of tests in each category. diff --git a/contrib/compare_tests b/contrib/compare_tests index 51a3719..2dfa864 100755 --- a/contrib/compare_tests +++ b/contrib/compare_tests @@ -129,7 +129,8 @@ grep '^PASS' "$before_s" | sed 's/^[^:]*:[ ]//

Re: Report DejaGnu ERROR messages in compare_tests

2016-09-20 Thread Jeff Law
On 09/20/2016 03:26 AM, Christophe Lyon wrote: Hello, We recently faced a problem where a DejaGnu error went un-noticed (https://gcc.gnu.org/ml/gcc-patches/2016-08/msg01879.html). To help identify these problems earlier, here is a patch for compare_tests that will report such cases as

Report DejaGnu ERROR messages in compare_tests

2016-09-20 Thread Christophe Lyon
Hello, We recently faced a problem where a DejaGnu error went un-noticed (https://gcc.gnu.org/ml/gcc-patches/2016-08/msg01879.html). To help identify these problems earlier, here is a patch for compare_tests that will report such cases as: New tests that FAIL

compare_tests

2013-05-13 Thread Mike Stump
So, it turns out that comm on macosx does't like long lines. Don't know why that is, kinda unfortunate, but life goes on. 2013-05-13 Mike Stump * compare_tests: Limit lines to 2000 characters as comm on Mac OS X 10.8.3 doesn't like long lines (those 2055 cha

compare_tests fix

2012-11-19 Thread Mike Stump
Recently g++ comparisons of the full log files stopped working as well as they used to, as sort is locale aware. This defeats some of the new fangled magic that breaks comparisons. * compare_tests (Usage): Add export LC_ALL=C to make sort happier. Index: compare_tests

Re: compare_tests does not work with symlinked directories

2012-04-23 Thread Mike Stump
On Apr 23, 2012, at 12:12 PM, Manuel López-Ibáñez wrote: > The version of 'find' in the GCC farm does not traverse symlinked > directories unless they have a trailing slash. > > OK? Ok.

compare_tests does not work with symlinked directories

2012-04-23 Thread Manuel López-Ibáñez
The version of 'find' in the GCC farm does not traverse symlinked directories unless they have a trailing slash. OK? 2012-04-23 Manuel López-Ibáñez * contrib/compare_tests: Append '/' to make 'find' traverse symlinked directories. compare_

Re: PATCH: Add capability to contrib/compare_tests to handle directories

2012-02-16 Thread Quentin Neill
;t show the sum file with the problem (instead they show the sum1/sum2 files). Patch below iterates over sum files instead of concatenating. Okay to commit? (output before the patch) $ compare_tests -strict /d/qneill/tst.w[io].zeroshift.* # Comparing directories ## Dir1=

Re: PATCH: Add capability to contrib/compare_tests to handle directories

2012-02-14 Thread Mike Stump
On Feb 14, 2012, at 8:39 AM, Quentin Neill wrote: > Thanks for the fix. This seemed familiar, and upon review it looks > like I never committed this fix: > http://gcc.gnu.org/ml/gcc-patches/2011-11/msg01194.html Ah, ok, let's go with your version, it is much better. Thanks.

Re: PATCH: Add capability to contrib/compare_tests to handle directories

2012-02-14 Thread Quentin Neill
On Tue, Feb 14, 2012 at 10:39 AM, Quentin Neill wrote: > On Sat, Feb 11, 2012 at 8:13 AM, Mike Stump wrote: >> On Nov 4, 2011, at 8:23 PM, Quentin Neill wrote: >>> My scenario about "ANY test results changed" is what I added with -strict. >>> This patch concatenates the common .sum files before c

Re: PATCH: Add capability to contrib/compare_tests to handle directories

2012-02-14 Thread Quentin Neill
inal intent (declaring sum1/sum2 with other tmps and removing the trap on line 52): --- a/contrib/compare_tests +++ b/contrib/compare_tests @@ -43,7 +43,9 @@ lst2=/tmp/$tool-lst2.$$ lst3=/tmp/$tool-lst3.$$ lst4=/tmp/$tool-lst4.$$ lst5=/tmp/$tool-lst5.$$ -tmps="$tmp1 $tmp2 $now_s $before_s

contrib/compare_tests

2012-02-11 Thread Mike Stump
Index: compare_tests === --- compare_tests (revision 184129) +++ compare_tests (working copy) @@ -83,11 +83,14 @@ if [ -d "$1" -a -d "$2" ] ; then exit $exit_status fi

Re: PATCH: Add capability to contrib/compare_tests to handle directories

2012-02-11 Thread Mike Stump
On Nov 4, 2011, at 8:23 PM, Quentin Neill wrote: > My scenario about "ANY test results changed" is what I added with -strict. > This patch concatenates the common .sum files before comparing. So, how exactly does this work for you: + ( for fname in `cat $lst5`; do cat $1/$fname; done ) >$su

Re: PATCH: Add capability to contrib/compare_tests to handle directories

2011-11-08 Thread Mike Stump
On Nov 8, 2011, at 7:29 AM, Quentin Neill wrote: > FYI I see my patch was missing these two fixes: > Okay to commit? Ok.

Re: PATCH: Add capability to contrib/compare_tests to handle directories

2011-11-08 Thread Quentin Neill
two fixes: 1. fix missing sum1 and sum2 temp variables 2. handle trailing slashes in dir args Okay to commit? Should I commit such a patch as trivial? -- Quentin Index: compare_tests === --- compare_tests (revision 181166) ++

Re: PATCH: Add capability to contrib/compare_tests to handle directories

2011-11-05 Thread Mike Stump
On Nov 4, 2011, at 8:23 PM, Quentin Neill wrote: > This patch concatenates the common .sum files before comparing. > > Okay to commit? Ok, thanks for the contribution.

Re: PATCH: Add capability to contrib/compare_tests to handle directories

2011-11-04 Thread Quentin Neill
t; Quentin I got to this anyway. My scenario about "ANY test results changed" is what I added with -strict. This patch concatenates the common .sum files before comparing. Okay to commit? -- Quentin From aaac4ffeedf4b3c9641d593de6526b4e872760d5 Mon Sep 17 00:00:00 2001 From: Quentin Neil

Re: PATCH: Add capability to contrib/compare_tests to handle directories

2011-11-02 Thread Quentin Neill
On Tue, Oct 4, 2011 at 4:57 PM, Mike Stump wrote: > On Oct 4, 2011, at 2:37 PM, Quentin Neill wrote: >> Ping? > > The problem with this patch is it reorders the listing so that lower priority > things are after higher priority things.  The entire point of the routine is > to list the high priori

Re: PATCH: Add capability to contrib/compare_tests to handle directories

2011-10-04 Thread Mike Stump
On Oct 4, 2011, at 2:37 PM, Quentin Neill wrote: > Ping? The problem with this patch is it reorders the listing so that lower priority things are after higher priority things. The entire point of the routine is to list the high priority things first, so that a casual user can read the first li

Re: PATCH: Add capability to contrib/compare_tests to handle directories

2011-10-04 Thread Quentin Neill
t; > --- >  contrib/ChangeLog     |    4 ++ >  contrib/compare_tests |  107 > - >  2 files changed, 101 insertions(+), 10 deletions(-) > > diff --git a/contrib/ChangeLog b/contrib/ChangeLog > index 07adb58..e2007e7 100644 >

PATCH: Add capability to contrib/compare_tests to handle directories

2011-09-07 Thread Quentin Neill
rom 4d4fa9d094745ace0b6e51faadb2f3ea40cb7c7f Mon Sep 17 00:00:00 2001 From: Quentin Neill Date: Wed, 7 Sep 2011 12:04:35 -0500 Subject: [PATCH] Add capability to compare test log directories. --- contrib/ChangeLog |4 ++ contrib/compare_tests | 107 - 2 files changed,