Thanks Mr. Aleksandar, "Reference" and "latest" already each has its own results directory.
I will try re-running the tests tonight from scratch as you've suggested to see how things will go. I will also add the "-------" line at the beginning as you've suggested. Best regards, Ahmed On Sat, Aug 22, 2020, 2:21 PM Aleksandar Markovic < aleksandar.qemu.de...@gmail.com> wrote: > > > On Saturday, August 22, 2020, Aleksandar Markovic < > aleksandar.qemu.de...@gmail.com> wrote: > >> >> >> On Wednesday, August 19, 2020, Ahmed Karaman < >> ahmedkhaledkara...@gmail.com> wrote: >> >>> Host CPU : Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz >>> Host Memory : 15.49 GB >>> >>> Start Time (UTC) : 2020-08-19 21:00:01 >>> End Time (UTC) : 2020-08-19 21:32:15 >>> Execution Time : 0:32:14.021998 >>> >>> Status : SUCCESS >>> >>> -------------------------------------------------------- >>> >>> >>> I see we did not receive nightly report last night. The cause is most >> likely the change of our build system that happened yesterday. >> >> I think the best approach for you is to start tonight "from scratch". So, >> with source code tree and all past data deleted - as if you execute the >> nighlies for the first time ever. This will cause a fresh checkout, and a >> recreation of 5.1 and 'latest' perfirmace data. >> >> > Sorry, I envision some problems with the approach I described. I think you > should better create a separate source directory for reference 5.1 > measurements, and another source directory for all measurements from > tonight on. That way you will avoid switching between build systems from > within the same directory. > > Thanks, > Aleksandar > > > > >> Unrelated hint: >> >> Please include the following (or similar) text right before the tables >> with results: >> >> "'-----' denotes difference less than 0.01%." >> >> This way the readers will not be confused with '-----' meaning. >> >> Yours, >> Aleksandar >> >> >>> >>> SUMMARY REPORT - COMMIT 672b2f26 >>> -------------------------------------------------------- >>> AVERAGE RESULTS >>> -------------------------------------------------------- >>> Target Instructions Latest v5.1.0 >>> ---------- -------------------- ---------- ---------- >>> aarch64 2 118 484 879 ----- ----- >>> alpha 1 838 407 216 ----- ----- >>> arm 7 887 992 884 ----- ----- >>> hppa 4 124 996 474 ----- ----- >>> m68k 2 453 421 671 ----- ----- >>> mips 1 812 636 995 ----- ----- >>> mipsel 1 947 725 352 ----- ----- >>> mips64 1 862 495 613 ----- ----- >>> mips64el 1 984 211 702 ----- ----- >>> ppc 2 394 319 834 ----- ----- >>> ppc64 2 488 040 622 ----- ----- >>> ppc64le 2 470 198 016 ----- ----- >>> riscv64 1 367 774 718 ----- ----- >>> s390x 3 058 498 362 ----- ----- >>> sh4 2 278 490 061 ----- ----- >>> sparc64 3 186 999 246 ----- ----- >>> x86_64 1 734 475 394 ----- ----- >>> -------------------------------------------------------- >>> >>> DETAILED RESULTS >>> -------------------------------------------------------- >>> Test Program: dijkstra_double >>> -------------------------------------------------------- >>> Target Instructions Latest v5.1.0 >>> ---------- -------------------- ---------- ---------- >>> aarch64 3 019 613 303 ----- ----- >>> alpha 3 078 110 233 ----- ----- >>> arm 15 982 079 823 ----- ----- >>> hppa 7 012 014 505 ----- ----- >>> m68k 3 914 631 319 ----- ----- >>> mips 2 979 137 836 ----- ----- >>> mipsel 3 141 391 810 ----- ----- >>> mips64 3 163 713 203 ----- ----- >>> mips64el 3 314 105 619 ----- ----- >>> ppc 4 692 148 212 ----- ----- >>> ppc64 4 875 585 404 ----- ----- >>> ppc64le 4 859 857 200 ----- ----- >>> riscv64 2 150 267 230 ----- ----- >>> s390x 4 455 507 359 ----- ----- >>> sh4 3 816 841 775 ----- ----- >>> sparc64 4 399 783 149 ----- ----- >>> x86_64 2 441 371 746 ----- ----- >>> -------------------------------------------------------- >>> -------------------------------------------------------- >>> Test Program: dijkstra_int32 >>> -------------------------------------------------------- >>> Target Instructions Latest v5.1.0 >>> ---------- -------------------- ---------- ---------- >>> aarch64 2 177 687 656 ----- ----- >>> alpha 1 462 693 182 ----- ----- >>> arm 8 048 440 634 ----- ----- >>> hppa 5 053 362 217 ----- ----- >>> m68k 1 683 346 196 ----- ----- >>> mips 1 473 265 047 ----- ----- >>> mipsel 1 475 326 892 ----- ----- >>> mips64 1 683 560 350 ----- ----- >>> mips64el 1 663 467 060 ----- ----- >>> ppc 1 978 581 291 ----- ----- >>> ppc64 2 160 088 877 ----- ----- >>> ppc64le 2 151 841 575 ----- ----- >>> riscv64 1 323 226 597 ----- ----- >>> s390x 2 880 509 792 ----- ----- >>> sh4 1 938 787 291 ----- ----- >>> sparc64 2 768 217 627 ----- ----- >>> x86_64 1 521 726 675 ----- ----- >>> -------------------------------------------------------- >>> -------------------------------------------------------- >>> Test Program: matmult_double >>> -------------------------------------------------------- >>> Target Instructions Latest v5.1.0 >>> ---------- -------------------- ---------- ---------- >>> aarch64 1 408 042 295 ----- ----- >>> alpha 3 009 129 018 ----- ----- >>> arm 8 453 187 175 ----- ----- >>> hppa 3 334 593 464 ----- ----- >>> m68k 3 309 165 600 ----- ----- >>> mips 2 252 644 394 ----- ----- >>> mipsel 3 166 010 232 ----- ----- >>> mips64 2 266 660 274 ----- ----- >>> mips64el 3 179 408 969 ----- ----- >>> ppc 3 108 563 525 ----- ----- >>> ppc64 3 186 404 684 ----- ----- >>> ppc64le 3 186 105 591 ----- ----- >>> riscv64 1 218 230 013 ----- ----- >>> s390x 2 715 954 030 ----- ----- >>> sh4 3 330 300 193 ----- ----- >>> sparc64 3 197 860 268 ----- ----- >>> x86_64 1 244 922 914 ----- ----- >>> -------------------------------------------------------- >>> -------------------------------------------------------- >>> Test Program: matmult_int32 >>> -------------------------------------------------------- >>> Target Instructions Latest v5.1.0 >>> ---------- -------------------- ---------- ---------- >>> aarch64 595 215 814 ----- ----- >>> alpha 369 955 794 ----- ----- >>> arm 735 842 738 ----- ----- >>> hppa 666 414 556 ----- ----- >>> m68k 406 857 412 ----- ----- >>> mips 497 082 899 ----- ----- >>> mipsel 497 032 468 ----- ----- >>> mips64 478 686 174 ----- ----- >>> mips64el 462 210 845 ----- ----- >>> ppc 338 165 176 ----- ----- >>> ppc64 390 046 801 ----- ----- >>> ppc64le 390 236 162 ----- ----- >>> riscv64 348 989 619 ----- ----- >>> s390x 491 496 329 ----- ----- >>> sh4 399 095 487 ----- ----- >>> sparc64 490 124 541 ----- ----- >>> x86_64 399 613 899 ----- ----- >>> -------------------------------------------------------- >>> -------------------------------------------------------- >>> Test Program: qsort_double >>> -------------------------------------------------------- >>> Target Instructions Latest v5.1.0 >>> ---------- -------------------- ---------- ---------- >>> aarch64 2 645 742 637 ----- ----- >>> alpha 1 899 562 379 ----- ----- >>> arm 8 113 107 429 ----- ----- >>> hppa 3 098 469 739 ----- ----- >>> m68k 4 302 051 049 ----- ----- >>> mips 2 060 965 462 ----- ----- >>> mipsel 2 061 404 232 ----- ----- >>> mips64 1 933 231 416 ----- ----- >>> mips64el 1 930 636 000 ----- ----- >>> ppc 2 673 960 745 ----- ----- >>> ppc64 2 623 577 315 ----- ----- >>> ppc64le 2 580 240 728 ----- ----- >>> riscv64 1 575 021 518 ----- ----- >>> s390x 2 437 147 903 ----- ----- >>> sh4 2 520 101 855 ----- ----- >>> sparc64 3 882 349 298 ----- ----- >>> x86_64 1 969 776 338 ----- ----- >>> -------------------------------------------------------- >>> -------------------------------------------------------- >>> Test Program: qsort_int32 >>> -------------------------------------------------------- >>> Target Instructions Latest v5.1.0 >>> ---------- -------------------- ---------- ---------- >>> aarch64 2 131 273 662 ----- ----- >>> alpha 1 460 090 651 ----- ----- >>> arm 3 372 526 755 ----- ----- >>> hppa 2 196 131 815 ----- ----- >>> m68k 1 779 454 745 ----- ----- >>> mips 1 500 097 569 ----- ----- >>> mipsel 1 502 804 063 ----- ----- >>> mips64 1 497 347 136 ----- ----- >>> mips64el 1 476 627 156 ----- ----- >>> ppc 1 667 589 417 ----- ----- >>> ppc64 1 779 203 387 ----- ----- >>> ppc64le 1 728 565 582 ----- ----- >>> riscv64 1 288 897 227 ----- ----- >>> s390x 2 113 929 796 ----- ----- >>> sh4 1 878 433 512 ----- ----- >>> sparc64 3 353 723 284 ----- ----- >>> x86_64 1 751 619 062 ----- ----- >>> -------------------------------------------------------- >>> -------------------------------------------------------- >>> Test Program: qsort_string >>> -------------------------------------------------------- >>> Target Instructions Latest v5.1.0 >>> ---------- -------------------- ---------- ---------- >>> aarch64 2 529 811 267 ----- ----- >>> alpha 1 793 314 577 ----- ----- >>> arm 7 155 792 109 ----- ----- >>> hppa 4 595 956 496 ----- ----- >>> m68k 2 294 974 463 ----- ----- >>> mips 2 113 124 208 ----- ----- >>> mipsel 2 110 049 468 ----- ----- >>> mips64 1 967 925 447 ----- ----- >>> mips64el 1 950 320 901 ----- ----- >>> ppc 2 428 056 923 ----- ----- >>> ppc64 2 404 890 978 ----- ----- >>> ppc64le 2 385 487 957 ----- ----- >>> riscv64 1 563 271 793 ----- ----- >>> s390x 3 934 075 315 ----- ----- >>> sh4 2 097 732 542 ----- ----- >>> sparc64 4 131 589 952 ----- ----- >>> x86_64 2 864 598 485 ----- ----- >>> -------------------------------------------------------- >>> -------------------------------------------------------- >>> Test Program: search_string >>> -------------------------------------------------------- >>> Target Instructions Latest v5.1.0 >>> ---------- -------------------- ---------- ---------- >>> aarch64 2 440 492 400 ----- ----- >>> alpha 1 634 401 901 ----- ----- >>> arm 11 242 966 409 ----- ----- >>> hppa 7 043 029 003 ----- ----- >>> m68k 1 936 892 588 ----- ----- >>> mips 1 624 778 552 ----- ----- >>> mipsel 1 627 783 657 ----- ----- >>> mips64 1 908 840 910 ----- ----- >>> mips64el 1 896 917 069 ----- ----- >>> ppc 2 267 493 386 ----- ----- >>> ppc64 2 484 527 533 ----- ----- >>> ppc64le 2 479 249 335 ----- ----- >>> riscv64 1 474 293 752 ----- ----- >>> s390x 5 439 366 376 ----- ----- >>> sh4 2 246 627 833 ----- ----- >>> sparc64 3 272 345 849 ----- ----- >>> x86_64 1 682 174 033 ----- ----- >>> -------------------------------------------------------- >>> >>> >>> >>>
