Source: catch2 Version: 3.7.1-0.2 Severity: serious Tags: ftbfs patch X-Debbugs-Cc: Sebastian Ramacher <sramac...@debian.org>
https://buildd.debian.org/status/fetch.php?pkg=catch2&arch=i386&ver=3.7.1-0.2&stamp=1729275595&raw=0 ... 71/71 Test #30: ApprovalTests ................................................***Failed Error regular expression found in output. Regex=[Results differed] 6.62 sec /<<PKGBUILDDIR>>/tools/scripts/approvalTests.py:124: SyntaxWarning: invalid escape sequence '\g' line = filelocParser.sub('\g<filename>:<line number>', line) /<<PKGBUILDDIR>>/tools/scripts/approvalTests.py:133: SyntaxWarning: invalid escape sequence '\g' line = tapTestNumParser.sub("\g<1> {test-number} -", line) /<<PKGBUILDDIR>>/tools/scripts/approvalTests.py:151: SyntaxWarning: invalid escape sequence '\g' line = specialCaseParser.sub('file:\g<1>', line) Running approvals against executable: /<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/SelfTest ['/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/SelfTest', '~[!nonportable]~[!benchmark]~[approvals] *', '--order', 'lex', '--rng-seed', '1', '--colour-mode', 'none'] console.std: [92mResults matched[0m ['/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/SelfTest', '~[!nonportable]~[!benchmark]~[approvals] *', '-s', '-w', 'NoAssertions', '-x', '4', '--order', 'lex', '--rng-seed', '1', '--colour-mode', 'none'] console.swa4: [92mResults matched[0m ['/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/SelfTest', '~[!nonportable]~[!benchmark]~[approvals] *', '-s', '-w', 'NoAssertions', '--order', 'lex', '--rng-seed', '1', '--colour-mode', 'none', '-r', 'console'] console.sw: --- console.sw.approved.txt +++ console.sw.unapproved.txt - 0.13015979861484195 + 0.13015979861484198 **************************** [91mResults differed[0m ['/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/SelfTest', '~[!nonportable]~[!benchmark]~[approvals] *', '-s', '-w', 'NoAssertions', '--order', 'lex', '--rng-seed', '1', '--colour-mode', 'none', '-r', 'junit'] junit.sw: [92mResults matched[0m ['/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/SelfTest', '~[!nonportable]~[!benchmark]~[approvals] *', '-s', '-w', 'NoAssertions', '--order', 'lex', '--rng-seed', '1', '--colour-mode', 'none', '-r', 'xml'] xml.sw: --- xml.sw.approved.txt +++ xml.sw.unapproved.txt - 0.13015979861484195 + 0.13015979861484198 **************************** [91mResults differed[0m ['/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/SelfTest', '~[!nonportable]~[!benchmark]~[approvals] *', '-s', '-w', 'NoAssertions', '--order', 'lex', '--rng-seed', '1', '--colour-mode', 'none', '-r', 'compact'] compact.sw: --- compact.sw.approved.txt +++ compact.sw.unapproved.txt -InternalBenchmark.tests.cpp:<line number>: passed: normal_quantile(0.551780) == Approx(0.13015979861484198) for: 0.13015979861484195 +InternalBenchmark.tests.cpp:<line number>: passed: normal_quantile(0.551780) == Approx(0.13015979861484198) for: 0.13015979861484198 **************************** [91mResults differed[0m ['/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/SelfTest', '~[!nonportable]~[!benchmark]~[approvals] *', '-s', '-w', 'NoAssertions', '--order', 'lex', '--rng-seed', '1', '--colour-mode', 'none', '-r', 'sonarqube'] sonarqube.sw: [92mResults matched[0m ['/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/SelfTest', '~[!nonportable]~[!benchmark]~[approvals] *', '-s', '-w', 'NoAssertions', '--order', 'lex', '--rng-seed', '1', '--colour-mode', 'none', '-r', 'tap'] tap.sw: --- tap.sw.approved.txt +++ tap.sw.unapproved.txt -ok {test-number} - normal_quantile(0.551780) == Approx(0.13015979861484198) for: 0.13015979861484195 == Approx( 0.13015979861484198 ) +ok {test-number} - normal_quantile(0.551780) == Approx(0.13015979861484198) for: 0.13015979861484198 == Approx( 0.13015979861484198 ) **************************** [91mResults differed[0m ['/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/SelfTest', '~[!nonportable]~[!benchmark]~[approvals] *', '-s', '-w', 'NoAssertions', '--order', 'lex', '--rng-seed', '1', '--colour-mode', 'none', '-r', 'teamcity'] teamcity.sw: [92mResults matched[0m ['/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/SelfTest', '~[!nonportable]~[!benchmark]~[approvals] *', '-s', '-w', 'NoAssertions', '--order', 'lex', '--rng-seed', '1', '--colour-mode', 'none', '-r', 'automake'] automake.sw: [92mResults matched[0m ['/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/SelfTest', '~[!nonportable]~[!benchmark]~[approvals] *', '-s', '-w', 'NoAssertions', '--order', 'lex', '--rng-seed', '1', '--colour-mode', 'none', '-r', 'console::out=/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/ApprovalTests/_console.sw.multi.tmp', '-r', 'junit::out=/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/ApprovalTests/_junit.sw.multi.tmp', '-r', 'xml::out=/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/ApprovalTests/_xml.sw.multi.tmp', '-r', 'compact::out=/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/ApprovalTests/_compact.sw.multi.tmp', '-r', 'sonarqube::out=/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/ApprovalTests/_sonarqube.sw.multi.tmp', '-r', 'tap::out=/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/ApprovalTests/_tap.sw.multi.tmp', '-r', 'teamcity::out=/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/ApprovalTests/_teamcity.sw.multi.tmp', '-r', 'automake::out=/<<PKGBUILDDIR>>/obj-i686-linux-gnu/tests/ApprovalTests/_automake.sw.multi.tmp'] default.sw.multi: [92mResults matched[0m console.sw.multi: --- console.sw.multi.approved.txt +++ console.sw.multi.unapproved.txt - 0.13015979861484195 + 0.13015979861484198 **************************** [91mResults differed[0m junit.sw.multi: [92mResults matched[0m xml.sw.multi: --- xml.sw.multi.approved.txt +++ xml.sw.multi.unapproved.txt - 0.13015979861484195 + 0.13015979861484198 **************************** [91mResults differed[0m compact.sw.multi: --- compact.sw.multi.approved.txt +++ compact.sw.multi.unapproved.txt -InternalBenchmark.tests.cpp:<line number>: passed: normal_quantile(0.551780) == Approx(0.13015979861484198) for: 0.13015979861484195 +InternalBenchmark.tests.cpp:<line number>: passed: normal_quantile(0.551780) == Approx(0.13015979861484198) for: 0.13015979861484198 **************************** [91mResults differed[0m sonarqube.sw.multi: [92mResults matched[0m tap.sw.multi: --- tap.sw.multi.approved.txt +++ tap.sw.multi.unapproved.txt -ok {test-number} - normal_quantile(0.551780) == Approx(0.13015979861484198) for: 0.13015979861484195 == Approx( 0.13015979861484198 ) +ok {test-number} - normal_quantile(0.551780) == Approx(0.13015979861484198) for: 0.13015979861484198 == Approx( 0.13015979861484198 ) **************************** [91mResults differed[0m teamcity.sw.multi: [92mResults matched[0m automake.sw.multi: [92mResults matched[0m If these differences are expected, run approve.py to approve new baselines. 99% tests passed, 1 tests failed out of 71 Label Time Summary: uses-python = 6.84 sec*proc (3 tests) Total Test time (real) = 6.63 sec The following tests FAILED: 30 - ApprovalTests (Failed) Errors while running CTest make[1]: *** [Makefile:94: test] Error 8 If such exact results are really required, the following removes the excess precision: --- debian/rules.old 2024-10-18 18:21:15.123934050 +0000 +++ debian/rules 2024-10-18 18:21:34.895915333 +0000 @@ -3,6 +3,10 @@ # Disable fixfilepath, as it triggers build failures. export DEB_BUILD_MAINT_OPTIONS=reproducible=-fixfilepath +ifeq ($(DEB_HOST_ARCH_CPU),i386) + export DEB_CXXFLAGS_MAINT_APPEND += -ffloat-store +endif + ifeq (,$(filter nocheck,$(DEB_BUILD_OPTIONS))) ENABLE_SELFTEST = ON else
