Here's another one today. libwacom 2.9.0-1 has a clear regression detected by its superficial autopkgtest but Ubuntu'sbritney is reporting "Not a regression" for s390x.
The regression was reported as https://bugs.debian.org/1060687 and Debian's britney is correctly detecting it as an autopkgtest regression. https://autopkgtest.ubuntu.com/packages/libw/libwacom/noble/s390x https://ubuntu-archive-team.ubuntu.com/proposed- migration/update_excuses.html#libwacom ** Bug watch added: Debian Bug tracker #1060687 https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1060687 ** Attachment added: "libwacom-regression.png" https://bugs.launchpad.net/auto-package-testing/+bug/2035101/+attachment/5738844/+files/libwacom-regression.png -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https://bugs.launchpad.net/bugs/2035101 Title: autopkgtest failures are ignored, apparently for packages with only superficial tests Status in Auto Package Testing: New Status in britney: New Bug description: Example 1 ========= Yesterday, I noticed that gnome-metronome 1.3.0-0ubuntu2 was allowed to migrate from mantic-proposed to mantic despite its own autopkgtest failing on every architecture. This migration happened after an automatic migration-reference run happened which returned the result "neutral". "neutral" is expected for superficial autopkgtests like the one in gnome-metronome. Before that migration-reference run, the failures were correctly shown on the excuses page. Screenshots attached. https://autopkgtest.ubuntu.com/packages/gnome-metronome/mantic/amd64 (I then uploaded 1.3.0-0ubuntu3 which fixed the autopkgtest regression) Here's the gnome-metronome autopkgtest code: https://salsa.debian.org/a-wai/gnome-metronome/-/blob/debian/master/debian/tests/control Example 2 ========= https://ubuntu-archive-team.ubuntu.com/proposed-migration/update_excuses.html#webkit2gtk does not show that the 2.41 series of webkit2gtk triggered an autopkgtest failure for devhelp https://autopkgtest.ubuntu.com/packages/devhelp/mantic/amd64 However, Debian's britney is showing the failure: https://release.debian.org/britney/pseudo-excuses-experimental.html#webkit2gtk Here's the devhelp autopkgetst code: https://salsa.debian.org/gnome-team/devhelp/-/blob/debian/latest/debian/tests/control Theory ====== My theory is that failures are being ignored for packages which only have superficial autopkgtests, like for devhelp and gnome-metronome. Possibly, this issue has been fixed in Debian's copy of britney already To manage notifications about this bug go to: https://bugs.launchpad.net/auto-package-testing/+bug/2035101/+subscriptions -- Mailing list: https://launchpad.net/~canonical-ubuntu-qa Post to : canonical-ubuntu-qa@lists.launchpad.net Unsubscribe : https://launchpad.net/~canonical-ubuntu-qa More help : https://help.launchpad.net/ListHelp
