On Mon, 2026-08-17 at 12:51 +0200, Alexander Kanavin via lists.openembedded.org wrote: > On Sun, 16 Aug 2026 at 13:12, Paul Barker via lists.openembedded.org > <[email protected]> wrote: > > > I'm wondering why we haven't spotted this issue previously, we've been > > using Linux 6.18 for months now. Are we missing a test case? > > I suspect it's because the execution of useful cases for sdk and image > runtimes tends to regress due to 'soft-skip', e.g. if a needed package > isn't present, the test isn't run. I don't think this is quite right, > and each particular image and sdk should check that particular tests > do run, and if they aren't, that's a fail in itself. I'm not yet sure > how to technically implement this.
I've worried about this for a while too. We really need to mark up the images with the lists of tests we expect to pass. It is tricky as that list can vary depending on distro features and package classes but should be possible. The other option is to have resulttool have more checks where it compares to a list of tests we should see running. The regression report is supposed to partly handle that but if you miss a regression, the difference will no longer show it... Cheers, Richard
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#243619): https://lists.openembedded.org/g/openembedded-core/message/243619 Mute This Topic: https://lists.openembedded.org/mt/120728612/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
