On Tue Mar 3, 2026 at 6:20 PM CET, Ross Burton via lists.openembedded.org wrote:
> I discovered that running a single test case with tcltest doesn't let
> you know if the test failed or not, so when run-ptest moved away from
> using all.tcl[1] we were always marking the tests as passing.
>
> So, revert that commit and use all.tcl as a test runner. This is more
> noisy, but importantly will let us know if a test failed.
>
> Remove our un-upstreamable tweaks to the interp tests and instead skip
> the test that is known to be fragile, so we don't have to carry a patch
> forever.
>
> Don't install another copy of the entire Tcl library for the tests, as
> there is no real point. This does then expose a bug in the tests where
> clock-59.2 assumes that it is running in a source tree and behaves
> differently if the system tzdata is being used. This is being worked on
> upstream[2], for now skip this test.
>
> Clean up musl overriding so it's more resiliant.
>
> Exit 1 if a test fails.
>
> [1] oe-core 9c41887f2a ("tcl: improve test execution loop")
> [2]
> https://core.tcl-lang.org/tcl/tktview/51aa53616067cb63900b17ca1d71f07b094ffa1a
>
> Signed-off-by: Ross Burton <[email protected]>
> ---
Hi Ross,
So now, of course we have ptest failures :)
Both for tcl and tcl8:
Failed ptests:
{'tcl8': ['tests/unixFile.test']}
...
Failed ptests:
{'tcl': ['tests/cmdAH.test', 'tests/unixFile.test', 'tests/zipfs.test']}
https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/3180
https://autobuilder.yoctoproject.org/valkyrie/#/builders/73/builds/3209
Ptest logs are there:
https://valkyrie.yocto.io/pub/non-release/20260305-50/testresults/qemuarm64-ptest/core-image-ptest-tcl8/
https://valkyrie.yocto.io/pub/non-release/20260305-50/testresults/qemuarm64-ptest/core-image-ptest-tcl/
https://valkyrie.yocto.io/pub/non-release/20260305-50/testresults/qemux86-64-ptest/core-image-ptest-tcl8/
https://valkyrie.yocto.io/pub/non-release/20260305-50/testresults/qemux86-64-ptest/core-image-ptest-tcl/
Can you have a look at these?
Thanks,
Mathieu
--
Mathieu Dubois-Briand, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#232469):
https://lists.openembedded.org/g/openembedded-core/message/232469
Mute This Topic: https://lists.openembedded.org/mt/118117354/21656
Group Owner: [email protected]
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub
[[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-
