Found on O-6.11 generic: egede
--
You received this bug notification because you are a member of Canonical
Platform QA Team, which is subscribed to ubuntu-kernel-tests.
https://bugs.launchpad.net/bugs/2086505
Title:
cpuhotplug04 in cpuhotplug from ubuntu_ltp cause crash on some
instances
Status in ubuntu-kernel-tests:
New
Bug description:
This issue can be found on some newly added testflinger ARM64 nodes in
sru-20240930, nodes in our regular test poll are OK.
The syndrome is that the test will be cut-off after this cpuhotplug04
test and a sut-test failure will be emitted:
* N-6.8 generic: moigno
* N-nvidia: moigno
* J-lowlatency-6.8: igor
* J-nvidia-6.8: egede
* J-5.15 generic: egede (manually tested)
Test log will be like this:
ubuntu_ltp.cpuhotplug:cpuhotplug04 ubuntu_ltp.cpuhotplug:cpuhotplug04
timeout=6300 timestamp=1730138395 localtime=Oct 28 17:59:55
Persistent state client._record_indent now set to 2
Persistent state client.unexpected_reboot now set to
('ubuntu_ltp.cpuhotplug:cpuhotplug04', 'ubuntu_ltp.cpuhotplug:cpuhotplug04')
Waiting for pid 221194 for 6300 seconds
System python is too old, crash handling disabled
Timer expired (6300 sec.), nuking pid 221194
sut-test TEST SYSTEM FAILURE DETECTED Test results file
'/home/maas/workspace/noble-linux-nvidia-nvidia-arm64-6.8.0-moigno-ubuntu_ltp/kernel-results.xml'
not found.
And the system will stop responding here.
syslog output:
Nov 1 22:25:51 egede kernel: [ 355.328546] LTP: starting cpuhotplug04
(cpuhotplug04.sh -l 1)
Nov 1 22:25:51 egede kernel: [ 355.701819] psci: CPU0 killed (polled 0 ms)
Nov 1 22:25:51 egede kernel: [ 355.788613] psci: CPU1 killed (polled 0 ms)
Nov 1 22:25:51 egede kernel: [ 355.860620] psci: CPU2 killed (polled 0 ms)
Nov 1 22:25:51 egede kernel: [ 355.909010] psci: CPU3 killed (polled 0 ms)
Nov 1 22:25:51 egede kernel: [ 355.961015] psci: CPU4 killed (polled 0 ms)
Nov 1 22:25:51 egede kernel: [ 356.016965] psci: CPU5 killed (polled 0 ms)
Nov 1 22:25:51 egede kernel: [ 356.061219] psci: CPU6 killed (polled 0 ms)
Nov 1 22:25:51 egede kernel: [ 356.116911] psci: CPU7 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 356.164934] psci: CPU8 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 356.212882] psci: CPU9 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 356.260864] psci: CPU10 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 356.316862] psci: CPU11 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 356.364841] psci: CPU12 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 356.412586] psci: CPU13 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 356.468571] psci: CPU14 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 356.518197] psci: CPU15 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 356.584595] psci: CPU16 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 356.634149] psci: CPU17 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 356.682006] psci: CPU18 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 356.730002] psci: CPU19 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 356.780594] psci: CPU20 killed (polled 0 ms)
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ vgic(9) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ arch_timer(11) guessed as
class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ vtimer(12) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ arm-pmu(14) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ uart-pl011(15) guessed as
class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ fault(17) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ fault(19) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ fault(21) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ fault(23) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ aerdrv(26) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ PME(28) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ xhci_hcd(29) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ gpio_keys(30) guessed as
class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ i2c-thunderx(31) guessed as
class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ BGX0(38) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ ahci[0001:00:08.0](39)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ BGX1(46) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ i2c-thunderx(47) guessed as
class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox0(56) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox1(57) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ i2c-thunderx(58) guessed as
class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ i2c-thunderx(59) guessed as
class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ ahci[0001:00:09.0](60)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ xhci_hcd(61) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ i2c-thunderx(62) guessed as
class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v0-rxtx-0(63) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v0-rxtx-1(64) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v0-rxtx-2(65) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v0-rxtx-3(66) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v0-rxtx-4(67) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v0-rxtx-5(68) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v0-rxtx-6(69) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v0-rxtx-7(70) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v0-rbdr-0(79) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(81) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v0-qset-err-0(82)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ ahci[0001:00:0a.0](83)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v1-rxtx-0(84) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v1-rxtx-1(85) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v1-rxtx-2(86) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v1-rxtx-3(87) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v1-rxtx-4(88) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v1-rxtx-5(89) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v1-rxtx-6(90) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v1-rxtx-7(91) guessed
as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v1-rbdr-0(100)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(102) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v1-qset-err-0(103)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ ahci[0001:00:0b.0](104)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v2-rxtx-0(105)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v2-rxtx-1(106)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v2-rxtx-2(107)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v2-rxtx-3(108)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v2-rxtx-4(109)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v2-rxtx-5(110)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v2-rxtx-6(111)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v2-rxtx-7(112)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v2-rbdr-0(121)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(123) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v2-qset-err-0(124)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v3-rxtx-0(125)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v3-rxtx-1(126)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v3-rxtx-2(127)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v3-rxtx-3(128)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v3-rxtx-4(129)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v3-rxtx-5(130)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v3-rxtx-6(131)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v3-rxtx-7(132)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v3-rbdr-0(141)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(143) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v3-qset-err-0(144)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v4-rxtx-0(145)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v4-rxtx-1(146)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v4-rxtx-2(147)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v4-rxtx-3(148)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v4-rxtx-4(149)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v4-rxtx-5(150)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v4-rxtx-6(151)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v4-rxtx-7(152)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v4-rbdr-0(161)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(163) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ enP2p1s0v4-qset-err-0(164)
guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(183) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(203) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(223) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(243) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(263) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(283) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(303) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(323) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(343) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(363) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(383) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(403) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(423) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(443) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(463) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(483) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(503) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(523) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(543) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(563) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(583) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(603) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(623) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(643) guessed as class 0
Nov 1 22:25:52 egede kernel: [ 356.850326] psci: CPU21 killed (polled 0 ms)
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ Mbox(663) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ LMC(665) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ LMC(666) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ OCX(667) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ OCX(668) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ OCX(669) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ OCX(670) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(671) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(672) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(673) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(674) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(675) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(676) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(677) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(678) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(679) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(680) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(681) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(682) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(683) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(684) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(685) guessed as class 0
Nov 1 22:25:52 egede /usr/sbin/irqbalance: IRQ L2C(686) guessed as class 0
Nov 1 22:25:52 egede kernel: [ 356.932623] psci: CPU22 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 357.028992] psci: CPU23 killed (polled 0 ms)
Nov 1 22:25:52 egede kernel: [ 357.125009] psci: CPU24 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 357.228634] psci: CPU25 killed (polled 0 ms)
Nov 1 22:25:53 egede /usr/sbin/irqbalance: WARNING, didn't collect load info
for all cpus, balancing is broken
Nov 1 22:25:53 egede kernel: [ 357.284538] psci: CPU26 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 357.352557] psci: CPU27 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 357.396543] psci: CPU28 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 357.444544] psci: CPU29 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 357.492531] psci: CPU30 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 357.544545] psci: CPU31 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 357.616528] psci: CPU32 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 357.696532] psci: CPU33 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 357.760523] psci: CPU34 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 357.821987] psci: CPU35 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 357.872547] psci: CPU36 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 357.920524] psci: CPU37 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 357.976535] psci: CPU38 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 358.036525] psci: CPU39 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 358.092522] psci: CPU40 killed (polled 0 ms)
Nov 1 22:25:53 egede kernel: [ 358.132649] psci: CPU41 killed (polled 0 ms)
Nov 1 22:25:54 egede kernel: [ 358.176513] psci: CPU42 killed (polled 0 ms)
Nov 1 22:25:54 egede kernel: [ 358.248536] psci: CPU43 killed (polled 0 ms)
Nov 1 22:25:54 egede kernel: [ 358.304621] psci: CPU44 killed (polled 0 ms)
Nov 1 22:25:54 egede kernel: [ 358.356547] psci: CPU45 killed (polled 0 ms)
Nov 1 22:25:54 egede kernel: [ 358.394081] psci: CPU46 killed (polled 0 ms)
This test will try to offline all CPUs. The operation should fail when
trying to do so on the last remaining CPU. If it fails, then the test
will pass.
I can't do more investigation without console access.
With a manual test, even the offlining task has passed it still hangs
when trying to put those CPU back online.
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/2086505/+subscriptions
--
Mailing list: https://launchpad.net/~canonical-ubuntu-qa
Post to : canonical-ubuntu-qa@lists.launchpad.net
Unsubscribe : https://launchpad.net/~canonical-ubuntu-qa
More help : https://help.launchpad.net/ListHelp
