** Also affects: linux (Ubuntu)
Importance: Undecided
Status: New
** Also affects: linux (Ubuntu Bionic)
Importance: Undecided
Status: New
** Description changed:
mem-on-off-test from memory-hotplug fails with timeout and blocked task,
although visible is also invalid argument/unexpected success on Bionic
4.15.0-141.145
This is not a regression as it happened on 4.15.0-139.143 too, though
passed all tests on 4.15.0-140.144.
This same test is reported as failing, though with different output on:
+ lp:1897764 and lp:1891003
- https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1897764
- https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1891003
-
+ -------------------
03/26 11:09:12 DEBUG| utils:0116| Running 'sudo sh -c 'echo 1 >
/proc/sys/net/ipv4/conf/all/accept_local''
03/26 11:09:12 DEBUG| utils:0116| Running 'sudo make -C
linux/tools/testing/selftests TARGETS=memory-hotplug run_tests'
03/26 11:09:12 DEBUG| utils:0153| [stdout] make: Entering directory
'/home/ubuntu/autotest/client/tmp/ubuntu_kernel_selftests/src/linux/tools/testing/selftests'
03/26 11:09:12 DEBUG| utils:0153| [stdout] make[1]: Entering directory
'/home/ubuntu/autotest/client/tmp/ubuntu_kernel_selftests/src/linux/tools/testing/selftests/memory-hotplug'
03/26 11:09:12 DEBUG| utils:0153| [stdout] make[1]: Nothing to be done
for 'all'.
03/26 11:09:12 DEBUG| utils:0153| [stdout] make[1]: Leaving directory
'/home/ubuntu/autotest/client/tmp/ubuntu_kernel_selftests/src/linux/tools/testing/selftests/memory-hotplug'
03/26 11:09:12 DEBUG| utils:0153| [stdout] make[1]: Entering directory
'/home/ubuntu/autotest/client/tmp/ubuntu_kernel_selftests/src/linux/tools/testing/selftests/memory-hotplug'
03/26 11:09:12 DEBUG| utils:0153| [stdout] ./mem-on-off-test.sh -r 2 &&
echo "selftests: memory-hotplug [PASS]" || echo "selftests: memory-hotplug
[FAIL]"
03/26 11:09:12 DEBUG| utils:0153| [stdout] Test scope: 2% hotplug memory
03/26 11:09:16 DEBUG| utils:0153| [stdout] online all
hot-pluggable memory in offline state:
03/26 11:09:16 DEBUG| utils:0153| [stdout] SKIPPED - no
hot-pluggable memory in offline state
03/26 11:09:20 DEBUG| utils:0153| [stdout] offline 2%
hot-pluggable memory in online state
03/26 11:09:20 DEBUG| utils:0153| [stdout] trying to offline 15
out of 748 memory block(s):
03/26 11:09:23 DEBUG| utils:0153| [stdout] online->offline memory10
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory100
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory101
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory102
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory103
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory104
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory105
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory106
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory107
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory108
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory109
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory11
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory110
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory111
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory112
03/26 11:09:28 DEBUG| utils:0153| [stdout] online all
hot-pluggable memory in offline state:
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory10
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory100
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory101
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory102
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory103
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory104
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory105
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory106
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory107
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory108
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory109
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory11
03/26 11:09:33 DEBUG| utils:0153| [stdout] offline->online memory110
03/26 11:09:33 DEBUG| utils:0153| [stdout] offline->online memory111
03/26 11:09:33 DEBUG| utils:0153| [stdout] offline->online memory112
03/26 11:09:33 DEBUG| utils:0153| [stdout] Test with memory
notifier error injection
03/26 11:09:37 ERROR| utils:0153| [stderr] ./mem-on-off-test.sh: line
263: echo: write error: Invalid argument
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 13:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 164:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 185:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 202:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 24:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 267:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 321:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 395:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 403:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 410:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 457:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 464:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 50:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 577:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 594:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 596:
unexpected success
03/26 11:09:46 ERROR| utils:0153| [stderr] ./mem-on-off-test.sh: line
279: echo: write error: Invalid argument
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail 10:
unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
100: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
101: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
102: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
103: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
104: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
105: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
106: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
107: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
108: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
109: unexpected success
+ -------------------
- On Bionic ibm-gt v4.15 kernel only on amd64 metal nodes rizzo and rumford has
a timeout of memory-hotplug from ubuntu_kernel_selftests:
+ On Bionic ibm-gt v4.15 kernel only on amd64 metal nodes rizzo and rumford
have a timeout of memory-hotplug from ubuntu_kernel_selftests:
-------------------
- 14121 14:49:30 ERROR| [stderr] offline_memory_expect_fail 5: unexpected
success
- 14122 14:56:12 ERROR| [stderr] offline_memory_expect_fail 62: unexpected
success
- 14123 14:56:12 ERROR| [stderr] offline_memory_expect_fail 63: unexpected
success
- 14124 15:19:22 INFO | Timer expired (1800 sec.), nuking pid 17231
- 14125 15:19:23 INFO | ERROR ubuntu_kernel_selftests.memory-hotplug
ubuntu_kernel_selftests.memory-hotplug timestamp=1625066363 localtime=Jun 30
15:19:23
+ 14121 14:49:30 ERROR| [stderr] offline_memory_expect_fail 5: unexpected
success
+ 14122 14:56:12 ERROR| [stderr] offline_memory_expect_fail 62: unexpected
success
+ 14123 14:56:12 ERROR| [stderr] offline_memory_expect_fail 63: unexpected
success
+ 14124 15:19:22 INFO | Timer expired (1800 sec.), nuking pid 17231
+ 14125 15:19:23 INFO | ERROR ubuntu_kernel_selftests.memory-hotplug
ubuntu_kernel_selftests.memory-hotplug timestamp=1625066363 localtime=Jun 30
15:19:23
-------------------
- In dmesg from next test:
+ In dmesg from a next test:
-------------------
[ 583.473311] Offlined Pages 32768
[ 583.476247] Offlined Pages 32768
[ 583.479028] Offlined Pages 32768
[ 583.481876] Offlined Pages 32768
[ 1088.798252] INFO: task systemd:1 blocked for more than 120 seconds.
[ 1088.798310] Not tainted 4.15.0-1098-ibm-gt #108-Ubuntu
[ 1088.798360] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[ 1088.798410] systemd D 0 1 0 0x00000000
[ 1088.798413] Call Trace:
[ 1088.798422] __schedule+0x24e/0x890
[ 1088.798426] schedule+0x2c/0x80
[ 1088.798428] schedule_preempt_disabled+0xe/0x10
[ 1088.798431] __mutex_lock.isra.5+0x276/0x4e0
[ 1088.798435] __mutex_lock_slowpath+0x13/0x20
[ 1088.798437] ? __mutex_lock_slowpath+0x13/0x20
[ 1088.798439] mutex_lock+0x2f/0x40
[ 1088.798444] proc_cgroup_show+0x4c/0x2a0
[ 1088.798449] proc_single_show+0x56/0x80
[ 1088.798453] seq_read+0xe5/0x450
[ 1088.798459] __vfs_read+0x1b/0x40
[ 1088.798462] vfs_read+0x8e/0x130
[ 1088.798466] SyS_read+0x5c/0xe0
[ 1088.798470] do_syscall_64+0x73/0x130
[ 1088.798474] entry_SYSCALL_64_after_hwframe+0x41/0xa6
[ 1088.798477] RIP: 0033:0x7fb5b16cf184
[ 1088.798478] RSP: 002b:00007fff21894aa0 EFLAGS: 00000246 ORIG_RAX:
0000000000000000
[ 1088.798481] RAX: ffffffffffffffda RBX: 0000000000000012 RCX:
00007fb5b16cf184
[ 1088.798482] RDX: 0000000000000400 RSI: 000056544b965d80 RDI:
0000000000000012
[ 1088.798484] RBP: 000056544b965d80 R08: 0000000000000000 R09:
00007fb5b12cc9ba
[ 1088.798485] R10: 0000000000000000 R11: 0000000000000246 R12:
0000000000000400
[ 1088.798486] R13: 00007fb5b19a72a0 R14: 000056544b8ad570 R15:
00000000000007ff
[ 1088.798497] INFO: task kworker/11:1:179 blocked for more than 120 seconds.
-------------------
** Description changed:
mem-on-off-test from memory-hotplug fails with timeout and blocked task,
although visible is also invalid argument/unexpected success on Bionic
4.15.0-141.145
This is not a regression as it happened on 4.15.0-139.143 too, though
passed all tests on 4.15.0-140.144.
This same test is reported as failing, though with different output on:
lp:1897764 and lp:1891003
-------------------
03/26 11:09:12 DEBUG| utils:0116| Running 'sudo sh -c 'echo 1 >
/proc/sys/net/ipv4/conf/all/accept_local''
03/26 11:09:12 DEBUG| utils:0116| Running 'sudo make -C
linux/tools/testing/selftests TARGETS=memory-hotplug run_tests'
03/26 11:09:12 DEBUG| utils:0153| [stdout] make: Entering directory
'/home/ubuntu/autotest/client/tmp/ubuntu_kernel_selftests/src/linux/tools/testing/selftests'
03/26 11:09:12 DEBUG| utils:0153| [stdout] make[1]: Entering directory
'/home/ubuntu/autotest/client/tmp/ubuntu_kernel_selftests/src/linux/tools/testing/selftests/memory-hotplug'
03/26 11:09:12 DEBUG| utils:0153| [stdout] make[1]: Nothing to be done
for 'all'.
03/26 11:09:12 DEBUG| utils:0153| [stdout] make[1]: Leaving directory
'/home/ubuntu/autotest/client/tmp/ubuntu_kernel_selftests/src/linux/tools/testing/selftests/memory-hotplug'
03/26 11:09:12 DEBUG| utils:0153| [stdout] make[1]: Entering directory
'/home/ubuntu/autotest/client/tmp/ubuntu_kernel_selftests/src/linux/tools/testing/selftests/memory-hotplug'
03/26 11:09:12 DEBUG| utils:0153| [stdout] ./mem-on-off-test.sh -r 2 &&
echo "selftests: memory-hotplug [PASS]" || echo "selftests: memory-hotplug
[FAIL]"
03/26 11:09:12 DEBUG| utils:0153| [stdout] Test scope: 2% hotplug memory
03/26 11:09:16 DEBUG| utils:0153| [stdout] online all
hot-pluggable memory in offline state:
03/26 11:09:16 DEBUG| utils:0153| [stdout] SKIPPED - no
hot-pluggable memory in offline state
03/26 11:09:20 DEBUG| utils:0153| [stdout] offline 2%
hot-pluggable memory in online state
03/26 11:09:20 DEBUG| utils:0153| [stdout] trying to offline 15
out of 748 memory block(s):
03/26 11:09:23 DEBUG| utils:0153| [stdout] online->offline memory10
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory100
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory101
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory102
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory103
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory104
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory105
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory106
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory107
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory108
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory109
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory11
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory110
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory111
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory112
03/26 11:09:28 DEBUG| utils:0153| [stdout] online all
hot-pluggable memory in offline state:
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory10
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory100
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory101
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory102
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory103
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory104
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory105
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory106
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory107
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory108
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory109
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory11
03/26 11:09:33 DEBUG| utils:0153| [stdout] offline->online memory110
03/26 11:09:33 DEBUG| utils:0153| [stdout] offline->online memory111
03/26 11:09:33 DEBUG| utils:0153| [stdout] offline->online memory112
03/26 11:09:33 DEBUG| utils:0153| [stdout] Test with memory
notifier error injection
03/26 11:09:37 ERROR| utils:0153| [stderr] ./mem-on-off-test.sh: line
263: echo: write error: Invalid argument
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 13:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 164:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 185:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 202:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 24:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 267:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 321:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 395:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 403:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 410:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 457:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 464:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 50:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 577:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 594:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 596:
unexpected success
03/26 11:09:46 ERROR| utils:0153| [stderr] ./mem-on-off-test.sh: line
279: echo: write error: Invalid argument
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail 10:
unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
100: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
101: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
102: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
103: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
104: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
105: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
106: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
107: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
108: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
109: unexpected success
-------------------
-
- On Bionic ibm-gt v4.15 kernel only on amd64 metal nodes rizzo and rumford
have a timeout of memory-hotplug from ubuntu_kernel_selftests:
+ On Bionic ibm-gt v4.15 kernel only on amd64 metal nodes rizzo and rumford has
a timeout of memory-hotplug from ubuntu_kernel_selftests:
-------------------
14121 14:49:30 ERROR| [stderr] offline_memory_expect_fail 5: unexpected
success
14122 14:56:12 ERROR| [stderr] offline_memory_expect_fail 62: unexpected
success
14123 14:56:12 ERROR| [stderr] offline_memory_expect_fail 63: unexpected
success
14124 15:19:22 INFO | Timer expired (1800 sec.), nuking pid 17231
14125 15:19:23 INFO | ERROR ubuntu_kernel_selftests.memory-hotplug
ubuntu_kernel_selftests.memory-hotplug timestamp=1625066363 localtime=Jun 30
15:19:23
-------------------
In dmesg from a next test:
-------------------
[ 583.473311] Offlined Pages 32768
[ 583.476247] Offlined Pages 32768
[ 583.479028] Offlined Pages 32768
[ 583.481876] Offlined Pages 32768
[ 1088.798252] INFO: task systemd:1 blocked for more than 120 seconds.
[ 1088.798310] Not tainted 4.15.0-1098-ibm-gt #108-Ubuntu
[ 1088.798360] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[ 1088.798410] systemd D 0 1 0 0x00000000
[ 1088.798413] Call Trace:
[ 1088.798422] __schedule+0x24e/0x890
[ 1088.798426] schedule+0x2c/0x80
[ 1088.798428] schedule_preempt_disabled+0xe/0x10
[ 1088.798431] __mutex_lock.isra.5+0x276/0x4e0
[ 1088.798435] __mutex_lock_slowpath+0x13/0x20
[ 1088.798437] ? __mutex_lock_slowpath+0x13/0x20
[ 1088.798439] mutex_lock+0x2f/0x40
[ 1088.798444] proc_cgroup_show+0x4c/0x2a0
[ 1088.798449] proc_single_show+0x56/0x80
[ 1088.798453] seq_read+0xe5/0x450
[ 1088.798459] __vfs_read+0x1b/0x40
[ 1088.798462] vfs_read+0x8e/0x130
[ 1088.798466] SyS_read+0x5c/0xe0
[ 1088.798470] do_syscall_64+0x73/0x130
[ 1088.798474] entry_SYSCALL_64_after_hwframe+0x41/0xa6
[ 1088.798477] RIP: 0033:0x7fb5b16cf184
[ 1088.798478] RSP: 002b:00007fff21894aa0 EFLAGS: 00000246 ORIG_RAX:
0000000000000000
[ 1088.798481] RAX: ffffffffffffffda RBX: 0000000000000012 RCX:
00007fb5b16cf184
[ 1088.798482] RDX: 0000000000000400 RSI: 000056544b965d80 RDI:
0000000000000012
[ 1088.798484] RBP: 000056544b965d80 R08: 0000000000000000 R09:
00007fb5b12cc9ba
[ 1088.798485] R10: 0000000000000000 R11: 0000000000000246 R12:
0000000000000400
[ 1088.798486] R13: 00007fb5b19a72a0 R14: 000056544b8ad570 R15:
00000000000007ff
[ 1088.798497] INFO: task kworker/11:1:179 blocked for more than 120 seconds.
-------------------
--
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1923113
Title:
mem-on-off-test from memory-hotplug in ubuntu_kernel_selftests fails
with blocked task on B/F/G/H
Status in ubuntu-kernel-tests:
Triaged
Status in linux package in Ubuntu:
New
Status in linux source package in Bionic:
New
Bug description:
mem-on-off-test from memory-hotplug fails with timeout and blocked
task, although visible is also invalid argument/unexpected success on
Bionic 4.15.0-141.145
This is not a regression as it happened on 4.15.0-139.143 too, though
passed all tests on 4.15.0-140.144.
This same test is reported as failing, though with different output
on: lp:1897764 and lp:1891003
-------------------
03/26 11:09:12 DEBUG| utils:0116| Running 'sudo sh -c 'echo 1 >
/proc/sys/net/ipv4/conf/all/accept_local''
03/26 11:09:12 DEBUG| utils:0116| Running 'sudo make -C
linux/tools/testing/selftests TARGETS=memory-hotplug run_tests'
03/26 11:09:12 DEBUG| utils:0153| [stdout] make: Entering directory
'/home/ubuntu/autotest/client/tmp/ubuntu_kernel_selftests/src/linux/tools/testing/selftests'
03/26 11:09:12 DEBUG| utils:0153| [stdout] make[1]: Entering directory
'/home/ubuntu/autotest/client/tmp/ubuntu_kernel_selftests/src/linux/tools/testing/selftests/memory-hotplug'
03/26 11:09:12 DEBUG| utils:0153| [stdout] make[1]: Nothing to be done
for 'all'.
03/26 11:09:12 DEBUG| utils:0153| [stdout] make[1]: Leaving directory
'/home/ubuntu/autotest/client/tmp/ubuntu_kernel_selftests/src/linux/tools/testing/selftests/memory-hotplug'
03/26 11:09:12 DEBUG| utils:0153| [stdout] make[1]: Entering directory
'/home/ubuntu/autotest/client/tmp/ubuntu_kernel_selftests/src/linux/tools/testing/selftests/memory-hotplug'
03/26 11:09:12 DEBUG| utils:0153| [stdout] ./mem-on-off-test.sh -r 2 &&
echo "selftests: memory-hotplug [PASS]" || echo "selftests: memory-hotplug
[FAIL]"
03/26 11:09:12 DEBUG| utils:0153| [stdout] Test scope: 2% hotplug memory
03/26 11:09:16 DEBUG| utils:0153| [stdout] online all
hot-pluggable memory in offline state:
03/26 11:09:16 DEBUG| utils:0153| [stdout] SKIPPED - no
hot-pluggable memory in offline state
03/26 11:09:20 DEBUG| utils:0153| [stdout] offline 2%
hot-pluggable memory in online state
03/26 11:09:20 DEBUG| utils:0153| [stdout] trying to offline 15
out of 748 memory block(s):
03/26 11:09:23 DEBUG| utils:0153| [stdout] online->offline memory10
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory100
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory101
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory102
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory103
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory104
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory105
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory106
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory107
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory108
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory109
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory11
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory110
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory111
03/26 11:09:24 DEBUG| utils:0153| [stdout] online->offline memory112
03/26 11:09:28 DEBUG| utils:0153| [stdout] online all
hot-pluggable memory in offline state:
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory10
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory100
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory101
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory102
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory103
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory104
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory105
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory106
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory107
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory108
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory109
03/26 11:09:32 DEBUG| utils:0153| [stdout] offline->online memory11
03/26 11:09:33 DEBUG| utils:0153| [stdout] offline->online memory110
03/26 11:09:33 DEBUG| utils:0153| [stdout] offline->online memory111
03/26 11:09:33 DEBUG| utils:0153| [stdout] offline->online memory112
03/26 11:09:33 DEBUG| utils:0153| [stdout] Test with memory
notifier error injection
03/26 11:09:37 ERROR| utils:0153| [stderr] ./mem-on-off-test.sh: line
263: echo: write error: Invalid argument
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 13:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 164:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 185:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 202:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 24:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 267:
unexpected success
03/26 11:09:41 ERROR| utils:0153| [stderr] online_memory_expect_fail 321:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 395:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 403:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 410:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 457:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 464:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 50:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 577:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 594:
unexpected success
03/26 11:09:42 ERROR| utils:0153| [stderr] online_memory_expect_fail 596:
unexpected success
03/26 11:09:46 ERROR| utils:0153| [stderr] ./mem-on-off-test.sh: line
279: echo: write error: Invalid argument
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail 10:
unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
100: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
101: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
102: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
103: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
104: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
105: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
106: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
107: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
108: unexpected success
03/26 11:09:50 ERROR| utils:0153| [stderr] offline_memory_expect_fail
109: unexpected success
-------------------
On Bionic ibm-gt v4.15 kernel only on amd64 metal nodes rizzo and rumford has
a timeout of memory-hotplug from ubuntu_kernel_selftests:
-------------------
14121 14:49:30 ERROR| [stderr] offline_memory_expect_fail 5: unexpected
success
14122 14:56:12 ERROR| [stderr] offline_memory_expect_fail 62: unexpected
success
14123 14:56:12 ERROR| [stderr] offline_memory_expect_fail 63: unexpected
success
14124 15:19:22 INFO | Timer expired (1800 sec.), nuking pid 17231
14125 15:19:23 INFO | ERROR ubuntu_kernel_selftests.memory-hotplug
ubuntu_kernel_selftests.memory-hotplug timestamp=1625066363 localtime=Jun 30
15:19:23
-------------------
In dmesg from a next test:
-------------------
[ 583.473311] Offlined Pages 32768
[ 583.476247] Offlined Pages 32768
[ 583.479028] Offlined Pages 32768
[ 583.481876] Offlined Pages 32768
[ 1088.798252] INFO: task systemd:1 blocked for more than 120 seconds.
[ 1088.798310] Not tainted 4.15.0-1098-ibm-gt #108-Ubuntu
[ 1088.798360] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[ 1088.798410] systemd D 0 1 0 0x00000000
[ 1088.798413] Call Trace:
[ 1088.798422] __schedule+0x24e/0x890
[ 1088.798426] schedule+0x2c/0x80
[ 1088.798428] schedule_preempt_disabled+0xe/0x10
[ 1088.798431] __mutex_lock.isra.5+0x276/0x4e0
[ 1088.798435] __mutex_lock_slowpath+0x13/0x20
[ 1088.798437] ? __mutex_lock_slowpath+0x13/0x20
[ 1088.798439] mutex_lock+0x2f/0x40
[ 1088.798444] proc_cgroup_show+0x4c/0x2a0
[ 1088.798449] proc_single_show+0x56/0x80
[ 1088.798453] seq_read+0xe5/0x450
[ 1088.798459] __vfs_read+0x1b/0x40
[ 1088.798462] vfs_read+0x8e/0x130
[ 1088.798466] SyS_read+0x5c/0xe0
[ 1088.798470] do_syscall_64+0x73/0x130
[ 1088.798474] entry_SYSCALL_64_after_hwframe+0x41/0xa6
[ 1088.798477] RIP: 0033:0x7fb5b16cf184
[ 1088.798478] RSP: 002b:00007fff21894aa0 EFLAGS: 00000246 ORIG_RAX:
0000000000000000
[ 1088.798481] RAX: ffffffffffffffda RBX: 0000000000000012 RCX:
00007fb5b16cf184
[ 1088.798482] RDX: 0000000000000400 RSI: 000056544b965d80 RDI:
0000000000000012
[ 1088.798484] RBP: 000056544b965d80 R08: 0000000000000000 R09:
00007fb5b12cc9ba
[ 1088.798485] R10: 0000000000000000 R11: 0000000000000246 R12:
0000000000000400
[ 1088.798486] R13: 00007fb5b19a72a0 R14: 000056544b8ad570 R15:
00000000000007ff
[ 1088.798497] INFO: task kworker/11:1:179 blocked for more than 120 seconds.
-------------------
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1923113/+subscriptions
--
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help : https://help.launchpad.net/ListHelp
