------- Comment From dieg...@br.ibm.com 2017-12-20 08:19 EDT------- Hi, I did some tests on a LPAR machine. I got the following:
[root@tuletapio1-lp1 memory-hotplug]# sh ./mem-on-off-test.sh -r 80 [...] [ 204.004656] Offlined Pages 4096 [ 204.008378] Offlined Pages 4096 [ 204.012030] Offlined Pages 4096 [ 204.012201] Built 2 zonelists in Node order, mobility grouping on. Total pages: 92347 [ 204.012210] Policy zone: DMA [ 204.012283] ------------[ cut here ]------------ [ 204.012286] kernel BUG at /home/jsalisbury/bugs/lp1706247/zesty/ubuntu-zesty/mm/slub.c:3993! [ 204.012291] Oops: Exception in kernel mode, sig: 5 [#1] [ 204.012294] SMP NR_CPUS=2048 [ 204.012295] NUMA [ 204.012297] pSeries [ 204.012300] Modules linked in: xt_tcpudp ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter btrfs xor raid6_pq vmx_crypto ip_tables x_tables xfs libcrc32c ibmveth ibmvscsi crc32c_vpmsum autofs4 [last unloaded: notifier_error_inject] [ 204.012343] CPU: 18 PID: 6298 Comm: sh Not tainted 4.10.0-42-generic #46~lp1706247 [ 204.012347] task: c0000001f7dd8c00 task.stack: c0000001eef3c000 [ 204.012350] NIP: c000000000311134 LR: c000000000311148 CTR: c000000000310f40 [ 204.012353] REGS: c0000001eef3f6c0 TRAP: 0700 Not tainted (4.10.0-42-generic) [ 204.012356] MSR: 800000000282b033 <SF,VEC,VSX,EE,FP,ME,IR,DR,RI,LE> [ 204.012361] CR: 24222828 XER: 00000001 [ 204.012365] CFAR: c000000000311154 SOFTE: 1 GPR00: c000000000311148 c0000001eef3f940 c00000000145c900 0000000000000001 GPR04: c0000001fe010000 c0000001fe030000 c0000001fe030000 0000000000000000 GPR08: 0000000000000000 c0000001fe02fd88 0000000000000001 0000000000000000 GPR12: 0000000024222822 c00000000fb8a200 0000000000000bff f000000002ffffc0 GPR16: 0000000000000001 0000000000000000 c000000001483b00 0000000100001686 GPR20: 0000000000001000 0000000000000001 c0000001eef3fae0 c0000001ffec0600 GPR24: 0000000002fc0000 c0000000015ce368 f000000000000000 0000000000000000 GPR28: c000000001360738 0000000000000008 c000000001360758 c0000001fe02fd80 [ 204.012404] NIP [c000000000311134] slab_memory_callback+0x1f4/0x2b0 [ 204.012408] LR [c000000000311148] slab_memory_callback+0x208/0x2b0 [ 204.012410] Call Trace: [ 204.012413] [c0000001eef3f940] [c000000000311148] slab_memory_callback+0x208/0x2b0 (unreliable) [ 204.012419] [c0000001eef3f9a0] [c000000000112834] notifier_call_chain+0xa4/0x110 [ 204.012424] [c0000001eef3f9f0] [c000000000112d34] __blocking_notifier_call_chain+0x74/0xb0 [ 204.012429] [c0000001eef3fa40] [c000000000779a00] memory_notify+0x30/0x50 [ 204.012433] [c0000001eef3fa60] [c0000000003424cc] __offline_pages.constprop.8+0xa4c/0xa60 [ 204.012437] [c0000001eef3fbb0] [c000000000778afc] memory_block_action+0x9c/0x240 [ 204.012441] [c0000001eef3fc30] [c000000000779878] memory_subsys_offline+0x68/0xf0 [ 204.012446] [c0000001eef3fc60] [c00000000074fb84] device_offline+0xf4/0x130 [ 204.012449] [c0000001eef3fca0] [c0000000007797f8] store_mem_state+0x178/0x190 [ 204.012453] [c0000001eef3fce0] [c00000000074ac7c] dev_attr_store+0x3c/0x60 [ 204.012458] [c0000001eef3fd00] [c000000000405538] sysfs_kf_write+0x68/0xa0 [ 204.012461] [c0000001eef3fd20] [c0000000004043cc] kernfs_fop_write+0x17c/0x250 [ 204.012466] [c0000001eef3fd70] [c00000000034714c] __vfs_write+0x3c/0x70 [ 204.012470] [c0000001eef3fd90] [c000000000348bd4] vfs_write+0xd4/0x240 [ 204.012474] [c0000001eef3fde0] [c00000000034a788] SyS_write+0x68/0x110 [ 204.012478] [c0000001eef3fe30] [c00000000000b184] system_call+0x38/0xe0 [ 204.012481] Instruction dump: [ 204.012484] 3bffff98 419e0050 7bbd1f24 3b600000 60000000 60000000 60420000 7d3fea14 [ 204.012490] e8890108 2fa40000 419e001c e9440020 <0b0a0000> fb690108 3c62002d e863f9e0 [ 204.012497] ---[ end trace 3cd9645673a966d8 ]--- I did run twice to get this error with 80% of ratio (using the -r 80) to increase the chance to take some HugePage. This problem is not occuring on a PowerNV and it is different from the previous problem. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1724120 Title: Ubuntu 16.04.3 - call traces occurs when memory-hotplug test is run with 16Gb hugepages configured Status in The Ubuntu-power-systems project: Triaged Status in linux package in Ubuntu: In Progress Status in linux source package in Xenial: In Progress Status in linux source package in Zesty: In Progress Bug description: Issue: Call traces occurs when memory-hotplug script is run with 16Gb hugepages configured. Environment: ppc64le PowerVM Lpar root@ltctuleta-lp1:~# uname -r 4.4.0-34-generic root@ltctuleta-lp1:~# cat /proc/meminfo | grep -i huge AnonHugePages: 0 kB HugePages_Total: 2 HugePages_Free: 2 HugePages_Rsvd: 0 HugePages_Surp: 0 Hugepagesize: 16777216 kB root@ltctuleta-lp1:~# free -h total used free shared buff/cache available Mem: 85G 32G 52G 16M 193M 52G Swap: 43G 0B 43G Steps to reproduce: 1 - Download kernel source and enter to the directory- tools/testing/selftests/memory-hotplug/ 2 - Run mem-on-off-test.sh script in it. System gives call traces like: offline_memory_expect_success 639: unexpected fail online-offline 668 [ 57.552964] Unable to handle kernel paging request for data at address 0x00000028 [ 57.552977] Faulting instruction address: 0xc00000000029bc04 [ 57.552987] Oops: Kernel access of bad area, sig: 11 [#1] [ 57.552992] SMP NR_CPUS=2048 NUMA pSeries [ 57.553002] Modules linked in: btrfs xor raid6_pq pseries_rng sunrpc autofs4 ses enclosure nouveau bnx2x i2c_algo_bit ttm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops drm vxlan ip6_udp_tunnel ipr udp_tunnel rtc_generic mdio libcrc32c [ 57.553050] CPU: 44 PID: 6518 Comm: mem-on-off-test Not tainted 4.4.0-34-generic #53-Ubuntu [ 57.553059] task: c00000072773c8e0 ti: c000000727780000 task.ti: c000000727780000 [ 57.553067] NIP: c00000000029bc04 LR: c00000000029bbdc CTR: c0000000001107f0 [ 57.553076] REGS: c000000727783770 TRAP: 0300 Not tainted (4.4.0-34-generic) [ 57.553083] MSR: 8000000100009033 <SF,EE,ME,IR,DR,RI,LE> CR: 24242882 XER: 00000002 [ 57.553104] CFAR: c000000000008468 DAR: 0000000000000028 DSISR: 40000000 SOFTE: 1 GPR00: c00000000029bbdc c0000007277839f0 c0000000015b5d00 0000000000000000 GPR04: 000000000029d000 0000000000000800 0000000000000000 f00000000a000001 GPR08: f00000000a700020 0000000000000008 c00000000185e270 c000000e7e000050 GPR12: 0000000000002200 c00000000e6ea200 000000000029d000 0000000022000000 GPR16: 1000000000000000 c0000000015e2200 000000000a700000 0000000000000000 GPR20: 0000000000010000 0000000000000100 0000000000000200 c0000000015f16d0 GPR24: c000000001876510 0000000000000000 0000000000000001 c000000001872a00 GPR28: 000000000029d000 f000000000000000 f00000000a700000 000000000029c000 [ 57.553211] NIP [c00000000029bc04] dissolve_free_huge_pages+0x154/0x220 [ 57.553219] LR [c00000000029bbdc] dissolve_free_huge_pages+0x12c/0x220 [ 57.553226] Call Trace: [ 57.553231] [c0000007277839f0] [c00000000029bbdc] dissolve_free_huge_pages+0x12c/0x220 (unreliable) [ 57.553244] [c000000727783a80] [c0000000002dcbc8] __offline_pages.constprop.6+0x3f8/0x900 [ 57.553254] [c000000727783bd0] [c0000000006fbb38] memory_subsys_offline+0xa8/0x110 [ 57.553265] [c000000727783c00] [c0000000006d6424] device_offline+0x104/0x140 [ 57.553274] [c000000727783c40] [c0000000006fba80] store_mem_state+0x180/0x190 [ 57.553283] [c000000727783c80] [c0000000006d1e58] dev_attr_store+0x68/0xa0 [ 57.553293] [c000000727783cc0] [c000000000398110] sysfs_kf_write+0x80/0xb0 [ 57.553302] [c000000727783d00] [c000000000397028] kernfs_fop_write+0x188/0x200 [ 57.553312] [c000000727783d50] [c0000000002e190c] __vfs_write+0x6c/0xe0 [ 57.553321] [c000000727783d90] [c0000000002e2640] vfs_write+0xc0/0x230 [ 57.553329] [c000000727783de0] [c0000000002e367c] SyS_write+0x6c/0x110 [ 57.553339] [c000000727783e30] [c000000000009204] system_call+0x38/0xb4 [ 57.553346] Instruction dump: [ 57.553351] 7e831836 4bfff991 e91e0028 e8fe0020 7d32e82a f9070008 f8e80000 fabe0020 [ 57.553366] fade0028 79294620 79291764 7d234a14 <e9030028> 3908ffff f9030028 81091458 [ 57.553383] ---[ end trace 617f7bdd75bcfc10 ]--- [ 57.557133] Segmentation fault The following commit IDs were built into a 4.10.0-37-generic #41 test kernel and verified to fix the problem: a525108cf1cc14651602d678da38fa627a76a724 e1073d1e7920946ac4776a619cc40668b9e1401b 40692eb5eea209c2dd55857f44b4e1d7206e91d6 e24a1307ba1f99fc62a0bd61d5e87fcfb6d5503d 79cc38ded1e1ac86e69c90f604efadd50b0b3762 4ae279c2c96ab38a78b954d218790a8f6db714e5 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-power-systems/+bug/1724120/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
