Public bug reported: I believe this started with the upgrade from 5.0.0-15-generic to 5.0.0-16-generic.
I'm running a ZFS RAID2 pool and one of the drives is faulted. I rebooted under 5.0.0-16-generic and the pool won't import, even with '-f'. zpool emits a kernel oops spa_load and any zfs tools run after that just hangs (the system itself seems fine otherwise). Trace included just incase the bug tool didn't pick it up. [ 1365.610907] BUG: unable to handle kernel NULL pointer dereference at 0000000000000000 [ 1365.610980] #PF error: [normal kernel read fault] [ 1365.611017] PGD 0 P4D 0 [ 1365.611042] Oops: 0000 [#1] SMP PTI [ 1365.611073] CPU: 2 PID: 5945 Comm: zpool Tainted: P O 5.0.0-16-generic #17-Ubuntu [ 1365.611139] Hardware name: Supermicro A1SRM-2758F/A1SRM-2758F, BIOS 2.1 01/19/2018 [ 1365.611270] RIP: 0010:spa_config_valid_zaps+0x43/0x70 [zfs] [ 1365.611315] Code: 00 00 48 8b 86 e0 26 00 00 48 89 87 e0 26 00 00 74 42 55 48 89 e5 41 55 49 89 f5 41 54 49 89 fc 53 31 db 49 8b 85 88 00 00 00 <48> 8b 34 d8 49 8b 84 24 88 00 00 00 48 8b 3c d8 48 83 c3 01 e8 a4 [ 1365.611450] RSP: 0018:ffffb59d43bc7c48 EFLAGS: 00010246 [ 1365.611492] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000001485 [ 1365.611546] RDX: ffff9fa181649780 RSI: ffff9fa1986d4000 RDI: ffff9fa17bdcc000 [ 1365.611600] RBP: ffffb59d43bc7c60 R08: 0000000000027060 R09: ffffffffc0bd5f53 [ 1365.611653] R10: ffffdda120059240 R11: ffff9fa1986a8000 R12: ffff9fa17bdcc000 [ 1365.611707] R13: ffff9fa1986d4000 R14: ffff9fa17bd94000 R15: ffff9fa1986d4000 [ 1365.611761] FS: 00007f8c91465780(0000) GS:ffff9fa1dfa80000(0000) knlGS:0000000000000000 [ 1365.611822] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1365.611866] CR2: 0000000000000000 CR3: 00000007fccd2000 CR4: 00000000001006e0 [ 1365.611920] Call Trace: [ 1365.612021] spa_load+0x14b4/0x21e0 [zfs] [ 1365.612121] spa_tryimport+0xaa/0x450 [zfs] [ 1365.612217] zfs_ioc_pool_tryimport+0x64/0xc0 [zfs] [ 1365.612317] zfsdev_ioctl+0x54e/0x630 [zfs] [ 1365.612357] do_vfs_ioctl+0xa9/0x640 [ 1365.612391] ? handle_mm_fault+0xe1/0x210 [ 1365.612426] ksys_ioctl+0x67/0x90 [ 1365.612456] __x64_sys_ioctl+0x1a/0x20 [ 1365.612489] do_syscall_64+0x5a/0x110 [ 1365.612522] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 1365.612563] RIP: 0033:0x7f8c915b3417 [ 1365.612595] Code: 00 00 90 48 8b 05 79 0a 0d 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 49 0a 0d 00 f7 d8 64 89 01 48 [ 1365.612731] RSP: 002b:00007fff14f9fd78 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [ 1365.612790] RAX: ffffffffffffffda RBX: 00007fff14f9fd90 RCX: 00007f8c915b3417 [ 1365.612844] RDX: 00007fff14f9fd90 RSI: 0000000000005a06 RDI: 0000000000000003 [ 1365.612897] RBP: 0000559b69acc160 R08: 0000559b69ae4af0 R09: 0000000008000000 [ 1365.612952] R10: fffffffffffff000 R11: 0000000000000246 R12: 0000559b69ace1e0 [ 1365.613005] R13: 0000559b69ada6f0 R14: 00007fff14fa3410 R15: 00007fff14fa3458 [ 1365.613062] Modules linked in: zfs(PO) zunicode(PO) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat nf_nat_ipv4 xt_addrtype iptable_filter bpfilter xt_conntrack nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc aufs overlay nls_iso8859_1 dm_multipath scsi_dh_rdac scsi_dh_emc scsi_dh_alua ipmi_ssif joydev input_leds intel_powerclamp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel intel_cstate ipmi_si ipmi_devintf mac_hid ipmi_msghandler sch_fq_codel nfsd auth_rpcgss nfs_acl lockd grace sunrpc ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi coretemp ip_tables x_tables autofs4 xfs btrfs zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear hid_generic usbhid hid ast ttm aesni_intel uas aes_x86_64 drm_kms_helper [ 1365.613113] syscopyarea usb_storage crypto_simd sysfillrect gpio_ich sysimgblt cryptd fb_sys_fops glue_helper ahci lpc_ich igb mpt3sas libahci i2c_i801 dca drm raid_class i2c_algo_bit scsi_transport_sas i2c_ismt [ 1365.624209] CR2: 0000000000000000 [ 1365.626489] ---[ end trace b55794841dc1b04f ]--- [ 1365.720954] RIP: 0010:spa_config_valid_zaps+0x43/0x70 [zfs] [ 1365.720957] Code: 00 00 48 8b 86 e0 26 00 00 48 89 87 e0 26 00 00 74 42 55 48 89 e5 41 55 49 89 f5 41 54 49 89 fc 53 31 db 49 8b 85 88 00 00 00 <48> 8b 34 d8 49 8b 84 24 88 00 00 00 48 8b 3c d8 48 83 c3 01 e8 a4 [ 1365.720959] RSP: 0018:ffffb59d43bc7c48 EFLAGS: 00010246 [ 1365.720962] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000001485 [ 1365.720963] RDX: ffff9fa181649780 RSI: ffff9fa1986d4000 RDI: ffff9fa17bdcc000 [ 1365.720964] RBP: ffffb59d43bc7c60 R08: 0000000000027060 R09: ffffffffc0bd5f53 [ 1365.720965] R10: ffffdda120059240 R11: ffff9fa1986a8000 R12: ffff9fa17bdcc000 [ 1365.720967] R13: ffff9fa1986d4000 R14: ffff9fa17bd94000 R15: ffff9fa1986d4000 [ 1365.720968] FS: 00007f8c91465780(0000) GS:ffff9fa1dfa80000(0000) knlGS:0000000000000000 [ 1365.720970] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1365.720971] CR2: 0000000000000000 CR3: 00000007fccd2000 CR4: 00000000001006e0 ProblemType: Bug DistroRelease: Ubuntu 19.04 Package: zfsutils-linux 0.7.12-1ubuntu5 ProcVersionSignature: Ubuntu 5.0.0-16.17-generic 5.0.8 Uname: Linux 5.0.0-16-generic x86_64 NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair ApportVersion: 2.20.10-0ubuntu27 Architecture: amd64 Date: Sat Jun 8 12:21:53 2019 ProcEnviron: LC_CTYPE=C.UTF-8 TERM=xterm-256color PATH=(custom, no user) LANG=C.UTF-8 SHELL=/bin/bash SourcePackage: zfs-linux UpgradeStatus: Upgraded to disco on 2019-04-20 (49 days ago) ** Affects: zfs-linux (Ubuntu) Importance: Undecided Status: New ** Tags: amd64 apport-bug disco uec-images -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to zfs-linux in Ubuntu. https://bugs.launchpad.net/bugs/1832088 Title: zpool import -f throws kernel Ooops Status in zfs-linux package in Ubuntu: New Bug description: I believe this started with the upgrade from 5.0.0-15-generic to 5.0.0-16-generic. I'm running a ZFS RAID2 pool and one of the drives is faulted. I rebooted under 5.0.0-16-generic and the pool won't import, even with '-f'. zpool emits a kernel oops spa_load and any zfs tools run after that just hangs (the system itself seems fine otherwise). Trace included just incase the bug tool didn't pick it up. [ 1365.610907] BUG: unable to handle kernel NULL pointer dereference at 0000000000000000 [ 1365.610980] #PF error: [normal kernel read fault] [ 1365.611017] PGD 0 P4D 0 [ 1365.611042] Oops: 0000 [#1] SMP PTI [ 1365.611073] CPU: 2 PID: 5945 Comm: zpool Tainted: P O 5.0.0-16-generic #17-Ubuntu [ 1365.611139] Hardware name: Supermicro A1SRM-2758F/A1SRM-2758F, BIOS 2.1 01/19/2018 [ 1365.611270] RIP: 0010:spa_config_valid_zaps+0x43/0x70 [zfs] [ 1365.611315] Code: 00 00 48 8b 86 e0 26 00 00 48 89 87 e0 26 00 00 74 42 55 48 89 e5 41 55 49 89 f5 41 54 49 89 fc 53 31 db 49 8b 85 88 00 00 00 <48> 8b 34 d8 49 8b 84 24 88 00 00 00 48 8b 3c d8 48 83 c3 01 e8 a4 [ 1365.611450] RSP: 0018:ffffb59d43bc7c48 EFLAGS: 00010246 [ 1365.611492] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000001485 [ 1365.611546] RDX: ffff9fa181649780 RSI: ffff9fa1986d4000 RDI: ffff9fa17bdcc000 [ 1365.611600] RBP: ffffb59d43bc7c60 R08: 0000000000027060 R09: ffffffffc0bd5f53 [ 1365.611653] R10: ffffdda120059240 R11: ffff9fa1986a8000 R12: ffff9fa17bdcc000 [ 1365.611707] R13: ffff9fa1986d4000 R14: ffff9fa17bd94000 R15: ffff9fa1986d4000 [ 1365.611761] FS: 00007f8c91465780(0000) GS:ffff9fa1dfa80000(0000) knlGS:0000000000000000 [ 1365.611822] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1365.611866] CR2: 0000000000000000 CR3: 00000007fccd2000 CR4: 00000000001006e0 [ 1365.611920] Call Trace: [ 1365.612021] spa_load+0x14b4/0x21e0 [zfs] [ 1365.612121] spa_tryimport+0xaa/0x450 [zfs] [ 1365.612217] zfs_ioc_pool_tryimport+0x64/0xc0 [zfs] [ 1365.612317] zfsdev_ioctl+0x54e/0x630 [zfs] [ 1365.612357] do_vfs_ioctl+0xa9/0x640 [ 1365.612391] ? handle_mm_fault+0xe1/0x210 [ 1365.612426] ksys_ioctl+0x67/0x90 [ 1365.612456] __x64_sys_ioctl+0x1a/0x20 [ 1365.612489] do_syscall_64+0x5a/0x110 [ 1365.612522] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 1365.612563] RIP: 0033:0x7f8c915b3417 [ 1365.612595] Code: 00 00 90 48 8b 05 79 0a 0d 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 49 0a 0d 00 f7 d8 64 89 01 48 [ 1365.612731] RSP: 002b:00007fff14f9fd78 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [ 1365.612790] RAX: ffffffffffffffda RBX: 00007fff14f9fd90 RCX: 00007f8c915b3417 [ 1365.612844] RDX: 00007fff14f9fd90 RSI: 0000000000005a06 RDI: 0000000000000003 [ 1365.612897] RBP: 0000559b69acc160 R08: 0000559b69ae4af0 R09: 0000000008000000 [ 1365.612952] R10: fffffffffffff000 R11: 0000000000000246 R12: 0000559b69ace1e0 [ 1365.613005] R13: 0000559b69ada6f0 R14: 00007fff14fa3410 R15: 00007fff14fa3458 [ 1365.613062] Modules linked in: zfs(PO) zunicode(PO) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat nf_nat_ipv4 xt_addrtype iptable_filter bpfilter xt_conntrack nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc aufs overlay nls_iso8859_1 dm_multipath scsi_dh_rdac scsi_dh_emc scsi_dh_alua ipmi_ssif joydev input_leds intel_powerclamp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel intel_cstate ipmi_si ipmi_devintf mac_hid ipmi_msghandler sch_fq_codel nfsd auth_rpcgss nfs_acl lockd grace sunrpc ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi coretemp ip_tables x_tables autofs4 xfs btrfs zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear hid_generic usbhid hid ast ttm aesni_intel uas aes_x86_64 drm_kms_helper [ 1365.613113] syscopyarea usb_storage crypto_simd sysfillrect gpio_ich sysimgblt cryptd fb_sys_fops glue_helper ahci lpc_ich igb mpt3sas libahci i2c_i801 dca drm raid_class i2c_algo_bit scsi_transport_sas i2c_ismt [ 1365.624209] CR2: 0000000000000000 [ 1365.626489] ---[ end trace b55794841dc1b04f ]--- [ 1365.720954] RIP: 0010:spa_config_valid_zaps+0x43/0x70 [zfs] [ 1365.720957] Code: 00 00 48 8b 86 e0 26 00 00 48 89 87 e0 26 00 00 74 42 55 48 89 e5 41 55 49 89 f5 41 54 49 89 fc 53 31 db 49 8b 85 88 00 00 00 <48> 8b 34 d8 49 8b 84 24 88 00 00 00 48 8b 3c d8 48 83 c3 01 e8 a4 [ 1365.720959] RSP: 0018:ffffb59d43bc7c48 EFLAGS: 00010246 [ 1365.720962] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000001485 [ 1365.720963] RDX: ffff9fa181649780 RSI: ffff9fa1986d4000 RDI: ffff9fa17bdcc000 [ 1365.720964] RBP: ffffb59d43bc7c60 R08: 0000000000027060 R09: ffffffffc0bd5f53 [ 1365.720965] R10: ffffdda120059240 R11: ffff9fa1986a8000 R12: ffff9fa17bdcc000 [ 1365.720967] R13: ffff9fa1986d4000 R14: ffff9fa17bd94000 R15: ffff9fa1986d4000 [ 1365.720968] FS: 00007f8c91465780(0000) GS:ffff9fa1dfa80000(0000) knlGS:0000000000000000 [ 1365.720970] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1365.720971] CR2: 0000000000000000 CR3: 00000007fccd2000 CR4: 00000000001006e0 ProblemType: Bug DistroRelease: Ubuntu 19.04 Package: zfsutils-linux 0.7.12-1ubuntu5 ProcVersionSignature: Ubuntu 5.0.0-16.17-generic 5.0.8 Uname: Linux 5.0.0-16-generic x86_64 NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair ApportVersion: 2.20.10-0ubuntu27 Architecture: amd64 Date: Sat Jun 8 12:21:53 2019 ProcEnviron: LC_CTYPE=C.UTF-8 TERM=xterm-256color PATH=(custom, no user) LANG=C.UTF-8 SHELL=/bin/bash SourcePackage: zfs-linux UpgradeStatus: Upgraded to disco on 2019-04-20 (49 days ago) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/zfs-linux/+bug/1832088/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp