problem repeats: Jun 17 23:28:06 nl100 kernel: [89832.101712] Modules linked in: binfmt_misc msr amd64_edac_mod edac_mce_amd kvm_amd kvm irqbypass crct10dif_pclmul efi_pstore crc32_pclmul ghash_clmulni_intel efivars pcspkr ipmi_ssif nls_ascii nls_cp437 vfat fat ast ttm joydev drm_kms_helper drm ccp i2c_algo_bit evdev rng_core sp5100_tco ipmi_si ipmi_devintf ipmi_msghandler pcc_cpufreq acpi_cpufreq button tcp_bbr sch_fq aufs(OE) efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic fscrypto ecb hid_generic usbhid hid crc32c_intel aesni_intel aes_x86_64 crypto_simd mlx5_core(OE) cryptd glue_helper mlxfw(OE) psample ahci mlxdevm(OE) auxiliary(OE) libahci xhci_pci xhci_hcd mlx_compat(OE) libata nvme usbcore devlink scsi_mod nvme_core i2c_piix4 usb_common Jun 17 23:28:06 nl100 kernel: [89832.101756] CPU: 51 PID: 96472 Comm: nginx Tainted: G W OEL 4.19.0-20-amd64 #1 Debian 4.19.235-1 Jun 17 23:28:06 nl100 kernel: [89832.101757] Hardware name: Supermicro AS -1124US-TNRP/H12DSU-iN, BIOS 2.3a 03/03/2022 Jun 17 23:28:06 nl100 kernel: [89832.101764] RIP: 0010:_raw_spin_unlock_irqrestore+0x11/0x20 Jun 17 23:28:06 nl100 kernel: [89832.101767] Code: d8 48 3d 90 d0 03 00 76 cc 80 4d 00 08 eb 98 90 90 90 90 90 90 90 90 90 90 0f 1f 44 00 00 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 c3 66 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 8b 07 Jun 17 23:28:06 nl100 kernel: [89832.101767] RSP: 0018:ffff91564d8c3e88 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff13 Jun 17 23:28:06 nl100 kernel: [89832.101769] RAX: 0000000000000066 RBX: ffffd27afe4c4020 RCX: 000000008040003b Jun 17 23:28:06 nl100 kernel: [89832.101769] RDX: 000000008040003c RSI: 0000000000000282 RDI: 0000000000000282 Jun 17 23:28:06 nl100 kernel: [89832.101770] RBP: 000000000000005b R08: 0000000000000000 R09: ffffffffb3ef6000 Jun 17 23:28:06 nl100 kernel: [89832.101770] R10: ffff910d717a7c00 R11: 0000000000000001 R12: ffff915637c5f858 Jun 17 23:28:06 nl100 kernel: [89832.101771] R13: 0000000000000282 R14: ffff915637c5f140 R15: ffffd27afe4c6028 Jun 17 23:28:06 nl100 kernel: [89832.101772] FS: 00007ffff7783b80(0000) GS:ffff91564d8c0000(0000) knlGS:0000000000000000 Jun 17 23:28:06 nl100 kernel: [89832.101772] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jun 17 23:28:06 nl100 kernel: [89832.101773] CR2: 00007ffff7f8f8c0 CR3: 00000176fe4a8000 CR4: 0000000000340ee0 Jun 17 23:28:06 nl100 kernel: [89832.101773] Call Trace: Jun 17 23:28:06 nl100 kernel: [89832.101776] <IRQ> Jun 17 23:28:06 nl100 kernel: [89832.101781] fq_flush_timeout+0x6a/0x90 Jun 17 23:28:06 nl100 kernel: [89832.101784] ? fq_ring_free+0xd0/0xd0 Jun 17 23:28:06 nl100 kernel: [89832.101788] call_timer_fn+0x2b/0x130 Jun 17 23:28:06 nl100 kernel: [89832.101790] run_timer_softirq+0x1c7/0x3e0 Jun 17 23:28:06 nl100 kernel: [89832.101794] ? recalibrate_cpu_khz+0x10/0x10 Jun 17 23:28:06 nl100 kernel: [89832.101795] ? ktime_get+0x3a/0xa0 Jun 17 23:28:06 nl100 kernel: [89832.101797] __do_softirq+0xde/0x2d8 Jun 17 23:28:06 nl100 kernel: [89832.101800] irq_exit+0xba/0xc0 Jun 17 23:28:06 nl100 kernel: [89832.101802] smp_apic_timer_interrupt+0x74/0x140 Jun 17 23:28:06 nl100 kernel: [89832.101804] apic_timer_interrupt+0xf/0x20 Jun 17 23:28:06 nl100 kernel: [89832.101805] </IRQ> Jun 17 23:28:06 nl100 kernel: [89832.101806] RIP: 0010:_raw_spin_unlock_irqrestore+0x11/0x20 Jun 17 23:28:06 nl100 kernel: [89832.101807] Code: d8 48 3d 90 d0 03 00 76 cc 80 4d 00 08 eb 98 90 90 90 90 90 90 90 90 90 90 0f 1f 44 00 00 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 c3 66 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 8b 07 Jun 17 23:28:06 nl100 kernel: [89832.101807] RSP: 0018:ffffb27b1e963638 EFLAGS: 00000293 ORIG_RAX: ffffffffffffff13 Jun 17 23:28:06 nl100 kernel: [89832.101808] RAX: ffff9155ca566880 RBX: ffff915637c5f140 RCX: ffff9155ca566880 Jun 17 23:28:06 nl100 kernel: [89832.101809] RDX: ffff9155d0a7ce40 RSI: 0000000000000293 RDI: 0000000000000293 Jun 17 23:28:06 nl100 kernel: [89832.101809] RBP: 0000000000000078 R08: 0000000001580000 R09: ffff9155dbe9de80 Jun 17 23:28:06 nl100 kernel: [89832.101810] R10: 0000000000000000 R11: ffff914aa5ee6000 R12: ffff9155dbe9de80 Jun 17 23:28:06 nl100 kernel: [89832.101810] R13: 0000000000000080 R14: ffffffffffffff80 R15: ffffffffffffff80 Jun 17 23:28:06 nl100 kernel: [89832.101812] alloc_iova+0x11f/0x140 Jun 17 23:28:06 nl100 kernel: [89832.101813] alloc_iova_fast+0x56/0x250 Jun 17 23:28:06 nl100 kernel: [89832.101817] ? __kmalloc+0x180/0x220 Jun 17 23:28:06 nl100 kernel: [89832.101820] ? mempool_alloc+0x67/0x190 Jun 17 23:28:06 nl100 kernel: [89832.101821] dma_ops_alloc_iova.isra.28+0x4b/0x70 Jun 17 23:28:06 nl100 kernel: [89832.101822] map_sg+0x73/0x1f0 Jun 17 23:28:06 nl100 kernel: [89832.101827] nvme_queue_rq+0x1e7/0x9e0 [nvme] Jun 17 23:28:06 nl100 kernel: [89832.101831] ? __sbitmap_queue_get+0x24/0x90 Jun 17 23:28:06 nl100 kernel: [89832.101834] ? blk_mq_get_tag+0x236/0x260 Jun 17 23:28:06 nl100 kernel: [89832.101835] ? nvme_queue_rq+0x4d2/0x9e0 [nvme] Jun 17 23:28:06 nl100 kernel: [89832.101838] ? finish_wait+0x80/0x80 Jun 17 23:28:06 nl100 kernel: [89832.101839] blk_mq_dispatch_rq_list+0x392/0x590 Jun 17 23:28:06 nl100 kernel: [89832.101840] ? remove_wait_queue+0x60/0x60 Jun 17 23:28:06 nl100 kernel: [89832.101842] blk_mq_sched_dispatch_requests+0xf0/0x170 Jun 17 23:28:06 nl100 kernel: [89832.101845] __blk_mq_run_hw_queue+0x4e/0xe0 Jun 17 23:28:06 nl100 kernel: [89832.101847] __blk_mq_delay_run_hw_queue+0x143/0x160 Jun 17 23:28:06 nl100 kernel: [89832.101848] blk_mq_run_hw_queue+0x88/0x110 Jun 17 23:28:06 nl100 kernel: [89832.101849] __blk_mq_try_issue_directly+0x8e/0x1c0 Jun 17 23:28:06 nl100 kernel: [89832.101850] ? recalibrate_cpu_khz+0x10/0x10 Jun 17 23:28:06 nl100 kernel: [89832.101851] ? ktime_get+0x3a/0xa0 Jun 17 23:28:06 nl100 kernel: [89832.101852] blk_mq_try_issue_directly+0x30/0xb0 Jun 17 23:28:06 nl100 kernel: [89832.101853] blk_mq_make_request+0x332/0x530 Jun 17 23:28:06 nl100 kernel: [89832.101855] generic_make_request+0x1a4/0x400 Jun 17 23:28:06 nl100 kernel: [89832.101856] ? __add_to_page_cache_locked+0x1df/0x240 Jun 17 23:28:06 nl100 kernel: [89832.101857] submit_bio+0x45/0x130 Jun 17 23:28:06 nl100 kernel: [89832.101858] ? add_to_page_cache_lru+0x74/0xe0 Jun 17 23:28:06 nl100 kernel: [89832.101861] ? bio_add_page+0x48/0x60 Jun 17 23:28:06 nl100 kernel: [89832.101876] ext4_mpage_readpages+0x4c3/0x860 [ext4] Jun 17 23:28:06 nl100 kernel: [89832.101880] read_pages+0x6b/0x190 Jun 17 23:28:06 nl100 kernel: [89832.101882] __do_page_cache_readahead+0x1c1/0x1e0 Jun 17 23:28:06 nl100 kernel: [89832.101883] ondemand_readahead+0x1f9/0x2c0 Jun 17 23:28:06 nl100 kernel: [89832.101885] generic_file_read_iter+0x742/0xbc0 Jun 17 23:28:06 nl100 kernel: [89832.101888] ? sock_write_iter+0x97/0x100 Jun 17 23:28:06 nl100 kernel: [89832.101891] new_sync_read+0xf8/0x160 Jun 17 23:28:06 nl100 kernel: [89832.101893] vfs_read+0x91/0x140 Jun 17 23:28:06 nl100 kernel: [89832.101895] ksys_pread64+0x61/0xa0 Jun 17 23:28:06 nl100 kernel: [89832.101899] do_syscall_64+0x53/0x110 Jun 17 23:28:06 nl100 kernel: [89832.101901] entry_SYSCALL_64_after_hwframe+0x44/0xa9 Jun 17 23:28:06 nl100 kernel: [89832.101902] RIP: 0033:0x7ffff7fb1df4 Jun 17 23:28:06 nl100 kernel: [89832.101904] Code: d8 64 89 02 b8 ff ff ff ff eb c5 66 2e 0f 1f 84 00 00 00 00 00 90 8b 05 5a e6 00 00 49 89 ca 85 c0 75 13 b8 11 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5c c3 0f 1f 00 41 55 49 89 cd 41 54 49 89 d4 Jun 17 23:28:06 nl100 kernel: [89832.101904] RSP: 002b:00007fffffffe5d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000011 Jun 17 23:28:06 nl100 kernel: [89832.101905] RAX: ffffffffffffffda RBX: 000055555a2ed388 RCX: 00007ffff7fb1df4 Jun 17 23:28:06 nl100 kernel: [89832.101906] RDX: 0000000000100000 RSI: 000055555d16a8b0 RDI: 00000000000000d2 Jun 17 23:28:06 nl100 kernel: [89832.101906] RBP: 000055555a2ed050 R08: 000055555a2ed050 R09: 0000000000000001 Jun 17 23:28:06 nl100 kernel: [89832.101907] R10: 000000001e343d86 R11: 0000000000000246 R12: 0000000000100000 Jun 17 23:28:06 nl100 kernel: [89832.101907] R13: 00007fffffffe630 R14: 0000000000000001 R15: 000055555a2ed000 Jun 17 23:28:06 nl100 kernel: [89832.298856] Sending NMI from CPU 82 to CPUs 51: Jun 17 23:28:06 nl100 kernel: [89832.299866] NMI backtrace for cpu 51 Jun 17 23:28:06 nl100 kernel: [89832.299867] CPU: 51 PID: 96472 Comm: nginx Tainted: G W OEL 4.19.0-20-amd64 #1 Debian 4.19.235-1 Jun 17 23:28:06 nl100 kernel: [89832.299867] Hardware name: Supermicro AS -1124US-TNRP/H12DSU-iN, BIOS 2.3a 03/03/2022 Jun 17 23:28:06 nl100 kernel: [89832.299868] RIP: 0010:native_queued_spin_lock_slowpath+0x52/0x190 Jun 17 23:28:06 nl100 kernel: [89832.299869] Code: 74 37 81 e6 00 ff ff ff 75 5f f0 0f ba 2f 08 8b 07 72 56 89 c2 30 e6 a9 00 00 ff ff 75 47 85 d2 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 c3 8b 37 81 fe 00 01 00 Jun 17 23:28:06 nl100 kernel: [89832.299869] RSP: 0018:ffff91564d8c3e78 EFLAGS: 00000002 Jun 17 23:28:06 nl100 kernel: [89832.299870] RAX: 0000000000000101 RBX: 0000000000000282 RCX: 0000000000000061 Jun 17 23:28:06 nl100 kernel: [89832.299870] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffffd27afe646028 Jun 17 23:28:06 nl100 kernel: [89832.299870] RBP: 0000000000000061 R08: 0000000000000000 R09: ffffffffb3ef6001 Jun 17 23:28:06 nl100 kernel: [89832.299870] R10: ffff9155e7cbdd00 R11: 0000000000000001 R12: ffff915637c5f858 Jun 17 23:28:06 nl100 kernel: [89832.299871] R13: 0000000000000282 R14: ffff915637c5f140 R15: ffffd27afe646028 Jun 17 23:28:06 nl100 kernel: [89832.299871] FS: 00007ffff7783b80(0000) GS:ffff91564d8c0000(0000) knlGS:0000000000000000 Jun 17 23:28:06 nl100 kernel: [89832.299871] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jun 17 23:28:06 nl100 kernel: [89832.299871] CR2: 00007ffff7f8f8c0 CR3: 00000176fe4a8000 CR4: 0000000000340ee0 Jun 17 23:28:06 nl100 kernel: [89832.299872] Call Trace: Jun 17 23:28:06 nl100 kernel: [89832.299872] <IRQ> Jun 17 23:28:06 nl100 kernel: [89832.299872] _raw_spin_lock_irqsave+0x32/0x40 Jun 17 23:28:06 nl100 kernel: [89832.299872] fq_flush_timeout+0x51/0x90 Jun 17 23:28:06 nl100 kernel: [89832.299872] ? fq_ring_free+0xd0/0xd0 Jun 17 23:28:06 nl100 kernel: [89832.299873] call_timer_fn+0x2b/0x130 Jun 17 23:28:06 nl100 kernel: [89832.299873] run_timer_softirq+0x1c7/0x3e0 Jun 17 23:28:06 nl100 kernel: [89832.299873] ? recalibrate_cpu_khz+0x10/0x10 Jun 17 23:28:06 nl100 kernel: [89832.299873] ? ktime_get+0x3a/0xa0 Jun 17 23:28:06 nl100 kernel: [89832.299873] __do_softirq+0xde/0x2d8 Jun 17 23:28:06 nl100 kernel: [89832.299874] irq_exit+0xba/0xc0 Jun 17 23:28:06 nl100 kernel: [89832.299874] smp_apic_timer_interrupt+0x74/0x140 Jun 17 23:28:06 nl100 kernel: [89832.299874] apic_timer_interrupt+0xf/0x20 Jun 17 23:28:06 nl100 kernel: [89832.299874] </IRQ> Jun 17 23:28:06 nl100 kernel: [89832.299874] RIP: 0010:_raw_spin_unlock_irqrestore+0x11/0x20 Jun 17 23:28:06 nl100 kernel: [89832.299875] Code: d8 48 3d 90 d0 03 00 76 cc 80 4d 00 08 eb 98 90 90 90 90 90 90 90 90 90 90 0f 1f 44 00 00 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 c3 66 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 8b 07 Jun 17 23:28:06 nl100 kernel: [89832.299875] RSP: 0018:ffffb27b1e963638 EFLAGS: 00000293 ORIG_RAX: ffffffffffffff13 Jun 17 23:28:06 nl100 kernel: [89832.299876] RAX: ffff9155ca566880 RBX: ffff915637c5f140 RCX: ffff9155ca566880 Jun 17 23:28:06 nl100 kernel: [89832.299876] RDX: ffff9155d0a7ce40 RSI: 0000000000000293 RDI: 0000000000000293 Jun 17 23:28:06 nl100 kernel: [89832.299876] RBP: 0000000000000078 R08: 0000000001580000 R09: ffff9155dbe9de80 Jun 17 23:28:06 nl100 kernel: [89832.299876] R10: 0000000000000000 R11: ffff914aa5ee6000 R12: ffff9155dbe9de80 Jun 17 23:28:06 nl100 kernel: [89832.299877] R13: 0000000000000080 R14: ffffffffffffff80 R15: ffffffffffffff80 Jun 17 23:28:06 nl100 kernel: [89832.299877] alloc_iova+0x11f/0x140 Jun 17 23:28:06 nl100 kernel: [89832.299877] alloc_iova_fast+0x56/0x250 Jun 17 23:28:06 nl100 kernel: [89832.299877] ? __kmalloc+0x180/0x220 Jun 17 23:28:06 nl100 kernel: [89832.299877] ? mempool_alloc+0x67/0x190 Jun 17 23:28:06 nl100 kernel: [89832.299878] dma_ops_alloc_iova.isra.28+0x4b/0x70 Jun 17 23:28:06 nl100 kernel: [89832.299878] map_sg+0x73/0x1f0 Jun 17 23:28:06 nl100 kernel: [89832.299878] nvme_queue_rq+0x1e7/0x9e0 [nvme] Jun 17 23:28:06 nl100 kernel: [89832.299878] ? __sbitmap_queue_get+0x24/0x90 Jun 17 23:28:06 nl100 kernel: [89832.299878] ? blk_mq_get_tag+0x236/0x260 Jun 17 23:28:06 nl100 kernel: [89832.299879] ? nvme_queue_rq+0x4d2/0x9e0 [nvme] Jun 17 23:28:06 nl100 kernel: [89832.299879] ? finish_wait+0x80/0x80 Jun 17 23:28:06 nl100 kernel: [89832.299879] blk_mq_dispatch_rq_list+0x392/0x590 Jun 17 23:28:06 nl100 kernel: [89832.299879] ? remove_wait_queue+0x60/0x60 Jun 17 23:28:06 nl100 kernel: [89832.299879] blk_mq_sched_dispatch_requests+0xf0/0x170 Jun 17 23:28:06 nl100 kernel: [89832.299880] __blk_mq_run_hw_queue+0x4e/0xe0 Jun 17 23:28:06 nl100 kernel: [89832.299880] __blk_mq_delay_run_hw_queue+0x143/0x160 Jun 17 23:28:06 nl100 kernel: [89832.299880] blk_mq_run_hw_queue+0x88/0x110 Jun 17 23:28:06 nl100 kernel: [89832.299880] __blk_mq_try_issue_directly+0x8e/0x1c0 Jun 17 23:28:06 nl100 kernel: [89832.299880] ? recalibrate_cpu_khz+0x10/0x10 Jun 17 23:28:06 nl100 kernel: [89832.299881] ? ktime_get+0x3a/0xa0 Jun 17 23:28:06 nl100 kernel: [89832.299881] blk_mq_try_issue_directly+0x30/0xb0 Jun 17 23:28:06 nl100 kernel: [89832.299881] blk_mq_make_request+0x332/0x530 Jun 17 23:28:06 nl100 kernel: [89832.299881] generic_make_request+0x1a4/0x400 Jun 17 23:28:06 nl100 kernel: [89832.299881] ? __add_to_page_cache_locked+0x1df/0x240 Jun 17 23:28:06 nl100 kernel: [89832.299882] submit_bio+0x45/0x130 Jun 17 23:28:06 nl100 kernel: [89832.299882] ? add_to_page_cache_lru+0x74/0xe0 Jun 17 23:28:06 nl100 kernel: [89832.299882] ? bio_add_page+0x48/0x60 Jun 17 23:28:06 nl100 kernel: [89832.299882] ext4_mpage_readpages+0x4c3/0x860 [ext4] Jun 17 23:28:06 nl100 kernel: [89832.299882] read_pages+0x6b/0x190 Jun 17 23:28:06 nl100 kernel: [89832.299883] __do_page_cache_readahead+0x1c1/0x1e0 Jun 17 23:28:06 nl100 kernel: [89832.299883] ondemand_readahead+0x1f9/0x2c0 Jun 17 23:28:06 nl100 kernel: [89832.299883] generic_file_read_iter+0x742/0xbc0 Jun 17 23:28:06 nl100 kernel: [89832.299883] ? sock_write_iter+0x97/0x100 Jun 17 23:28:06 nl100 kernel: [89832.299883] new_sync_read+0xf8/0x160 Jun 17 23:28:06 nl100 kernel: [89832.299884] vfs_read+0x91/0x140 Jun 17 23:28:06 nl100 kernel: [89832.299884] ksys_pread64+0x61/0xa0 Jun 17 23:28:06 nl100 kernel: [89832.299884] do_syscall_64+0x53/0x110 Jun 17 23:28:06 nl100 kernel: [89832.299884] entry_SYSCALL_64_after_hwframe+0x44/0xa9 Jun 17 23:28:06 nl100 kernel: [89832.299884] RIP: 0033:0x7ffff7fb1df4 Jun 17 23:28:06 nl100 kernel: [89832.299885] Code: d8 64 89 02 b8 ff ff ff ff eb c5 66 2e 0f 1f 84 00 00 00 00 00 90 8b 05 5a e6 00 00 49 89 ca 85 c0 75 13 b8 11 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5c c3 0f 1f 00 41 55 49 89 cd 41 54 49 89 d4 Jun 17 23:28:06 nl100 kernel: [89832.299885] RSP: 002b:00007fffffffe5d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000011 Jun 17 23:28:06 nl100 kernel: [89832.299886] RAX: ffffffffffffffda RBX: 000055555a2ed388 RCX: 00007ffff7fb1df4 Jun 17 23:28:06 nl100 kernel: [89832.299886] RDX: 0000000000100000 RSI: 000055555d16a8b0 RDI: 00000000000000d2 Jun 17 23:28:06 nl100 kernel: [89832.299886] RBP: 000055555a2ed050 R08: 000055555a2ed050 R09: 0000000000000001 Jun 17 23:28:06 nl100 kernel: [89832.299886] R10: 000000001e343d86 R11: 0000000000000246 R12: 0000000000100000 Jun 17 23:28:06 nl100 kernel: [89832.299887] R13: 00007fffffffe630 R14: 0000000000000001 R15: 000055555a2ed000 Jun 17 23:28:34 nl100 kernel: [89860.345081] Modules linked in: binfmt_misc msr amd64_edac_mod edac_mce_amd kvm_amd kvm irqbypass crct10dif_pclmul efi_pstore crc32_pclmul ghash_clmulni_intel efivars pcspkr ipmi_ssif nls_ascii nls_cp437 vfat fat ast ttm joydev drm_kms_helper drm ccp i2c_algo_bit evdev rng_core sp5100_tco ipmi_si ipmi_devintf ipmi_msghandler pcc_cpufreq acpi_cpufreq button tcp_bbr sch_fq aufs(OE) efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic fscrypto ecb hid_generic usbhid hid crc32c_intel aesni_intel aes_x86_64 crypto_simd mlx5_core(OE) cryptd glue_helper mlxfw(OE) psample ahci mlxdevm(OE) auxiliary(OE) libahci xhci_pci xhci_hcd mlx_compat(OE) libata nvme usbcore devlink scsi_mod nvme_core i2c_piix4 usb_common Jun 17 23:28:34 nl100 kernel: [89860.345124] CPU: 51 PID: 96472 Comm: nginx Tainted: G W OEL 4.19.0-20-amd64 #1 Debian 4.19.235-1 Jun 17 23:28:34 nl100 kernel: [89860.345124] Hardware name: Supermicro AS -1124US-TNRP/H12DSU-iN, BIOS 2.3a 03/03/2022 Jun 17 23:28:34 nl100 kernel: [89860.345132] RIP: 0010:_raw_spin_unlock_irqrestore+0x11/0x20 Jun 17 23:28:34 nl100 kernel: [89860.345133] Code: d8 48 3d 90 d0 03 00 76 cc 80 4d 00 08 eb 98 90 90 90 90 90 90 90 90 90 90 0f 1f 44 00 00 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 c3 66 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 8b 07 Jun 17 23:28:34 nl100 kernel: [89860.345134] RSP: 0018:ffff91564d8c3e88 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff13 Jun 17 23:28:34 nl100 kernel: [89860.345135] RAX: 00000000000000b3 RBX: ffffd17b4d584020 RCX: 0000000080400038 Jun 17 23:28:34 nl100 kernel: [89860.345136] RDX: 0000000080400039 RSI: 0000000000000282 RDI: 0000000000000282 Jun 17 23:28:34 nl100 kernel: [89860.345136] RBP: 000000000000000e R08: 0000000000000000 R09: ffffffffb3ef6000 Jun 17 23:28:34 nl100 kernel: [89860.345136] R10: ffff91e6ea4598c0 R11: 0000000000000001 R12: ffff915637c5f858 Jun 17 23:28:34 nl100 kernel: [89860.345137] R13: 0000000000000282 R14: ffff915637c5f140 R15: ffffd17b4d586028 Jun 17 23:28:34 nl100 kernel: [89860.345138] FS: 00007ffff7783b80(0000) GS:ffff91564d8c0000(0000) knlGS:0000000000000000 Jun 17 23:28:34 nl100 kernel: [89860.345138] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jun 17 23:28:34 nl100 kernel: [89860.345139] CR2: 00007ffff7f8f8c0 CR3: 00000176fe4a8000 CR4: 0000000000340ee0 Jun 17 23:28:34 nl100 kernel: [89860.345139] Call Trace: Jun 17 23:28:34 nl100 kernel: [89860.345141] <IRQ> Jun 17 23:28:34 nl100 kernel: [89860.345146] fq_flush_timeout+0x6a/0x90 Jun 17 23:28:34 nl100 kernel: [89860.345149] ? fq_ring_free+0xd0/0xd0 Jun 17 23:28:34 nl100 kernel: [89860.345153] call_timer_fn+0x2b/0x130 Jun 17 23:28:34 nl100 kernel: [89860.345155] run_timer_softirq+0x1c7/0x3e0 Jun 17 23:28:34 nl100 kernel: [89860.345159] ? recalibrate_cpu_khz+0x10/0x10 Jun 17 23:28:34 nl100 kernel: [89860.345160] ? ktime_get+0x3a/0xa0 Jun 17 23:28:34 nl100 kernel: [89860.345162] __do_softirq+0xde/0x2d8 Jun 17 23:28:34 nl100 kernel: [89860.345165] irq_exit+0xba/0xc0 Jun 17 23:28:34 nl100 kernel: [89860.345167] smp_apic_timer_interrupt+0x74/0x140 Jun 17 23:28:34 nl100 kernel: [89860.345169] apic_timer_interrupt+0xf/0x20 Jun 17 23:28:34 nl100 kernel: [89860.345170] </IRQ> Jun 17 23:28:34 nl100 kernel: [89860.345171] RIP: 0010:_raw_spin_unlock_irqrestore+0x11/0x20 Jun 17 23:28:34 nl100 kernel: [89860.345172] Code: d8 48 3d 90 d0 03 00 76 cc 80 4d 00 08 eb 98 90 90 90 90 90 90 90 90 90 90 0f 1f 44 00 00 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 c3 66 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 8b 07 Jun 17 23:28:34 nl100 kernel: [89860.345172] RSP: 0018:ffffb27b1e963638 EFLAGS: 00000293 ORIG_RAX: ffffffffffffff13 Jun 17 23:28:34 nl100 kernel: [89860.345173] RAX: ffff9155ca566880 RBX: ffff915637c5f140 RCX: ffff9155ca566880 Jun 17 23:28:34 nl100 kernel: [89860.345173] RDX: ffff9155d0a7ce40 RSI: 0000000000000293 RDI: 0000000000000293 Jun 17 23:28:34 nl100 kernel: [89860.345174] RBP: 0000000000000078 R08: 0000000001580000 R09: ffff9155dbe9de80 Jun 17 23:28:34 nl100 kernel: [89860.345174] R10: 0000000000000000 R11: ffff914aa5ee6000 R12: ffff9155dbe9de80 Jun 17 23:28:34 nl100 kernel: [89860.345175] R13: 0000000000000080 R14: ffffffffffffff80 R15: ffffffffffffff80 Jun 17 23:28:34 nl100 kernel: [89860.345176] alloc_iova+0x11f/0x140 Jun 17 23:28:34 nl100 kernel: [89860.345178] alloc_iova_fast+0x56/0x250 Jun 17 23:28:34 nl100 kernel: [89860.345181] ? __kmalloc+0x180/0x220 Jun 17 23:28:34 nl100 kernel: [89860.345185] ? mempool_alloc+0x67/0x190 Jun 17 23:28:34 nl100 kernel: [89860.345186] dma_ops_alloc_iova.isra.28+0x4b/0x70 Jun 17 23:28:34 nl100 kernel: [89860.345188] map_sg+0x73/0x1f0 Jun 17 23:28:34 nl100 kernel: [89860.345193] nvme_queue_rq+0x1e7/0x9e0 [nvme] Jun 17 23:28:34 nl100 kernel: [89860.345197] ? __sbitmap_queue_get+0x24/0x90 Jun 17 23:28:34 nl100 kernel: [89860.345199] ? blk_mq_get_tag+0x236/0x260 Jun 17 23:28:34 nl100 kernel: [89860.345201] ? nvme_queue_rq+0x4d2/0x9e0 [nvme] Jun 17 23:28:34 nl100 kernel: [89860.345203] ? finish_wait+0x80/0x80 Jun 17 23:28:34 nl100 kernel: [89860.345205] blk_mq_dispatch_rq_list+0x392/0x590 Jun 17 23:28:34 nl100 kernel: [89860.345206] ? remove_wait_queue+0x60/0x60 Jun 17 23:28:34 nl100 kernel: [89860.345208] blk_mq_sched_dispatch_requests+0xf0/0x170 Jun 17 23:28:34 nl100 kernel: [89860.345210] __blk_mq_run_hw_queue+0x4e/0xe0 Jun 17 23:28:34 nl100 kernel: [89860.345212] __blk_mq_delay_run_hw_queue+0x143/0x160 Jun 17 23:28:34 nl100 kernel: [89860.345213] blk_mq_run_hw_queue+0x88/0x110 Jun 17 23:28:34 nl100 kernel: [89860.345214] __blk_mq_try_issue_directly+0x8e/0x1c0 Jun 17 23:28:34 nl100 kernel: [89860.345215] ? recalibrate_cpu_khz+0x10/0x10 Jun 17 23:28:34 nl100 kernel: [89860.345216] ? ktime_get+0x3a/0xa0 Jun 17 23:28:34 nl100 kernel: [89860.345217] blk_mq_try_issue_directly+0x30/0xb0 Jun 17 23:28:34 nl100 kernel: [89860.345218] blk_mq_make_request+0x332/0x530 Jun 17 23:28:34 nl100 kernel: [89860.345220] generic_make_request+0x1a4/0x400 Jun 17 23:28:34 nl100 kernel: [89860.345222] ? __add_to_page_cache_locked+0x1df/0x240 Jun 17 23:28:34 nl100 kernel: [89860.345223] submit_bio+0x45/0x130 Jun 17 23:28:34 nl100 kernel: [89860.345224] ? add_to_page_cache_lru+0x74/0xe0 Jun 17 23:28:34 nl100 kernel: [89860.345225] ? bio_add_page+0x48/0x60 Jun 17 23:28:34 nl100 kernel: [89860.345240] ext4_mpage_readpages+0x4c3/0x860 [ext4] Jun 17 23:28:34 nl100 kernel: [89860.345243] read_pages+0x6b/0x190 Jun 17 23:28:34 nl100 kernel: [89860.345245] __do_page_cache_readahead+0x1c1/0x1e0 Jun 17 23:28:34 nl100 kernel: [89860.345246] ondemand_readahead+0x1f9/0x2c0 Jun 17 23:28:34 nl100 kernel: [89860.345248] generic_file_read_iter+0x742/0xbc0 Jun 17 23:28:34 nl100 kernel: [89860.345252] ? sock_write_iter+0x97/0x100 Jun 17 23:28:34 nl100 kernel: [89860.345255] new_sync_read+0xf8/0x160 Jun 17 23:28:34 nl100 kernel: [89860.345257] vfs_read+0x91/0x140 Jun 17 23:28:34 nl100 kernel: [89860.345259] ksys_pread64+0x61/0xa0 Jun 17 23:28:34 nl100 kernel: [89860.345262] do_syscall_64+0x53/0x110 Jun 17 23:28:34 nl100 kernel: [89860.345264] entry_SYSCALL_64_after_hwframe+0x44/0xa9 Jun 17 23:28:34 nl100 kernel: [89860.345265] RIP: 0033:0x7ffff7fb1df4 Jun 17 23:28:34 nl100 kernel: [89860.345266] Code: d8 64 89 02 b8 ff ff ff ff eb c5 66 2e 0f 1f 84 00 00 00 00 00 90 8b 05 5a e6 00 00 49 89 ca 85 c0 75 13 b8 11 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5c c3 0f 1f 00 41 55 49 89 cd 41 54 49 89 d4 Jun 17 23:28:34 nl100 kernel: [89860.345267] RSP: 002b:00007fffffffe5d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000011 Jun 17 23:28:34 nl100 kernel: [89860.345267] RAX: ffffffffffffffda RBX: 000055555a2ed388 RCX: 00007ffff7fb1df4 Jun 17 23:28:34 nl100 kernel: [89860.345268] RDX: 0000000000100000 RSI: 000055555d16a8b0 RDI: 00000000000000d2 Jun 17 23:28:34 nl100 kernel: [89860.345268] RBP: 000055555a2ed050 R08: 000055555a2ed050 R09: 0000000000000001 Jun 17 23:28:34 nl100 kernel: [89860.345269] R10: 000000001e343d86 R11: 0000000000000246 R12: 0000000000100000 Jun 17 23:28:34 nl100 kernel: [89860.345269] R13: 00007fffffffe630 R14: 0000000000000001 R15: 000055555a2ed000
чт, 9 черв. 2022 р. о 15:34 Андрій Василишин <vasilishi...@gmail.com> пише: > Because it is the latest kernel which supports aufs. > Problem gone when I change to default parameters NIC Mellanox > Technologies MT28908 Family [ConnectX-6] > ethtool -C enp161s0f0np0 rx-usecs 8 rx-frames 128 tx-usecs 8 tx-frames 128 > > > вт, 7 черв. 2022 р. о 18:35 Diederik de Haas <didi.deb...@cknow.org> пише: > >> Control: reassign -1 src:linux 4.19.235-1 >> Control: tag -1 moreinfo >> >> On 23 Apr 2022 21:59:32 +0300 Андрій Василишин <vasilishi...@gmail.com> >> wrote: >> > Package: linux-image-4.19.0-20-amd64 >> > Version: 4.19.235-1 >> > >> > ... >> > >> > Hardware name: Supermicro AS-1124US-TNRP/H12DSU-iN, BIOS 2.3a 03/03/2022 >> >> https://www.supermicro.com/en/Aplus/system/1U/1124/AS-1124US-TNRP.cfm >> specifications (and BIOS date) indicate this is quite a new board. >> Yet you're running it with a 4.19 kernel from *OldStable* ! >> >> Why? >> >> Can you reproduce this issue with at least the 5.10 kernel from OldStable >> backports, but preferably with a recent kernel from Testing/Unstable. > > > > -- > WBR, Andrey Vasilishin > -- WBR, Andrey Vasilishin
