On Tue, Jan 12, 2021 at 09:42:54AM -0700, Theo de Raadt wrote:
> So was that a fd leak?
No clue, since all I have is what's in the logs, it had exited.
>
> (your error is EMFILE, not ENFILE. It is the process hitting fd limit)
Yes, I'm aware.
-------8<------
www:\
:openfiles=512:\
:tc=daemon:
--------------
So it should be running with 512 as the limit.
While I can "crank the limit" to avoid the problem if it is sheer volume
and not a leak, (which I suspect may be the case) really a web server
shouldn't be exiting when it hits the limit, it should probably do
"something" sensible to stop servicing connections, stop servicing new
connections, murder existing connections, etc. etc.
So I may "crank the limit" just to avoid the problem. unless
florian wants me to do something else, however cronning a restart
every hour to restart it if it dies feels like the garbage I have
to do on linux.
>
> Bob Beck <b...@obtuse.com> wrote:
>
> >
> >
> > On Tue, Jan 12, 2021 at 04:45:32PM +0100, Solene Rapenne wrote:
> > > Hello,
> > >
> > > it seems www.openbsd.org is down since 14h46 UTC
> > > If I remember correctly you are the right person to tell about it.
> > >
> > > Regards
> > > Sol??ne
> >
> > Yes, It appears that httpd ran low on file descriptors, and decided to fix
> > that by exiting rather than murdering connections or refusing to service
> > more.
> > I'd probably say that's not optimal behaviour for httpd. (even closing all
> > active
> > connections and restarting is preferable to just exiting).
> >
> > ...
> > Jan 12 07:35:01 r230-1 httpd[57093]: ftp.openbsd.org 64.62.252.163 - -
> > [12/Jan/2021:07:35:01 -0700] "GET
> > /pub/OpenBSD/snapshots/packages/mips64/vlorb-1.2p0.tgz HTTP/1.1" 200 13103
> > "" "The Knowledge AI"
> > Jan 12 07:35:01 r230-1 httpd[57093]: ftp.openbsd.org 64.62.252.163 - -
> > [12/Jan/2021:07:35:01 -0700] "GET
> > /pub/OpenBSD/snapshots/packages/mips64/vmdktool-1.4.tgz HTTP/1.1" 200 15583
> > "" "The Knowledge AI"
> > Jan 12 07:36:19 r230-1 httpd[62909]: startup
> > Jan 12 07:36:19 r230-1 httpd[62909]: parent: proc_open: imsg_flush: Too
> > many open files
> > Jan 12 07:36:19 r230-1 httpd[74776]: logger exiting, pid 74776
> > Jan 12 07:36:19 r230-1 httpd[42878]: server exiting, pid 42878
> > Jan 12 07:36:19 r230-1 httpd[88100]: server exiting, pid 88100
> > Jan 12 07:36:19 r230-1 httpd[57583]: server exiting, pid 57583
> > Jan 12 07:36:19 r230-1 httpd[15586]: server exiting, pid 15586
> > Jan 12 07:36:19 r230-1 httpd[6347]: server exiting, pid 6347
> > Jan 12 07:36:19 r230-1 httpd[68058]: server exiting, pid 68058
> > Jan 12 07:36:19 r230-1 httpd[36742]: server exiting, pid 36742
> > Jan 12 07:36:19 r230-1 httpd[69672]: server exiting, pid 69672
> > Jan 12 07:36:19 r230-1 httpd[50046]: server exiting, pid 50046
> > Jan 12 07:36:19 r230-1 httpd[42968]: server exiting, pid 42968
> > Jan 12 07:36:19 r230-1 httpd[40009]: server exiting, pid 40009
> > Jan 12 07:36:19 r230-1 httpd[34475]: server exiting, pid 34475
> > Jan 12 07:36:19 r230-1 httpd[56151]: server exiting, pid 56151
> > Jan 12 07:36:19 r230-1 httpd[42252]: server exiting, pid 42252
> > Jan 12 07:36:19 r230-1 httpd[49837]: server exiting, pid 49837
> > Jan 12 07:36:19 r230-1 httpd[70693]: server exiting, pid 70693
> > Jan 12 07:36:19 r230-1 httpd[37597]: server exiting, pid 37597
> > Jan 12 07:36:19 r230-1 httpd[78437]: server exiting, pid 78437
> > Jan 12 07:36:19 r230-1 httpd[39941]: server exiting, pid 39941
> > Jan 12 07:36:19 r230-1 httpd[64622]: server exiting, pid 64622
> > r230-1#
> >
> > r230-1# dmesg
> > OpenBSD 6.8 (GENERIC.MP) #84: Sat Sep 26 20:32:53 MDT 2020
> > dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> > real mem = 17119961088 (16326MB)
> > avail mem = 16586063872 (15817MB)
> > random: good seed from bootblocks
> > mpath0 at root
> > scsibus0 at mpath0: 256 targets
> > mainbus0 at root
> > bios0 at mainbus0: SMBIOS rev. 2.8 @ 0x8ef68000 (43 entries)
> > bios0: vendor Dell Inc. version "1.4.5" date 08/09/2016
> > bios0: Dell Inc. PowerEdge R230
> > acpi0 at bios0: ACPI 5.0
> > acpi0: sleep states S0 S5
> > acpi0: tables DSDT FACP BOOT SSDT SLIC HPET LPIT APIC MCFG WDAT SSDT DBGP
> > DBG2 SSDT SSDT SSDT SSDT DMAR SSDT SSDT PRAD HEST BERT ERST EINJ FPDT SPCR
> > acpi0: wakeup devices PEG0(S0) PEGP(S0) PEG1(S0) PEGP(S0) PEG2(S0) PEGP(S0)
> > XHC_(S0) XDCI(S0) RP01(S0) PXSX(S0) RP02(S0) PXSX(S0) RP03(S0) PXSX(S0)
> > RP04(S0) PXSX(S0) [...]
> > acpitimer0 at acpi0: 3579545 Hz, 24 bits
> > acpihpet0 at acpi0: 23999999 Hz
> > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> > cpu0 at mainbus0: apid 0 (boot processor)
> > cpu0: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3692.80 MHz, 06-5e-03
> > cpu0:
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > cpu0: 256KB 64b/line 8-way L2 cache
> > cpu0: smt 0, core 0, package 0
> > mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
> > cpu0: apic clock running at 24MHz
> > cpu0: mwait min=64, max=64, C-substates=0.2.1.2.4.1, IBE
> > cpu1 at mainbus0: apid 2 (application processor)
> > cpu1: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.41 MHz, 06-5e-03
> > cpu1:
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > cpu1: 256KB 64b/line 8-way L2 cache
> > cpu1: smt 0, core 1, package 0
> > cpu2 at mainbus0: apid 4 (application processor)
> > cpu2: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.41 MHz, 06-5e-03
> > cpu2:
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > cpu2: 256KB 64b/line 8-way L2 cache
> > cpu2: smt 0, core 2, package 0
> > cpu3 at mainbus0: apid 6 (application processor)
> > cpu3: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.41 MHz, 06-5e-03
> > cpu3:
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > cpu3: 256KB 64b/line 8-way L2 cache
> > cpu3: smt 0, core 3, package 0
> > cpu4 at mainbus0: apid 1 (application processor)
> > cpu4: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.40 MHz, 06-5e-03
> > cpu4:
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > cpu4: 256KB 64b/line 8-way L2 cache
> > cpu4: smt 1, core 0, package 0
> > cpu5 at mainbus0: apid 3 (application processor)
> > cpu5: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.40 MHz, 06-5e-03
> > cpu5:
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > cpu5: 256KB 64b/line 8-way L2 cache
> > cpu5: smt 1, core 1, package 0
> > cpu6 at mainbus0: apid 5 (application processor)
> > cpu6: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.40 MHz, 06-5e-03
> > cpu6:
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > cpu6: 256KB 64b/line 8-way L2 cache
> > cpu6: smt 1, core 2, package 0
> > cpu7 at mainbus0: apid 7 (application processor)
> > cpu7: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.40 MHz, 06-5e-03
> > cpu7:
> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > cpu7: 256KB 64b/line 8-way L2 cache
> > cpu7: smt 1, core 3, package 0
> > ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins
> > acpimcfg0 at acpi0
> > acpimcfg0: addr 0xe0000000, bus 0-255
> > acpiprt0 at acpi0: bus 0 (PCI0)
> > acpiprt0: no apic found for irq 32
> > acpiprt0: no apic found for irq 33
> > acpiprt0: no apic found for irq 34
> > acpiprt1 at acpi0: bus 1 (PEG0)
> > acpiprt2 at acpi0: bus 2 (PEG1)
> > acpiprt3 at acpi0: bus -1 (PEG2)
> > acpiprt4 at acpi0: bus -1 (RP01)
> > acpiprt5 at acpi0: bus -1 (RP02)
> > acpiprt6 at acpi0: bus -1 (RP03)
> > acpiprt7 at acpi0: bus -1 (RP04)
> > acpiprt8 at acpi0: bus -1 (RP05)
> > acpiprt9 at acpi0: bus -1 (RP06)
> > acpiprt10 at acpi0: bus -1 (RP07)
> > acpiprt11 at acpi0: bus -1 (RP08)
> > acpiprt12 at acpi0: bus 3 (RP09)
> > acpiprt13 at acpi0: bus -1 (RP10)
> > acpiprt14 at acpi0: bus 4 (RP11)
> > acpiprt15 at acpi0: bus -1 (RP12)
> > acpiprt16 at acpi0: bus -1 (RP13)
> > acpiprt17 at acpi0: bus -1 (RP14)
> > acpiprt18 at acpi0: bus -1 (RP15)
> > acpiprt19 at acpi0: bus -1 (RP16)
> > acpiprt20 at acpi0: bus -1 (RP17)
> > acpiprt21 at acpi0: bus -1 (RP18)
> > acpiprt22 at acpi0: bus -1 (RP19)
> > acpiprt23 at acpi0: bus -1 (RP20)
> > acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
> > acpicmos0 at acpi0
> > acpibtn0 at acpi0: SLPB
> > "PNP0C14" at acpi0 not configured
> > "PNP0C33" at acpi0 not configured
> > acpicpu0 at acpi0: C1(@1 halt!)
> > acpicpu1 at acpi0: C1(@1 halt!)
> > acpicpu2 at acpi0: C1(@1 halt!)
> > acpicpu3 at acpi0: C1(@1 halt!)
> > acpicpu4 at acpi0: C1(@1 halt!)
> > acpicpu5 at acpi0: C1(@1 halt!)
> > acpicpu6 at acpi0: C1(@1 halt!)
> > acpicpu7 at acpi0: C1(@1 halt!)
> > acpivideo0 at acpi0: GFX0
> > acpivout0 at acpivideo0: DD1F
> > ipmi at mainbus0 not configured
> > cpu0: using VERW MDS workaround (except on vmm entry)
> > pci0 at mainbus0 bus 0
> > pchb0 at pci0 dev 0 function 0 "Intel Xeon E3-1200 v5 Host" rev 0x07
> > ppb0 at pci0 dev 1 function 0 "Intel Core 6G PCIE" rev 0x07: msi
> > pci1 at ppb0 bus 1
> > ppb1 at pci0 dev 1 function 1 "Intel Core 6G PCIE" rev 0x07: msi
> > pci2 at ppb1 bus 2
> > xhci0 at pci0 dev 20 function 0 "Intel 100 Series xHCI" rev 0x31: msi, xHCI
> > 1.0
> > usb0 at xhci0: USB revision 3.0
> > uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev
> > 3.00/1.00 addr 1
> > pchtemp0 at pci0 dev 20 function 2 "Intel 100 Series Thermal" rev 0x31
> > "Intel 100 Series MEI" rev 0x31 at pci0 dev 22 function 0 not configured
> > "Intel 100 Series MEI" rev 0x31 at pci0 dev 22 function 1 not configured
> > ahci0 at pci0 dev 23 function 0 "Intel 100 Series AHCI" rev 0x31: msi, AHCI
> > 1.3.1
> > ahci0: port 4: 6.0Gb/s
> > scsibus1 at ahci0: 32 targets
> > sd0 at scsibus1 targ 4 lun 0: <ATA, Samsung SSD 860, RVQ0>
> > naa.5002538e4964a3d0
> > sd0: 3815447MB, 512 bytes/sector, 7814037168 sectors, thin
> > ppb2 at pci0 dev 29 function 0 "Intel 100 Series PCIE" rev 0xf1: msi
> > pci3 at ppb2 bus 3
> > 3:0:0: rom address conflict 0xfffc0000/0x40000
> > 3:0:1: rom address conflict 0xfffc0000/0x40000
> > bge0 at pci3 dev 0 function 0 "Broadcom BCM5720" rev 0x00, BCM5720 A0
> > (0x5720000), APE firmware NCSI 1.3.16.0: msi, address 10:98:36:ae:4d:c9
> > brgphy0 at bge0 phy 1: BCM5720C 10/100/1000baseT PHY, rev. 0
> > bge1 at pci3 dev 0 function 1 "Broadcom BCM5720" rev 0x00, BCM5720 A0
> > (0x5720000), APE firmware NCSI 1.3.16.0: msi, address 10:98:36:ae:4d:ca
> > brgphy1 at bge1 phy 2: BCM5720C 10/100/1000baseT PHY, rev. 0
> > ppb3 at pci0 dev 29 function 2 "Intel 100 Series PCIE" rev 0xf1: msi
> > pci4 at ppb3 bus 4
> > ppb4 at pci4 dev 0 function 0 "Renesas SH7758 PCIE Switch" rev 0x00
> > pci5 at ppb4 bus 5
> > ppb5 at pci5 dev 0 function 0 "Renesas SH7758 PCIE Switch" rev 0x00
> > pci6 at ppb5 bus 6
> > ppb6 at pci6 dev 0 function 0 "Renesas SH7758 PCIE-PCI" rev 0x00
> > pci7 at ppb6 bus 7
> > vga1 at pci7 dev 0 function 0 "Matrox MGA G200eR" rev 0x01
> > wsdisplay at vga1 not configured
> > pcib0 at pci0 dev 31 function 0 "Intel C236 LPC" rev 0x31
> > "Intel 100 Series PMC" rev 0x31 at pci0 dev 31 function 2 not configured
> > ichiic0 at pci0 dev 31 function 4 "Intel 100 Series SMBus" rev 0x31: apic 2
> > int 16
> > iic0 at ichiic0
> > sdtemp0 at iic0 addr 0x19: tse2004gb2
> > spdmem0 at iic0 addr 0x51: 16GB DDR4 SDRAM ECC PC4-17000 with thermal sensor
> > isa0 at pcib0
> > isadma0 at isa0
> > com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> > com0: console
> > com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
> > pcppi0 at isa0 port 0x61
> > spkr0 at pcppi0
> > vmm0 at mainbus0: VMX/EPT
> > uhub1 at uhub0 port 3 configuration 1 interface 0 "no manufacturer Gadget
> > USB HUB" rev 2.00/0.00 addr 2
> > vscsi0 at root
> > scsibus2 at vscsi0: 256 targets
> > softraid0 at root
> > scsibus3 at softraid0: 256 targets
> > root on sd0a (58ab553d2e2cd141.a) swap on sd0b dump on sd0b
> > carp1: state transition: BACKUP -> MASTER
> > carp0: state transition: BACKUP -> MASTER
> >
