Chris Cappuccio <ch...@nmedia.net> writes:
> Divan Santana [di...@santanas.co.za] wrote:
>> Greetings :)
>>
>> So I have two openbsd76 systems. A backup and primary.
>>
>> This alpine vm boots on the backup but not the primary.
>>
>> I have copied the vm between the two and done an md5 on both sides and
>> the file is identical. For some reason it boots on the backup server
>> but not the primary server.
>>
>> Here is console output of the failed boot. Any idea what the below means?
>>
>>
>> [ 0.509998] Loaded X.509 cert 'alpinelinux.org: Alpine Linux kernel key:
>> d76a695f66ad9cd28f5c22a8508f36e91f521f7a'
>> [ 0.509998] Demotion targets for Node 0: null
>> [ 0.509998] Key type .fscrypt registered
>> [ 0.509998] Key type fscrypt-provisioning registered
>> [ 0.509998] Unstable clock detected, switching default tracing clock to
>> "global"
>> [ 0.509998] If you want to keep using the local clock, then add:
>> [ 0.509998] "trace_clock=local"
>> [ 0.509998] on the kernel command line
>> [ 0.509998] clk: Disabling unused clocks
>> [ 0.509998] PM: genpd: Disabling unused power domains
>> [ 0.509998] Freeing unused kernel image (initmem) memory: 3572K
>> [ 0.509998] Write protecting the kernel read-only data: 22528k
>> [ 0.509998] Freeing unused kernel image (rodata/data gap) memory: 584K
>> [ 0.509998] Run /init as init process
>> [ 0.509998] ------------[ cut here ]------------
>> [ 0.509998] WARNING: CPU: 0 PID: 1 at arch/x86/kernel/fpu/xstate.c:1009
>> get_xsave_addr_user+0x34/0x50
>
> Try passing noxsave to the linux kernel during boot. Maybe vmm is not
> properly handling some of these CPU flags.
This fixes the issue for me. Thanks a lot Chris.
I was surprised, because previously alpine ran on this same system
without issue. Perhaps it's since the 3.21 upgrade that triggered the
bug.
>> dmesg below:
>>
>> cpu0: AMD Ryzen 9 7900 12-Core Processor, 3700.01 MHz, 19-61-02, patch
>> 0a601209
>> cpu0: cpuid 1
>> edx=178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT>
>>
>> ecx=76d8320b<SSE3,PCLMUL,MWAIT,SSSE3,FMA3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND>
>> cpu0: cpuid 6 eax=4<ARAT> ecx=1<EFFFREQ>
>> cpu0: cpuid 7.0
>> ebx=f1bf97a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,AVX512F,AVX512DQ,RDSEED,ADX,SMAP,AVX512IFMA,CLFLUSHOPT,CLWB,AVX512CD,SHA,AVX512BW,AVX512VL>
>> ecx=405fce<AVX512VBMI,UMIP,PKU> edx=10000010<L1DF>
>> cpu0: cpuid d.1 eax=f<XSAVEOPT,XSAVEC,XGETBV1,XSAVES>
>> cpu0: cpuid 80000001 edx=2fd3fbff<NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG>
>> ecx=75c237ff<LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,IBS,SKINIT,TCE,TOPEXT,CPCTR,DBKP,PCTRL3,MWAITX>
>> cpu0: cpuid 80000007 edx=6799<HWPSTATE,ITSC>
>> cpu0: cpuid 80000008
>> ebx=791ef257<IBPB,IBRS,STIBP,STIBP_ALL,IBRS_PREF,IBRS_SM,SSBD>
>> cpu0: cpuid 8000001F eax=1<SME>
>
> Are the working and non-working servers the same?
No. Yeah, the above is the broken system (new amd ryzen 9) and below is
the old system which worked without issue.
OpenBSD 7.6 (GENERIC.MP) #338: Mon Sep 30 08:55:35 MDT 2024
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 34304724992 (32715MB)
avail mem = 33241415680 (31701MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.6 @ 0xeb1d0 (104 entries)
bios0: vendor American Megatrends Inc. version "3703" date 07/16/2013
bios0: ASUSTeK COMPUTER INC. P8P67-M
acpi0 at bios0: ACPI 4.0
acpi0: sleep states S0 S1 S3 S4 S5
acpi0: tables DSDT FACP APIC MCFG HPET SSDT SSDT SSDT DMAR
acpi0: wakeup devices UAR1(S4) P0P1(S4) RP01(S4) PXSX(S4) RP02(S4) PXSX(S4)
RP03(S4) PXSX(S4) RP04(S4) PXSX(S4) RP06(S4) PXSX(S4) RP07(S4) PXSX(S4)
RP08(S4) PXSX(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.26 MHz, 06-2a-07, patch
0000002f
cpu0: cpuid 1
edx=bfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
ecx=17bae3ff<SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX>
cpu0: cpuid 6 eax=77<SENSOR,ARAT> ecx=9<EFFFREQ>
cpu0: cpuid 7.0 edx=9c000400<MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD>
cpu0: cpuid a vers=3, gp=4, gpwidth=48, ff=3, ffwidth=48
cpu0: cpuid d.1 eax=1<XSAVEOPT>
cpu0: cpuid 80000001 edx=28100800<NXE,RDTSCP,LONG> ecx=1<LAHF>
cpu0: cpuid 80000007 edx=100<ITSC>
cpu0: MELTDOWN
cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
8-way L2 cache, 8MB 64b/line 16-way L3 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 100MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.1, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.28 MHz, 06-2a-07, patch
0000002f
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.34 MHz, 06-2a-07, patch
0000002f
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 6 (application processor)
cpu3: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.41 MHz, 06-2a-07, patch
0000002f
cpu3: smt 0, core 3, package 0
cpu4 at mainbus0: apid 1 (application processor)
cpu4: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3412.03 MHz, 06-2a-07, patch
0000002f
cpu4: smt 1, core 0, package 0
cpu5 at mainbus0: apid 3 (application processor)
cpu5: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.95 MHz, 06-2a-07, patch
0000002f
cpu5: smt 1, core 1, package 0
cpu6 at mainbus0: apid 5 (application processor)
cpu6: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.71 MHz, 06-2a-07, patch
0000002f
cpu6: smt 1, core 2, package 0
cpu7 at mainbus0: apid 7 (application processor)
cpu7: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.53 MHz, 06-2a-07, patch
0000002f
cpu7: smt 1, core 3, package 0
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0xf8000000, bus 0-63
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus -1 (P0P1)
acpiprt2 at acpi0: bus 2 (RP01)
acpiprt3 at acpi0: bus -1 (RP02)
acpiprt4 at acpi0: bus -1 (RP03)
acpiprt5 at acpi0: bus 3 (RP04)
acpiprt6 at acpi0: bus 6 (RP06)
acpiprt7 at acpi0: bus 7 (RP07)
acpiprt8 at acpi0: bus 8 (RP08)
acpiprt9 at acpi0: bus 1 (PEG0)
acpiprt10 at acpi0: bus -1 (PEG1)
acpiprt11 at acpi0: bus -1 (PEG2)
acpiprt12 at acpi0: bus -1 (PEG3)
acpiprt13 at acpi0: bus 4 (RP05)
acpiprt14 at acpi0: bus 5 (PXSX)
acpiec0 at acpi0: not present
acpipci0 at acpi0 PCI0: 0x00000004 0x00000011 0x00000001
acpicmos0 at acpi0
com0 at acpi0 UAR1 addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo
acpibtn0 at acpi0: PWRB(wakeup)
"PNP0C0B" at acpi0 not configured
"PNP0C0B" at acpi0 not configured
"PNP0C0B" at acpi0 not configured
"PNP0C0B" at acpi0 not configured
"PNP0C0B" at acpi0 not configured
"PNP0C14" at acpi0 not configured
acpicpu0 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), C1(1000@1
mwait.1), PSS
acpicpu1 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), C1(1000@1
mwait.1), PSS
acpicpu2 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), C1(1000@1
mwait.1), PSS
acpicpu3 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), C1(1000@1
mwait.1), PSS
acpicpu4 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), C1(1000@1
mwait.1), PSS
acpicpu5 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), C1(1000@1
mwait.1), PSS
acpicpu6 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), C1(1000@1
mwait.1), PSS
acpicpu7 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), C1(1000@1
mwait.1), PSS
acpipwrres0 at acpi0: FN00, resource for FAN0
acpipwrres1 at acpi0: FN01, resource for FAN1
acpipwrres2 at acpi0: FN02, resource for FAN2
acpipwrres3 at acpi0: FN03, resource for FAN3
acpipwrres4 at acpi0: FN04, resource for FAN4
acpitz0 at acpi0: critical temperature is 99 degC
acpitz1 at acpi0: critical temperature is 99 degC
acpivideo0 at acpi0: GFX0
acpivout0 at acpivideo0: DD02
cpu0: using VERW MDS workaround (except on vmm entry)
cpu0: Enhanced SpeedStep 3411 MHz: speeds: 3401, 3400, 3300, 3100, 3000, 2900,
2800, 2600, 2500, 2400, 2200, 2100, 2000, 1900, 1700, 1600 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel Core 2G Host" rev 0x09
ppb0 at pci0 dev 1 function 0 "Intel Core 2G PCIE" rev 0x09: msi
pci1 at ppb0 bus 1
vga1 at pci1 dev 0 function 0 vendor "NVIDIA", unknown product 0x128b rev 0xa1
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
azalia0 at pci1 dev 0 function 1 vendor "NVIDIA", unknown product 0x0e0f rev
0xa1: msi
azalia0: no supported codecs
"Intel 6 Series MEI" rev 0x04 at pci0 dev 22 function 0 not configured
ehci0 at pci0 dev 26 function 0 "Intel 6 Series USB" rev 0x05: apic 2 int 23
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
addr 1
azalia1 at pci0 dev 27 function 0 "Intel 6 Series HD Audio" rev 0x05: msi
azalia1: codecs: Realtek ALC887
audio0 at azalia1
ppb1 at pci0 dev 28 function 0 "Intel 6 Series PCIE" rev 0xb5: msi
pci2 at ppb1 bus 2
ppb2 at pci0 dev 28 function 3 "Intel 6 Series PCIE" rev 0xb5: msi
pci3 at ppb2 bus 3
re0 at pci3 dev 0 function 0 "Realtek 8168" rev 0x01: RTL8168 2 (0x3800), msi,
address 00:e0:4c:1e:c5:df
rgephy0 at re0 phy 7: RTL8169S/8110S/8211, rev. 2
ppb3 at pci0 dev 28 function 4 "Intel 82801BA Hub-to-PCI" rev 0xb5: msi
pci4 at ppb3 bus 4
ppb4 at pci4 dev 0 function 0 "ASMedia ASM1083/1085 PCIE-PCI" rev 0x01
pci5 at ppb4 bus 5
puc0 at pci5 dev 0 function 0 "NetMos Nm9865" rev 0x00: ports: 16 com
com4 at puc0 port 0 apic 2 int 16: st16650, 32 byte fifo
puc1 at pci5 dev 0 function 1 "NetMos Nm9865" rev 0x00: ports: 16 com
com5 at puc1 port 0 apic 2 int 17: st16650, 32 byte fifo
ppb5 at pci0 dev 28 function 5 "Intel 6 Series PCIE" rev 0xb5: msi
pci6 at ppb5 bus 6
jmb0 at pci6 dev 0 function 0 "JMicron JMB361 IDE/SATA" rev 0x10
ahci0 at jmb0: apic 2 int 17, AHCI 1.1
scsibus1 at ahci0: 32 targets
pciide0 at jmb0: DMA, channel 0 wired to native-PCI, channel 1 wired to
native-PCI
pciide0: using apic 2 int 17 for native-PCI interrupt
pciide0: channel 0 disabled (no drives)
pciide0: channel 1 disabled (no drives)
ppb6 at pci0 dev 28 function 6 "Intel 6 Series PCIE" rev 0xb5: msi
pci7 at ppb6 bus 7
re1 at pci7 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E (0x2c00),
msi, address f4:6d:04:d9:f4:2c
rgephy1 at re1 phy 7: RTL8169S/8110S/8211, rev. 4
ppb7 at pci0 dev 28 function 7 "Intel 6 Series PCIE" rev 0xb5: msi
pci8 at ppb7 bus 8
xhci0 at pci8 dev 0 function 0 "ASMedia ASM1042 xHCI" rev 0x00: msix, xHCI 0.96
usb1 at xhci0: USB revision 3.0
uhub1 at usb1 configuration 1 interface 0 "ASMedia xHCI root hub" rev 3.00/1.00
addr 1
ehci1 at pci0 dev 29 function 0 "Intel 6 Series USB" rev 0x05: apic 2 int 23
usb2 at ehci1: USB revision 2.0
uhub2 at usb2 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
addr 1
pcib0 at pci0 dev 31 function 0 "Intel P67 LPC" rev 0x05
ahci1 at pci0 dev 31 function 2 "Intel 6 Series AHCI" rev 0x05: msi, AHCI 1.3
ahci1: port 0: 6.0Gb/s
ahci1: port 1: 6.0Gb/s
ahci1: port 3: 3.0Gb/s
ahci1: port 4: 3.0Gb/s
ahci1: port 5: 3.0Gb/s
scsibus2 at ahci1: 32 targets
sd0 at scsibus2 targ 0 lun 0: <ATA, CT500MX500SSD1, M3CR> naa.500a0751e210c4c9
sd0: 476940MB, 512 bytes/sector, 976773168 sectors, thin
sd1 at scsibus2 targ 1 lun 0: <ATA, CT500MX500SSD1, M3CR> naa.500a0751e2029946
sd1: 476940MB, 512 bytes/sector, 976773168 sectors, thin
sd2 at scsibus2 targ 3 lun 0: <ATA, ST2000DM006-2DM1, CC26> naa.5000c500b0037f38
sd2: 1907729MB, 512 bytes/sector, 3907029168 sectors
sd3 at scsibus2 targ 4 lun 0: <ATA, ST32000641AS, CC13> naa.5000c5003646094a
sd3: 1907729MB, 512 bytes/sector, 3907029168 sectors
sd4 at scsibus2 targ 5 lun 0: <ATA, ST2000DM006-2DM1, CC26> naa.5000c500b1734f1c
sd4: 1907729MB, 512 bytes/sector, 3907029168 sectors
ichiic0 at pci0 dev 31 function 3 "Intel 6 Series SMBus" rev 0x05: apic 2 int 18
iic0 at ichiic0
spdmem0 at iic0 addr 0x50: 8GB DDR3 SDRAM PC3-12800
spdmem1 at iic0 addr 0x51: 8GB DDR3 SDRAM PC3-12800
spdmem2 at iic0 addr 0x52: 8GB DDR3 SDRAM PC3-12800
spdmem3 at iic0 addr 0x53: 8GB DDR3 SDRAM PC3-12800
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
lpt0 at isa0 port 0x378/4 irq 7
wbsio0 at isa0 port 0x2e/2: NCT6776F rev 0x33
lm1 at wbsio0 port 0x290/8: NCT6776F
vmm0 at mainbus0: VMX/EPT
uhub3 at uhub0 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev
2.00/0.00 addr 2
uhidev0 at uhub3 port 2 configuration 1 interface 0 "Logitech Wireless
Receiver" rev 1.10/3.08 addr 3
uhidev0: iclass 3/1, 5 report ids
ums0 at uhidev0 reportid 1: 5 buttons, Z dir
wsmouse0 at ums0 mux 0
uhid0 at uhidev0 reportid 5: input=0, output=0, feature=7
umass0 at uhub1 port 1 configuration 1 interface 0 "TOSHIBA EXTERNAL_USB" rev
3.00/0.00 addr 2
umass0: using SCSI over Bulk-Only
scsibus3 at umass0: 2 targets, initiator 0
sd5 at scsibus3 targ 1 lun 0: <TOSHIBA, EXTERNAL_USB, 0>
serial.0480090640523010721F
sd5: 953869MB, 512 bytes/sector, 1953525168 sectors
uhub4 at uhub2 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev
2.00/0.00 addr 2
uhidev1 at uhub4 port 1 configuration 1 interface 0 "Logitech USB Keyboard" rev
1.10/62.00 addr 3
uhidev1: iclass 3/1
ukbd0 at uhidev1: 8 variable keys, 6 key codes
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
uhidev2 at uhub4 port 1 configuration 1 interface 1 "Logitech USB Keyboard" rev
1.10/62.00 addr 3
uhidev2: iclass 3/0
ucc0 at uhidev2: 1301 usages, 20 keys, array
wskbd2 at ucc0 mux 1
wskbd2: connecting to wsdisplay0
vscsi0 at root
scsibus4 at vscsi0: 256 targets
softraid0 at root
scsibus5 at softraid0: 256 targets
sd6 at scsibus5 targ 1 lun 0: <OPENBSD, SR RAID 1, 006>
sd6: 476939MB, 512 bytes/sector, 976772576 sectors
softraid0: trying to bring up sd7 degraded
sd7 at scsibus5 targ 2 lun 0: <OPENBSD, SR RAID 5, 006>
sd7: 3815457MB, 512 bytes/sector, 7814057216 sectors
softraid0: roaming device -> sd4a
root on sd6a (441e10d3d3aeca9d.a) swap on sd6b dump on sd6b
