On Sun, Dec 22, 2024 at 10:11:57PM +0200, Divan Santana wrote: > Chris Cappuccio <ch...@nmedia.net> writes: > > > Divan Santana [di...@santanas.co.za] wrote: > >> Greetings :) > >> > >> So I have two openbsd76 systems. A backup and primary. > >> > >> This alpine vm boots on the backup but not the primary. > >> > >> I have copied the vm between the two and done an md5 on both sides and > >> the file is identical. For some reason it boots on the backup server > >> but not the primary server. > >> > >> Here is console output of the failed boot. Any idea what the below means? > >> > >> > >> [ 0.509998] Loaded X.509 cert 'alpinelinux.org: Alpine Linux kernel > >> key: d76a695f66ad9cd28f5c22a8508f36e91f521f7a' > >> [ 0.509998] Demotion targets for Node 0: null > >> [ 0.509998] Key type .fscrypt registered > >> [ 0.509998] Key type fscrypt-provisioning registered > >> [ 0.509998] Unstable clock detected, switching default tracing clock to > >> "global" > >> [ 0.509998] If you want to keep using the local clock, then add: > >> [ 0.509998] "trace_clock=local" > >> [ 0.509998] on the kernel command line > >> [ 0.509998] clk: Disabling unused clocks > >> [ 0.509998] PM: genpd: Disabling unused power domains > >> [ 0.509998] Freeing unused kernel image (initmem) memory: 3572K > >> [ 0.509998] Write protecting the kernel read-only data: 22528k > >> [ 0.509998] Freeing unused kernel image (rodata/data gap) memory: 584K > >> [ 0.509998] Run /init as init process > >> [ 0.509998] ------------[ cut here ]------------ > >> [ 0.509998] WARNING: CPU: 0 PID: 1 at arch/x86/kernel/fpu/xstate.c:1009 > >> get_xsave_addr_user+0x34/0x50 > > > > Try passing noxsave to the linux kernel during boot. Maybe vmm is not > > properly handling some of these CPU flags. > > This fixes the issue for me. Thanks a lot Chris. > > I was surprised, because previously alpine ran on this same system > without issue. Perhaps it's since the 3.21 upgrade that triggered the > bug. >
So 3.20 works and 3.21 fails? If so, I can take a look. Is this dmesg below from the machine on which 3.21 fails? -ml > > >> dmesg below: > >> > >> cpu0: AMD Ryzen 9 7900 12-Core Processor, 3700.01 MHz, 19-61-02, patch > >> 0a601209 > >> cpu0: cpuid 1 > >> edx=178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT> > >> > >> ecx=76d8320b<SSE3,PCLMUL,MWAIT,SSSE3,FMA3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AES,XSAVE,AVX,F16C,RDRAND> > >> cpu0: cpuid 6 eax=4<ARAT> ecx=1<EFFFREQ> > >> cpu0: cpuid 7.0 > >> ebx=f1bf97a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,AVX512F,AVX512DQ,RDSEED,ADX,SMAP,AVX512IFMA,CLFLUSHOPT,CLWB,AVX512CD,SHA,AVX512BW,AVX512VL> > >> ecx=405fce<AVX512VBMI,UMIP,PKU> edx=10000010<L1DF> > >> cpu0: cpuid d.1 eax=f<XSAVEOPT,XSAVEC,XGETBV1,XSAVES> > >> cpu0: cpuid 80000001 edx=2fd3fbff<NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG> > >> ecx=75c237ff<LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,IBS,SKINIT,TCE,TOPEXT,CPCTR,DBKP,PCTRL3,MWAITX> > >> cpu0: cpuid 80000007 edx=6799<HWPSTATE,ITSC> > >> cpu0: cpuid 80000008 > >> ebx=791ef257<IBPB,IBRS,STIBP,STIBP_ALL,IBRS_PREF,IBRS_SM,SSBD> > >> cpu0: cpuid 8000001F eax=1<SME> > > > > Are the working and non-working servers the same? > > No. Yeah, the above is the broken system (new amd ryzen 9) and below is > the old system which worked without issue. > > OpenBSD 7.6 (GENERIC.MP) #338: Mon Sep 30 08:55:35 MDT 2024 > dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP > real mem = 34304724992 (32715MB) > avail mem = 33241415680 (31701MB) > random: good seed from bootblocks > mpath0 at root > scsibus0 at mpath0: 256 targets > mainbus0 at root > bios0 at mainbus0: SMBIOS rev. 2.6 @ 0xeb1d0 (104 entries) > bios0: vendor American Megatrends Inc. version "3703" date 07/16/2013 > bios0: ASUSTeK COMPUTER INC. P8P67-M > acpi0 at bios0: ACPI 4.0 > acpi0: sleep states S0 S1 S3 S4 S5 > acpi0: tables DSDT FACP APIC MCFG HPET SSDT SSDT SSDT DMAR > acpi0: wakeup devices UAR1(S4) P0P1(S4) RP01(S4) PXSX(S4) RP02(S4) PXSX(S4) > RP03(S4) PXSX(S4) RP04(S4) PXSX(S4) RP06(S4) PXSX(S4) RP07(S4) PXSX(S4) > RP08(S4) PXSX(S4) [...] > acpitimer0 at acpi0: 3579545 Hz, 24 bits > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat > cpu0 at mainbus0: apid 0 (boot processor) > cpu0: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.26 MHz, 06-2a-07, patch > 0000002f > cpu0: cpuid 1 > edx=bfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > > ecx=17bae3ff<SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,AES,XSAVE,AVX> > cpu0: cpuid 6 eax=77<SENSOR,ARAT> ecx=9<EFFFREQ> > cpu0: cpuid 7.0 edx=9c000400<MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD> > cpu0: cpuid a vers=3, gp=4, gpwidth=48, ff=3, ffwidth=48 > cpu0: cpuid d.1 eax=1<XSAVEOPT> > cpu0: cpuid 80000001 edx=28100800<NXE,RDTSCP,LONG> ecx=1<LAHF> > cpu0: cpuid 80000007 edx=100<ITSC> > cpu0: MELTDOWN > cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB > 64b/line 8-way L2 cache, 8MB 64b/line 16-way L3 cache > cpu0: smt 0, core 0, package 0 > mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges > cpu0: apic clock running at 100MHz > cpu0: mwait min=64, max=64, C-substates=0.2.1.1, IBE > cpu1 at mainbus0: apid 2 (application processor) > cpu1: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.28 MHz, 06-2a-07, patch > 0000002f > cpu1: smt 0, core 1, package 0 > cpu2 at mainbus0: apid 4 (application processor) > cpu2: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.34 MHz, 06-2a-07, patch > 0000002f > cpu2: smt 0, core 2, package 0 > cpu3 at mainbus0: apid 6 (application processor) > cpu3: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.41 MHz, 06-2a-07, patch > 0000002f > cpu3: smt 0, core 3, package 0 > cpu4 at mainbus0: apid 1 (application processor) > cpu4: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3412.03 MHz, 06-2a-07, patch > 0000002f > cpu4: smt 1, core 0, package 0 > cpu5 at mainbus0: apid 3 (application processor) > cpu5: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.95 MHz, 06-2a-07, patch > 0000002f > cpu5: smt 1, core 1, package 0 > cpu6 at mainbus0: apid 5 (application processor) > cpu6: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.71 MHz, 06-2a-07, patch > 0000002f > cpu6: smt 1, core 2, package 0 > cpu7 at mainbus0: apid 7 (application processor) > cpu7: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 3411.53 MHz, 06-2a-07, patch > 0000002f > cpu7: smt 1, core 3, package 0 > ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins > acpimcfg0 at acpi0 > acpimcfg0: addr 0xf8000000, bus 0-63 > acpihpet0 at acpi0: 14318179 Hz > acpiprt0 at acpi0: bus 0 (PCI0) > acpiprt1 at acpi0: bus -1 (P0P1) > acpiprt2 at acpi0: bus 2 (RP01) > acpiprt3 at acpi0: bus -1 (RP02) > acpiprt4 at acpi0: bus -1 (RP03) > acpiprt5 at acpi0: bus 3 (RP04) > acpiprt6 at acpi0: bus 6 (RP06) > acpiprt7 at acpi0: bus 7 (RP07) > acpiprt8 at acpi0: bus 8 (RP08) > acpiprt9 at acpi0: bus 1 (PEG0) > acpiprt10 at acpi0: bus -1 (PEG1) > acpiprt11 at acpi0: bus -1 (PEG2) > acpiprt12 at acpi0: bus -1 (PEG3) > acpiprt13 at acpi0: bus 4 (RP05) > acpiprt14 at acpi0: bus 5 (PXSX) > acpiec0 at acpi0: not present > acpipci0 at acpi0 PCI0: 0x00000004 0x00000011 0x00000001 > acpicmos0 at acpi0 > com0 at acpi0 UAR1 addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo > acpibtn0 at acpi0: PWRB(wakeup) > "PNP0C0B" at acpi0 not configured > "PNP0C0B" at acpi0 not configured > "PNP0C0B" at acpi0 not configured > "PNP0C0B" at acpi0 not configured > "PNP0C0B" at acpi0 not configured > "PNP0C14" at acpi0 not configured > acpicpu0 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), > C1(1000@1 mwait.1), PSS > acpicpu1 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), > C1(1000@1 mwait.1), PSS > acpicpu2 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), > C1(1000@1 mwait.1), PSS > acpicpu3 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), > C1(1000@1 mwait.1), PSS > acpicpu4 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), > C1(1000@1 mwait.1), PSS > acpicpu5 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), > C1(1000@1 mwait.1), PSS > acpicpu6 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), > C1(1000@1 mwait.1), PSS > acpicpu7 at acpi0: C3(350@104 mwait.1@0x20), C2(500@80 mwait.1@0x10), > C1(1000@1 mwait.1), PSS > acpipwrres0 at acpi0: FN00, resource for FAN0 > acpipwrres1 at acpi0: FN01, resource for FAN1 > acpipwrres2 at acpi0: FN02, resource for FAN2 > acpipwrres3 at acpi0: FN03, resource for FAN3 > acpipwrres4 at acpi0: FN04, resource for FAN4 > acpitz0 at acpi0: critical temperature is 99 degC > acpitz1 at acpi0: critical temperature is 99 degC > acpivideo0 at acpi0: GFX0 > acpivout0 at acpivideo0: DD02 > cpu0: using VERW MDS workaround (except on vmm entry) > cpu0: Enhanced SpeedStep 3411 MHz: speeds: 3401, 3400, 3300, 3100, 3000, > 2900, 2800, 2600, 2500, 2400, 2200, 2100, 2000, 1900, 1700, 1600 MHz > pci0 at mainbus0 bus 0 > pchb0 at pci0 dev 0 function 0 "Intel Core 2G Host" rev 0x09 > ppb0 at pci0 dev 1 function 0 "Intel Core 2G PCIE" rev 0x09: msi > pci1 at ppb0 bus 1 > vga1 at pci1 dev 0 function 0 vendor "NVIDIA", unknown product 0x128b rev 0xa1 > wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) > wsdisplay0: screen 1-5 added (80x25, vt100 emulation) > azalia0 at pci1 dev 0 function 1 vendor "NVIDIA", unknown product 0x0e0f rev > 0xa1: msi > azalia0: no supported codecs > "Intel 6 Series MEI" rev 0x04 at pci0 dev 22 function 0 not configured > ehci0 at pci0 dev 26 function 0 "Intel 6 Series USB" rev 0x05: apic 2 int 23 > usb0 at ehci0: USB revision 2.0 > uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 > addr 1 > azalia1 at pci0 dev 27 function 0 "Intel 6 Series HD Audio" rev 0x05: msi > azalia1: codecs: Realtek ALC887 > audio0 at azalia1 > ppb1 at pci0 dev 28 function 0 "Intel 6 Series PCIE" rev 0xb5: msi > pci2 at ppb1 bus 2 > ppb2 at pci0 dev 28 function 3 "Intel 6 Series PCIE" rev 0xb5: msi > pci3 at ppb2 bus 3 > re0 at pci3 dev 0 function 0 "Realtek 8168" rev 0x01: RTL8168 2 (0x3800), > msi, address 00:e0:4c:1e:c5:df > rgephy0 at re0 phy 7: RTL8169S/8110S/8211, rev. 2 > ppb3 at pci0 dev 28 function 4 "Intel 82801BA Hub-to-PCI" rev 0xb5: msi > pci4 at ppb3 bus 4 > ppb4 at pci4 dev 0 function 0 "ASMedia ASM1083/1085 PCIE-PCI" rev 0x01 > pci5 at ppb4 bus 5 > puc0 at pci5 dev 0 function 0 "NetMos Nm9865" rev 0x00: ports: 16 com > com4 at puc0 port 0 apic 2 int 16: st16650, 32 byte fifo > puc1 at pci5 dev 0 function 1 "NetMos Nm9865" rev 0x00: ports: 16 com > com5 at puc1 port 0 apic 2 int 17: st16650, 32 byte fifo > ppb5 at pci0 dev 28 function 5 "Intel 6 Series PCIE" rev 0xb5: msi > pci6 at ppb5 bus 6 > jmb0 at pci6 dev 0 function 0 "JMicron JMB361 IDE/SATA" rev 0x10 > ahci0 at jmb0: apic 2 int 17, AHCI 1.1 > scsibus1 at ahci0: 32 targets > pciide0 at jmb0: DMA, channel 0 wired to native-PCI, channel 1 wired to > native-PCI > pciide0: using apic 2 int 17 for native-PCI interrupt > pciide0: channel 0 disabled (no drives) > pciide0: channel 1 disabled (no drives) > ppb6 at pci0 dev 28 function 6 "Intel 6 Series PCIE" rev 0xb5: msi > pci7 at ppb6 bus 7 > re1 at pci7 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E > (0x2c00), msi, address f4:6d:04:d9:f4:2c > rgephy1 at re1 phy 7: RTL8169S/8110S/8211, rev. 4 > ppb7 at pci0 dev 28 function 7 "Intel 6 Series PCIE" rev 0xb5: msi > pci8 at ppb7 bus 8 > xhci0 at pci8 dev 0 function 0 "ASMedia ASM1042 xHCI" rev 0x00: msix, xHCI > 0.96 > usb1 at xhci0: USB revision 3.0 > uhub1 at usb1 configuration 1 interface 0 "ASMedia xHCI root hub" rev > 3.00/1.00 addr 1 > ehci1 at pci0 dev 29 function 0 "Intel 6 Series USB" rev 0x05: apic 2 int 23 > usb2 at ehci1: USB revision 2.0 > uhub2 at usb2 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 > addr 1 > pcib0 at pci0 dev 31 function 0 "Intel P67 LPC" rev 0x05 > ahci1 at pci0 dev 31 function 2 "Intel 6 Series AHCI" rev 0x05: msi, AHCI 1.3 > ahci1: port 0: 6.0Gb/s > ahci1: port 1: 6.0Gb/s > ahci1: port 3: 3.0Gb/s > ahci1: port 4: 3.0Gb/s > ahci1: port 5: 3.0Gb/s > scsibus2 at ahci1: 32 targets > sd0 at scsibus2 targ 0 lun 0: <ATA, CT500MX500SSD1, M3CR> naa.500a0751e210c4c9 > sd0: 476940MB, 512 bytes/sector, 976773168 sectors, thin > sd1 at scsibus2 targ 1 lun 0: <ATA, CT500MX500SSD1, M3CR> naa.500a0751e2029946 > sd1: 476940MB, 512 bytes/sector, 976773168 sectors, thin > sd2 at scsibus2 targ 3 lun 0: <ATA, ST2000DM006-2DM1, CC26> > naa.5000c500b0037f38 > sd2: 1907729MB, 512 bytes/sector, 3907029168 sectors > sd3 at scsibus2 targ 4 lun 0: <ATA, ST32000641AS, CC13> naa.5000c5003646094a > sd3: 1907729MB, 512 bytes/sector, 3907029168 sectors > sd4 at scsibus2 targ 5 lun 0: <ATA, ST2000DM006-2DM1, CC26> > naa.5000c500b1734f1c > sd4: 1907729MB, 512 bytes/sector, 3907029168 sectors > ichiic0 at pci0 dev 31 function 3 "Intel 6 Series SMBus" rev 0x05: apic 2 int > 18 > iic0 at ichiic0 > spdmem0 at iic0 addr 0x50: 8GB DDR3 SDRAM PC3-12800 > spdmem1 at iic0 addr 0x51: 8GB DDR3 SDRAM PC3-12800 > spdmem2 at iic0 addr 0x52: 8GB DDR3 SDRAM PC3-12800 > spdmem3 at iic0 addr 0x53: 8GB DDR3 SDRAM PC3-12800 > isa0 at pcib0 > isadma0 at isa0 > pckbc0 at isa0 port 0x60/5 irq 1 irq 12 > pckbd0 at pckbc0 (kbd slot) > wskbd0 at pckbd0: console keyboard, using wsdisplay0 > pcppi0 at isa0 port 0x61 > spkr0 at pcppi0 > lpt0 at isa0 port 0x378/4 irq 7 > wbsio0 at isa0 port 0x2e/2: NCT6776F rev 0x33 > lm1 at wbsio0 port 0x290/8: NCT6776F > vmm0 at mainbus0: VMX/EPT > uhub3 at uhub0 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" > rev 2.00/0.00 addr 2 > uhidev0 at uhub3 port 2 configuration 1 interface 0 "Logitech Wireless > Receiver" rev 1.10/3.08 addr 3 > uhidev0: iclass 3/1, 5 report ids > ums0 at uhidev0 reportid 1: 5 buttons, Z dir > wsmouse0 at ums0 mux 0 > uhid0 at uhidev0 reportid 5: input=0, output=0, feature=7 > umass0 at uhub1 port 1 configuration 1 interface 0 "TOSHIBA EXTERNAL_USB" rev > 3.00/0.00 addr 2 > umass0: using SCSI over Bulk-Only > scsibus3 at umass0: 2 targets, initiator 0 > sd5 at scsibus3 targ 1 lun 0: <TOSHIBA, EXTERNAL_USB, 0> > serial.0480090640523010721F > sd5: 953869MB, 512 bytes/sector, 1953525168 sectors > uhub4 at uhub2 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" > rev 2.00/0.00 addr 2 > uhidev1 at uhub4 port 1 configuration 1 interface 0 "Logitech USB Keyboard" > rev 1.10/62.00 addr 3 > uhidev1: iclass 3/1 > ukbd0 at uhidev1: 8 variable keys, 6 key codes > wskbd1 at ukbd0 mux 1 > wskbd1: connecting to wsdisplay0 > uhidev2 at uhub4 port 1 configuration 1 interface 1 "Logitech USB Keyboard" > rev 1.10/62.00 addr 3 > uhidev2: iclass 3/0 > ucc0 at uhidev2: 1301 usages, 20 keys, array > wskbd2 at ucc0 mux 1 > wskbd2: connecting to wsdisplay0 > vscsi0 at root > scsibus4 at vscsi0: 256 targets > softraid0 at root > scsibus5 at softraid0: 256 targets > sd6 at scsibus5 targ 1 lun 0: <OPENBSD, SR RAID 1, 006> > sd6: 476939MB, 512 bytes/sector, 976772576 sectors > softraid0: trying to bring up sd7 degraded > sd7 at scsibus5 targ 2 lun 0: <OPENBSD, SR RAID 5, 006> > sd7: 3815457MB, 512 bytes/sector, 7814057216 sectors > softraid0: roaming device -> sd4a > root on sd6a (441e10d3d3aeca9d.a) swap on sd6b dump on sd6b >