I have a Thinkpad Z61m on loan with the 1st Sept i386 snapshot installed. I see a huge performance penalty with the multiprocessor kernel. The system is as installed, no mk.conf etc.
An example, 'time make bsd' with mp and up kernel. mp kernel: 41m36s real 4m12.26s user 38m50.02s system up kernel: 4m10.02s real 3m43.74s user 0m24.26s system Top confirmed this: CPU0 states: 8.8% user, 0.0% nice, 89.6% system, 0.0% interrupt, 1.6% idle CPU1 states: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle Here are various vmstat results while the compile is running and a dmesg from both kernels. Maybe irq0/ipi looks suspicious? I don't know. OpenBSD 4.0 (GENERIC.MP) #933: Fri Sep 1 12:06:05 MDT 2006 [EMAIL PROTECTED]:/usr/src/sys/arch/i386/compile/GENERIC.MP cpu0: Genuine Intel(R) CPU T2500 @ 2.00GHz ("GenuineIntel" 686-class) 2 GHz cpu0: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,VMX,EST,TM2 real mem = 1072066560 (1046940K) avail mem = 969912320 (947180K) using 4256 buffers containing 53706752 bytes (52448K) of memory mainbus0 (root) bios0 at mainbus0: AT/286+(57) BIOS, date 06/20/06, BIOS32 rev. 0 @ 0xfd6b0, SMBIOS rev. 2.4 @ 0xe0010 (68 entries) bios0: LENOVO 94503HG pcibios0 at bios0: rev 2.1 @ 0xfd640/0x9c0 pcibios0: PCI IRQ Routing Table rev 1.0 @ 0xfdea0/272 (15 entries) pcibios0: PCI Interrupt Router at 000:31:0 ("Intel 82371FB ISA" rev 0x00) pcibios0: PCI bus #22 is the last bus bios0: ROM list: 0xc0000/0xfe00 0xd0000/0x1600 0xd1800/0x1000 0xdc000/0x4000! 0xe0000/0x10000 mainbus0: Intel MP Specification (Version 1.4) (INTEL Napa ERB ) cpu0 at mainbus0: apid 0 (boot processor) cpu0: apic clock running at 166 MHz cpu1 at mainbus0: apid 1 (application processor) cpu1: Genuine Intel(R) CPU T2500 @ 2.00GHz ("GenuineIntel" 686-class) 2 GHz cpu1: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,VMX,EST,TM2 mainbus0: bus 0 is type PCI mainbus0: bus 1 is type PCI mainbus0: bus 2 is type PCI mainbus0: bus 3 is type PCI mainbus0: bus 21 is type PCI mainbus0: bus 22 is type ISA ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins pci0 at mainbus0 bus 0: configuration mode 1 (no bios) pchb0 at pci0 dev 0 function 0 "Intel 82945GM MCH" rev 0x03 ppb0 at pci0 dev 1 function 0 "Intel 82945GM PCIE" rev 0x03 pci1 at ppb0 bus 1 vga1 at pci1 dev 0 function 0 vendor "ATI", unknown product 0x7145 rev 0x00 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) azalia0 at pci0 dev 27 function 0 "Intel 82801GB HD Audio" rev 0x02: apic 2 int 11 (irq 11) azalia0: host: High Definition Audio rev. 1.0 azalia0: codec: Analog Devices AD1981HD (rev. 2.0), HDA version 1.0 azalia0: codec: 0x04x/0x14f1 (rev. 0.0), HDA version 0.9 azalia0: codec[1]: No support for modem function groups azalia0: codec[1]: No audio function groups audio0 at azalia0 ppb1 at pci0 dev 28 function 0 "Intel 82801GB PCIE" rev 0x02 pci2 at ppb1 bus 2 bge0 at pci2 dev 0 function 0 "Broadcom BCM5752M" rev 0x02, BCM5752 A2 (0x6002): apic 2 int 11 (irq 11)bge0: firmware handshake timed out , address 00:16:36:69:5f:6c brgphy0 at bge0 phy 1: BCM5752 10/100/1000baseT PHY, rev. 0 ppb2 at pci0 dev 28 function 1 "Intel 82801GB PCIE" rev 0x02 pci3 at ppb2 bus 3 wpi0 at pci3 dev 0 function 0 "Intel PRO/Wireless 3945ABG" rev 0x02: apic 2 int 11 (irq 11), address 00:13:02:99:92:4c ppb3 at pci0 dev 28 function 2 "Intel 82801GB PCIE" rev 0x02 pci4 at ppb3 bus 4 ppb4 at pci0 dev 28 function 3 "Intel 82801GB PCIE" rev 0x02 pci5 at ppb4 bus 12 uhci0 at pci0 dev 29 function 0 "Intel 82801GB USB" rev 0x02: apic 2 int 11 (irq 11) usb0 at uhci0: USB revision 1.0 uhub0 at usb0 uhub0: Intel UHCI root hub, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered uhci1 at pci0 dev 29 function 1 "Intel 82801GB USB" rev 0x02: apic 2 int 11 (irq 11) usb1 at uhci1: USB revision 1.0 uhub1 at usb1 uhub1: Intel UHCI root hub, rev 1.00/1.00, addr 1 uhub1: 2 ports with 2 removable, self powered uhci2 at pci0 dev 29 function 2 "Intel 82801GB USB" rev 0x02: apic 2 int 11 (irq 11) usb2 at uhci2: USB revision 1.0 uhub2 at usb2 uhub2: Intel UHCI root hub, rev 1.00/1.00, addr 1 uhub2: 2 ports with 2 removable, self powered uhci3 at pci0 dev 29 function 3 "Intel 82801GB USB" rev 0x02: apic 2 int 11 (irq 11) usb3 at uhci3: USB revision 1.0 uhub3 at usb3 uhub3: Intel UHCI root hub, rev 1.00/1.00, addr 1 uhub3: 2 ports with 2 removable, self powered ehci0 at pci0 dev 29 function 7 "Intel 82801GB USB" rev 0x02: apic 2 int 11 (irq 11) usb4 at ehci0: USB revision 2.0 uhub4 at usb4 uhub4: Intel EHCI root hub, rev 2.00/1.00, addr 1 uhub4: 8 ports with 8 removable, self powered ppb5 at pci0 dev 30 function 0 "Intel 82801BAM Hub-to-PCI" rev 0xe2 pci6 at ppb5 bus 21 cbb0 at pci6 dev 0 function 0 vendor "TI", unknown product 0x8039 rev 0x00: apic 2 int 11 (irq 11) vendor "TI", unknown product 0x803a (class serial bus subclass Firewire, rev 0x00) at pci6 dev 0 function 1 not configured vendor "TI", unknown product 0x803b (class mass storage subclass miscellaneous, rev 0x00) at pci6 dev 0 function 2 not configured sdhc0 at pci6 dev 0 function 3 vendor "TI", unknown product 0x803c rev 0x00: apic 2 int 11 (irq 11) sdmmc0 at sdhc0 cardslot0 at cbb0 slot 0 flags 0 cardbus0 at cardslot0: bus 22 device 0 cacheline 0x8, lattimer 0xb0 pcmcia0 at cardslot0 ichpcib0 at pci0 dev 31 function 0 "Intel 82801GBM LPC" rev 0x02: PM disabled pciide0 at pci0 dev 31 function 1 "Intel 82801GB IDE" rev 0x02: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility atapiscsi0 at pciide0 channel 0 drive 0 scsibus0 at atapiscsi0: 2 targets cd0 at scsibus0 targ 0 lun 0: <MATSHITA, DVD-RAM UJ-850, RB01> SCSI0 5/cdrom removable cd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2 pciide0: channel 1 ignored (disabled) pciide1 at pci0 dev 31 function 2 "Intel 82801GBM AHCI SATA" rev 0x02: DMA, channel 0 wired to native-PCI, channel 1 wired to native-PCI pciide1: using apic 2 int 11 (irq 11) for native-PCI interrupt wd0 at pciide1 channel 0 drive 0: <HTS541010G9SA00> wd0: 16-sector PIO, LBA48, 95396MB, 195371568 sectors wd0(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 5 ichiic0 at pci0 dev 31 function 3 "Intel 82801GB SMBus" rev 0x02: apic 2 int 11 (irq 11) iic0 at ichiic0 isa0 at ichpcib0 isadma0 at isa0 pckbc0 at isa0 port 0x60/5 pckbd0 at pckbc0 (kbd slot) pckbc0: using irq 1 for kbd slot wskbd0 at pckbd0: console keyboard, using wsdisplay0 pms0 at pckbc0 (aux slot) pckbc0: using irq 12 for aux slot wsmouse0 at pms0 mux 0 pcppi0 at isa0 port 0x61 midi0 at pcppi0: <PC speaker> spkr0 at pcppi0 npx0 at isa0 port 0xf0/16: using exception 16 biomask 0 netmask 0 ttymask 0 ioapic0: pin 11 shares different IPL interrupts (40..90), degraded performance pctr: 686-class user-level performance counters enabled mtrr: Pentium Pro MTRR support uhub5 at uhub4 port 5 uhub5: Standard Microsystems product 0x2502, rev 2.00/0.00, addr 2 uhub5: 2 ports with 2 removable, self powered, single transaction translator ugen0 at uhub5 port 2 ugen0: Microdia USB20 Camera, rev 2.00/1.00, addr 3 ugen1 at uhub2 port 2 ugen1: STMicroelectronics Biometric Coprocessor, rev 1.00/0.01, addr 2 uhidev0 at uhub1 port 1 configuration 1 interface 0 uhidev0: Logitech USB Mouse, rev 1.10/6.20, addr 2, iclass 3/1 ums0 at uhidev0: 3 buttons and Z dir. wsmouse1 at ums0 mux 0 dkcsum: wd0 matches BIOS drive 0x80 root on wd0a rootdev=0x0 rrootdev=0x300 rawdev=0x302 bge0: firmware handshake timed out $ vmstat procs memory page disks traps cpu r b w avm fre flt re pi po fr sr cd0 wd0 int sys cs us sy id 1 0 0 12024 900936 1601 0 0 0 0 0 0 9 39774 1691 26 4 36 60 $ vmstat -iz interrupt total rate irq0/clock 578228 207 irq0/ipi 5670579 2032 irq64/azalia0 1 0 irq64/bge0 1476 0 irq64/wpi0 1 0 irq64/uhci0 0 0 irq64/uhci1 18 0 irq64/uhci2 19 0 irq64/uhci3 0 0 irq64/ehci0 38 0 irq64/cbb0 0 0 irq64/sdhc0 0 0 irq65/pciide0 0 0 irq64/pciide1 9665 3 irq64/ichiic0 0 0 irq112/pckbc0 1404 0 irq113/pckbc0 0 0 Total 6261429 2244 $ vmstat -s 4096 bytes per page 256271 pages managed 222370 pages free 7037 pages active 4566 pages inactive 0 pages being paged out 78 pages wired 0 pages zeroed 4 pages reserved for pagedaemon 6 pages reserved for kernel 262205 swap pages 0 swap pages in use 501895 total anon's in system 496171 free anon's 4742048 page faults 4756115 traps 113564954 interrupts 69855 cpu context switches 7231 fpu context switches 49838 software interrupts 4331862 syscalls 0 pagein operations 0 swap ins 0 swap outs 5061 forks 17 forks where vmspace is shared 98 kernel map entries 0 number of times the pagedaemon woke up 0 revolutions of the clock hand 0 pages freed by pagedaemon 0 pages scanned by pagedaemon 0 pages reactivated by pagedaemon 0 busy pages found by pagedaemon 2015996 total name lookups cache hits (87% pos + 11% neg) system 0% per-directory deletions 0%, falsehits 0%, toolong 0% 0 select collisions OpenBSD 4.0 (GENERIC) #1104: Fri Sep 1 11:54:27 MDT 2006 [EMAIL PROTECTED]:/usr/src/sys/arch/i386/compile/GENERIC cpu0: Genuine Intel(R) CPU T2500 @ 2.00GHz ("GenuineIntel" 686-class) 2 GHz cpu0: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,VMX,EST,TM2 cpu0: unknown Enhanced SpeedStep CPU, msr 0x06130c2c06000c2c cpu0: using only highest and lowest power states cpu0: Enhanced SpeedStep 2000 MHz (1404 mV): speeds: 2000, 1000 MHz real mem = 1072066560 (1046940K) avail mem = 969969664 (947236K) using 4256 buffers containing 53706752 bytes (52448K) of memory mainbus0 (root) bios0 at mainbus0: AT/286+(af) BIOS, date 06/20/06, BIOS32 rev. 0 @ 0xfd6b0, SMBIOS rev. 2.4 @ 0xe0010 (68 entries) bios0: LENOVO 94503HG pcibios0 at bios0: rev 2.1 @ 0xfd640/0x9c0 pcibios0: PCI IRQ Routing Table rev 1.0 @ 0xfdea0/272 (15 entries) pcibios0: PCI Interrupt Router at 000:31:0 ("Intel 82371FB ISA" rev 0x00) pcibios0: PCI bus #22 is the last bus bios0: ROM list: 0xc0000/0xfe00 0xd0000/0x1600 0xd1800/0x1000 0xdc000/0x4000! 0xe0000/0x10000 cpu0 at mainbus0 pci0 at mainbus0 bus 0: configuration mode 1 (no bios) pchb0 at pci0 dev 0 function 0 "Intel 82945GM MCH" rev 0x03 ppb0 at pci0 dev 1 function 0 "Intel 82945GM PCIE" rev 0x03 pci1 at ppb0 bus 1 vga1 at pci1 dev 0 function 0 vendor "ATI", unknown product 0x7145 rev 0x00 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) azalia0 at pci0 dev 27 function 0 "Intel 82801GB HD Audio" rev 0x02: irq 11 azalia0: host: High Definition Audio rev. 1.0 azalia0: codec: Analog Devices AD1981HD (rev. 2.0), HDA version 1.0 azalia0: codec: 0x04x/0x14f1 (rev. 0.0), HDA version 0.9 azalia0: codec[1]: No support for modem function groups azalia0: codec[1]: No audio function groups audio0 at azalia0 ppb1 at pci0 dev 28 function 0 "Intel 82801GB PCIE" rev 0x02 pci2 at ppb1 bus 2 bge0 at pci2 dev 0 function 0 "Broadcom BCM5752M" rev 0x02, BCM5752 A2 (0x6002): irq 11bge0: firmware handshake timed out , address 00:16:36:69:5f:6c brgphy0 at bge0 phy 1: BCM5752 10/100/1000baseT PHY, rev. 0 ppb2 at pci0 dev 28 function 1 "Intel 82801GB PCIE" rev 0x02 pci3 at ppb2 bus 3 wpi0 at pci3 dev 0 function 0 "Intel PRO/Wireless 3945ABG" rev 0x02: irq 11, address 00:13:02:99:92:4c ppb3 at pci0 dev 28 function 2 "Intel 82801GB PCIE" rev 0x02 pci4 at ppb3 bus 4 ppb4 at pci0 dev 28 function 3 "Intel 82801GB PCIE" rev 0x02 pci5 at ppb4 bus 12 uhci0 at pci0 dev 29 function 0 "Intel 82801GB USB" rev 0x02: irq 11 usb0 at uhci0: USB revision 1.0 uhub0 at usb0 uhub0: Intel UHCI root hub, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered uhci1 at pci0 dev 29 function 1 "Intel 82801GB USB" rev 0x02: irq 11 usb1 at uhci1: USB revision 1.0 uhub1 at usb1 uhub1: Intel UHCI root hub, rev 1.00/1.00, addr 1 uhub1: 2 ports with 2 removable, self powered uhci2 at pci0 dev 29 function 2 "Intel 82801GB USB" rev 0x02: irq 11 usb2 at uhci2: USB revision 1.0 uhub2 at usb2 uhub2: Intel UHCI root hub, rev 1.00/1.00, addr 1 uhub2: 2 ports with 2 removable, self powered uhci3 at pci0 dev 29 function 3 "Intel 82801GB USB" rev 0x02: irq 11 usb3 at uhci3: USB revision 1.0 uhub3 at usb3 uhub3: Intel UHCI root hub, rev 1.00/1.00, addr 1 uhub3: 2 ports with 2 removable, self powered ehci0 at pci0 dev 29 function 7 "Intel 82801GB USB" rev 0x02: irq 11 usb4 at ehci0: USB revision 2.0 uhub4 at usb4 uhub4: Intel EHCI root hub, rev 2.00/1.00, addr 1 uhub4: 8 ports with 8 removable, self powered ppb5 at pci0 dev 30 function 0 "Intel 82801BAM Hub-to-PCI" rev 0xe2 pci6 at ppb5 bus 21 cbb0 at pci6 dev 0 function 0 vendor "TI", unknown product 0x8039 rev 0x00: irq 11 vendor "TI", unknown product 0x803a (class serial bus subclass Firewire, rev 0x00) at pci6 dev 0 function 1 not configured vendor "TI", unknown product 0x803b (class mass storage subclass miscellaneous, rev 0x00) at pci6 dev 0 function 2 not configured sdhc0 at pci6 dev 0 function 3 vendor "TI", unknown product 0x803c rev 0x00: irq 11 sdmmc0 at sdhc0 cardslot0 at cbb0 slot 0 flags 0 cardbus0 at cardslot0: bus 22 device 0 cacheline 0x8, lattimer 0xb0 pcmcia0 at cardslot0 ichpcib0 at pci0 dev 31 function 0 "Intel 82801GBM LPC" rev 0x02: PM disabled pciide0 at pci0 dev 31 function 1 "Intel 82801GB IDE" rev 0x02: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility atapiscsi0 at pciide0 channel 0 drive 0 scsibus0 at atapiscsi0: 2 targets cd0 at scsibus0 targ 0 lun 0: <MATSHITA, DVD-RAM UJ-850, RB01> SCSI0 5/cdrom removable cd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2 pciide0: channel 1 ignored (disabled) pciide1 at pci0 dev 31 function 2 "Intel 82801GBM AHCI SATA" rev 0x02: DMA, channel 0 wired to native-PCI, channel 1 wired to native-PCI pciide1: using irq 11 for native-PCI interrupt wd0 at pciide1 channel 0 drive 0: <HTS541010G9SA00> wd0: 16-sector PIO, LBA48, 95396MB, 195371568 sectors wd0(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 5 ichiic0 at pci0 dev 31 function 3 "Intel 82801GB SMBus" rev 0x02: irq 11 iic0 at ichiic0 isa0 at ichpcib0 isadma0 at isa0 pckbc0 at isa0 port 0x60/5 pckbd0 at pckbc0 (kbd slot) pckbc0: using irq 1 for kbd slot wskbd0 at pckbd0: console keyboard, using wsdisplay0 pms0 at pckbc0 (aux slot) pckbc0: using irq 12 for aux slot wsmouse0 at pms0 mux 0 pcppi0 at isa0 port 0x61 midi0 at pcppi0: <PC speaker> spkr0 at pcppi0 npx0 at isa0 port 0xf0/16: using exception 16 biomask effd netmask effd ttymask ffff pctr: 686-class user-level performance counters enabled mtrr: Pentium Pro MTRR support uhub5 at uhub4 port 5 uhub5: Standard Microsystems product 0x2502, rev 2.00/0.00, addr 2 uhub5: 2 ports with 2 removable, self powered, single transaction translator ugen0 at uhub5 port 2 ugen0: Microdia USB20 Camera, rev 2.00/1.00, addr 3 ugen1 at uhub2 port 2 ugen1: STMicroelectronics Biometric Coprocessor, rev 1.00/0.01, addr 2 uhidev0 at uhub1 port 1 configuration 1 interface 0 uhidev0: Logitech USB Mouse, rev 1.10/6.20, addr 2, iclass 3/1 ums0 at uhidev0: 3 buttons and Z dir. wsmouse1 at ums0 mux 0 dkcsum: wd0 matches BIOS drive 0x80 root on wd0a rootdev=0x0 rrootdev=0x300 rawdev=0x302 bge0: firmware handshake timed out $ vmstat procs memory page disks traps cpu r b w avm fre flt re pi po fr sr cd0 wd0 int sys cs us sy id 1 1 0 28840 883528 12711 0 0 0 0 0 0 41 270 11920 101 61 9 30 $ vmstat -iz interrupt total rate irq11/azalia0 294 1 irq11/bge0 168 0 irq11/wpi0 1 0 irq11/uhci0 0 0 irq11/uhci1 18 0 irq11/uhci2 19 0 irq11/uhci3 0 0 irq11/ehci0 39 0 irq11/cbb0 0 0 irq11/sdhc0 0 0 irq14/pciide0 0 0 irq11/pciide1 7035 28 irq11/ichiic0 0 0 irq1/pckbc0 389 1 irq12/pckbc0 0 0 irq0/clock 25625 104 irq8/rtc 32803 133 Total 66391 270 $ vmstat -s 4096 bytes per page 256284 pages managed 218126 pages free 10328 pages active 5564 pages inactive 0 pages being paged out 75 pages wired 0 pages zeroed 4 pages reserved for pagedaemon 6 pages reserved for kernel 262205 swap pages 0 swap pages in use 501907 total anon's in system 492829 free anon's 3402976 page faults 3396808 traps 72742 interrupts 27442 cpu context switches 3480 fpu context switches 15077 software interrupts 3208941 syscalls 0 pagein operations 0 swap ins 0 swap outs 3625 forks 17 forks where vmspace is shared 104 kernel map entries 0 number of times the pagedaemon woke up 0 revolutions of the clock hand 0 pages freed by pagedaemon 0 pages scanned by pagedaemon 0 pages reactivated by pagedaemon 0 busy pages found by pagedaemon 1620437 total name lookups cache hits (87% pos + 11% neg) system 0% per-directory deletions 0%, falsehits 0%, toolong 0% 0 select collisions