On 06/29/13 08:15, Philip Guenther wrote: > On Fri, Jun 28, 2013 at 10:25 PM, Andreas Bartelt <o...@bartula.de> wrote: >> I also noticed that tar performance got much worse on current, and time for >> building release doubled somewhere around the first half of June. > > Hmm, please excuse my frustration, but I'm going to have to rant a moment. > > > Gaaaaah! > > Build performance *was cut in half* and you didn't say anything until > *at least two weeks later*!?!? > > No "last known good" date given for when things were fast. > No date given for when you first noticed that it had slowed down. > No definitive time measurements. > No dmesg or information about the system involved (softdeps? NFS? > hell, *architecture*?!?!) > > <additional text deleted> > > > Folks, if you're following -current and see a support or performance > regression, SAY SOMETHING. We test as much as we believe necessary > and reasonable, which means that sometimes we miss cases that are > actually show-stoppers and other times we're simply wrong. Delays in > reporting just make it harder. > >
sorry, I'm quite busy atm. My last known good /bsd.mp kernel is from June 7: OpenBSD 5.3-current (GENERIC.MP) #0: Fri Jun 7 07:15:17 CEST 2013 I first noticed this problem a couple of days later. I usually build release via the following script (12 cores, hyperthreading deactivated): # cat buildsrc.sh #!/bin/sh cd /usr/src &&\ make obj &&\ cd etc &&\ env DESTDIR=/ make distrib-dirs &&\ cd /usr/src &&\ make -j12 build &&\ export DESTDIR=/usr/destdir; export RELEASEDIR=/usr/releasedir &&\ cd /usr/src/etc &&\ make -j12 release &&\ cd /usr/src/distrib/sets &&\ sh checkflist &&\ unset RELEASEDIR DESTDIR time ./buildsrc.sh took about 41 minutes at 5.3 release, then went down to 32 minutes at some point afterwards. At some point after June 7th, build time doubled to 64 minutes. As I already mentioned, tar got very slow. softdep is enabled on this box, kern.bufcachepercent=40, system is on a raid0 drive which spans over 2 ciss(4) HW raid1 drives. ciss(4) performance generally isn't optimal but I suppose this isn't directly related to the problem described above. # mount /dev/sd2a on / type ffs (local, noatime, softdep) /dev/sd2e on /usr type ffs (local, noatime, nodev, softdep) /dev/sd2d on /var type ffs (local, noatime, nodev, nosuid, softdep) # bioctl sd2 Volume Status Size Device softraid0 0 Online 599704600576 sd2 RAID0 0 Online 299852318720 0:0.0 noencl <sd0d> 1 Online 299852318720 0:1.0 noencl <sd1d> Best Regards Andreas OpenBSD 5.3-current (GENERIC.MP) #0: Thu Jun 27 22:50:00 CEST 2013 root@test:/usr/src/sys/arch/amd64/compile/GENERIC.MP real mem = 17152794624 (16358MB) avail mem = 16688459776 (15915MB) mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.7 @ 0xdf7fe000 (127 entries) bios0: vendor HP version "P68" date 01/28/2011 bios0: HP ProLiant DL360 G7 acpi0 at bios0: rev 2 acpi0: sleep states S0 S4 S5 acpi0: tables DSDT FACP SPCR MCFG HPET FFFF SPMI ERST APIC SRAT FFFF BERT HEST DMAR SSDT SSDT SSDT SSDT SSDT acpi0: wakeup devices acpitimer0 at acpi0: 3579545 Hz, 24 bits acpimcfg0 at acpi0 addr 0xe0000000, bus 0-63 acpihpet0 at acpi0: 14318179 Hz acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz, 2667.16 MHz cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC cpu0: 256KB 64b/line 8-way L2 cache cpu0: smt 0, core 0, package 0 cpu0: apic clock running at 133MHz cpu1 at mainbus0: apid 32 (application processor) cpu1: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz, 2666.77 MHz cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC cpu1: 256KB 64b/line 8-way L2 cache cpu1: smt 0, core 0, package 1 cpu2 at mainbus0: apid 16 (application processor) cpu2: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz, 2666.77 MHz cpu2: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC cpu2: 256KB 64b/line 8-way L2 cache cpu2: smt 0, core 8, package 0 cpu3 at mainbus0: apid 48 (application processor) cpu3: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz, 2666.76 MHz cpu3: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC cpu3: 256KB 64b/line 8-way L2 cache cpu3: smt 0, core 8, package 1 cpu4 at mainbus0: apid 4 (application processor) cpu4: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz, 2666.77 MHz cpu4: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC cpu4: 256KB 64b/line 8-way L2 cache cpu4: smt 0, core 2, package 0 cpu5 at mainbus0: apid 36 (application processor) cpu5: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz, 2666.76 MHz cpu5: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC cpu5: 256KB 64b/line 8-way L2 cache cpu5: smt 0, core 2, package 1 cpu6 at mainbus0: apid 20 (application processor) cpu6: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz, 2666.77 MHz cpu6: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC cpu6: 256KB 64b/line 8-way L2 cache cpu6: smt 0, core 10, package 0 cpu7 at mainbus0: apid 52 (application processor) cpu7: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz, 2666.76 MHz cpu7: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC cpu7: 256KB 64b/line 8-way L2 cache cpu7: smt 0, core 10, package 1 cpu8 at mainbus0: apid 2 (application processor) cpu8: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz, 2666.77 MHz cpu8: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC cpu8: 256KB 64b/line 8-way L2 cache cpu8: smt 0, core 1, package 0 cpu9 at mainbus0: apid 34 (application processor) cpu9: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz, 2666.76 MHz cpu9: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC cpu9: 256KB 64b/line 8-way L2 cache cpu9: smt 0, core 1, package 1 cpu10 at mainbus0: apid 18 (application processor) cpu10: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz, 2666.77 MHz cpu10: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC cpu10: 256KB 64b/line 8-way L2 cache cpu10: smt 0, core 9, package 0 cpu11 at mainbus0: apid 50 (application processor) cpu11: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz, 2666.76 MHz cpu11: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG,LAHF,PERF,ITSC cpu11: 256KB 64b/line 8-way L2 cache cpu11: smt 0, core 9, package 1 ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins ioapic1 at mainbus0: apid 0 pa 0xfec80000, version 20, 24 pins acpiprt0 at acpi0: bus 1 (IP2P) acpiprt1 at acpi0: bus 17 (IPT1) acpiprt2 at acpi0: bus -1 (IPT3) acpiprt3 at acpi0: bus 2 (IPT5) acpiprt4 at acpi0: bus 5 (PT01) acpiprt5 at acpi0: bus 9 (PT03) acpiprt6 at acpi0: bus 13 (PT04) acpiprt7 at acpi0: bus 14 (PT05) acpiprt8 at acpi0: bus 15 (PT06) acpiprt9 at acpi0: bus 3 (PT07) acpiprt10 at acpi0: bus 4 (PT08) acpiprt11 at acpi0: bus 6 (PT09) acpiprt12 at acpi0: bus 16 (PT0A) acpiprt13 at acpi0: bus 0 (PCI0) acpicpu0 at acpi0: C3, C3, C1 acpicpu1 at acpi0: C3, C3, C1 acpicpu2 at acpi0: C3, C3, C1 acpicpu3 at acpi0: C3, C3, C1 acpicpu4 at acpi0: C3, C3, C1 acpicpu5 at acpi0: C3, C3, C1 acpicpu6 at acpi0: C3, C3, C1 acpicpu7 at acpi0: C3, C3, C1 acpicpu8 at acpi0: C3, C3, C1 acpicpu9 at acpi0: C3, C3, C1 acpicpu10 at acpi0: C3, C3, C1 acpicpu11 at acpi0: C3, C3, C1 acpitz0 at acpi0: critical temperature is 31 degC ipmi at mainbus0 not configured pci0 at mainbus0 bus 0 pchb0 at pci0 dev 0 function 0 "Intel 5520 Host" rev 0x13 ppb0 at pci0 dev 1 function 0 "Intel X58 PCIE" rev 0x13 pci1 at ppb0 bus 5 ciss0 at pci1 dev 0 function 0 "Hewlett-Packard Smart Array" rev 0x01: apic 0 int 4 ciss0: 2 LDs, HW rev 2, FW 3.66/3.66, 64bit fifo rro scsibus0 at ciss0: 2 targets sd0 at scsibus0 targ 0 lun 0: <HP, LOGICAL VOLUME, 3.66> SCSI3 0/direct fixed sd0: 286070MB, 512 bytes/sector, 585871964 sectors sd1 at scsibus0 targ 1 lun 0: <HP, LOGICAL VOLUME, 3.66> SCSI3 0/direct fixed sd1: 286070MB, 512 bytes/sector, 585871964 sectors ppb1 at pci0 dev 2 function 0 "Intel X58 PCIE" rev 0x13 pci2 at ppb1 bus 12 ppb2 at pci0 dev 3 function 0 "Intel X58 PCIE" rev 0x13 pci3 at ppb2 bus 9 ppb3 at pci0 dev 4 function 0 "Intel X58 PCIE" rev 0x13 pci4 at ppb3 bus 13 ppb4 at pci0 dev 5 function 0 "Intel X58 PCIE" rev 0x13 pci5 at ppb4 bus 14 ppb5 at pci0 dev 6 function 0 "Intel X58 PCIE" rev 0x13 pci6 at ppb5 bus 15 ppb6 at pci0 dev 7 function 0 "Intel X58 PCIE" rev 0x13 pci7 at ppb6 bus 3 bnx0 at pci7 dev 0 function 0 "Broadcom BCM5709" rev 0x20: apic 0 int 6 bnx1 at pci7 dev 0 function 1 "Broadcom BCM5709" rev 0x20: apic 0 int 13 ppb7 at pci0 dev 8 function 0 "Intel X58 PCIE" rev 0x13 pci8 at ppb7 bus 4 bnx2 at pci8 dev 0 function 0 "Broadcom BCM5709" rev 0x20: apic 0 int 7 bnx3 at pci8 dev 0 function 1 "Broadcom BCM5709" rev 0x20: apic 0 int 15 ppb8 at pci0 dev 9 function 0 "Intel X58 PCIE" rev 0x13 pci9 at ppb8 bus 6 em0 at pci9 dev 0 function 0 "Intel 82571EB" rev 0x06: apic 0 int 8, address 00:26:55:db:e9:20 em1 at pci9 dev 0 function 1 "Intel 82571EB" rev 0x06: apic 0 int 18, address 00:26:55:db:e9:21 ppb9 at pci0 dev 10 function 0 "Intel X58 PCIE" rev 0x13 pci10 at ppb9 bus 16 pchb1 at pci0 dev 13 function 0 vendor "Intel", unknown product 0x343a rev 0x13 pchb2 at pci0 dev 13 function 1 vendor "Intel", unknown product 0x343b rev 0x13 pchb3 at pci0 dev 13 function 2 vendor "Intel", unknown product 0x343c rev 0x13 pchb4 at pci0 dev 13 function 3 vendor "Intel", unknown product 0x343d rev 0x13 pchb5 at pci0 dev 13 function 4 "Intel 5520/X58 QuickPath" rev 0x13 pchb6 at pci0 dev 13 function 5 "Intel 5520 QuickPath" rev 0x13 pchb7 at pci0 dev 13 function 6 vendor "Intel", unknown product 0x341a rev 0x13 pchb8 at pci0 dev 14 function 0 vendor "Intel", unknown product 0x341c rev 0x13 pchb9 at pci0 dev 14 function 1 vendor "Intel", unknown product 0x341d rev 0x13 pchb10 at pci0 dev 14 function 2 vendor "Intel", unknown product 0x341e rev 0x13 pchb11 at pci0 dev 14 function 3 vendor "Intel", unknown product 0x341f rev 0x13 pchb12 at pci0 dev 14 function 4 vendor "Intel", unknown product 0x3439 rev 0x13 "Intel X58 Misc" rev 0x13 at pci0 dev 20 function 0 not configured "Intel X58 GPIO" rev 0x13 at pci0 dev 20 function 1 not configured "Intel X58 RAS" rev 0x13 at pci0 dev 20 function 2 not configured ppb10 at pci0 dev 28 function 0 "Intel 82801JI PCIE" rev 0x00 pci11 at ppb10 bus 17 ppb11 at pci0 dev 28 function 4 "Intel 82801JI PCIE" rev 0x00 pci12 at ppb11 bus 2 "Hewlett-Packard iLO3 Slave" rev 0x04 at pci12 dev 0 function 0 not configured "Hewlett-Packard iLO3 Management" rev 0x04 at pci12 dev 0 function 2 not configured uhci0 at pci12 dev 0 function 4 "Hewlett-Packard USB" rev 0x01: apic 8 int 17 usb0 at uhci0: USB revision 1.0 uhub0 at usb0 "Hewlett-Packard UHCI root hub" rev 1.00/1.00 addr 1 uhci1 at pci0 dev 29 function 0 "Intel 82801JI USB" rev 0x00: apic 8 int 20 uhci2 at pci0 dev 29 function 1 "Intel 82801JI USB" rev 0x00: apic 8 int 23 uhci3 at pci0 dev 29 function 2 "Intel 82801JI USB" rev 0x00: apic 8 int 22 uhci4 at pci0 dev 29 function 3 "Intel 82801JI USB" rev 0x00: apic 8 int 23 ehci0 at pci0 dev 29 function 7 "Intel 82801JI USB" rev 0x00: apic 8 int 20 usb1 at ehci0: USB revision 2.0 uhub1 at usb1 "Intel EHCI root hub" rev 2.00/1.00 addr 1 ppb12 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x90 pci13 at ppb12 bus 1 vga1 at pci13 dev 3 function 0 "ATI ES1000" rev 0x02 radeondrm0 at vga1: apic 8 int 23 drm0 at radeondrm0 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) pcib0 at pci0 dev 31 function 0 "Intel 82801JIB LPC" rev 0x00 usb2 at uhci1: USB revision 1.0 uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb3 at uhci2: USB revision 1.0 uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb4 at uhci3: USB revision 1.0 uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb5 at uhci4: USB revision 1.0 uhub5 at usb5 "Intel UHCI root hub" rev 1.00/1.00 addr 1 isa0 at pcib0 isadma0 at isa0 com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo com1: probed fifo depth: 0 bytes pckbc0 at isa0 port 0x60/5 pckbd0 at pckbc0 (kbd slot) pckbc0: using irq 1 for kbd slot wskbd0 at pckbd0: console keyboard, using wsdisplay0 pcppi0 at isa0 port 0x61 spkr0 at pcppi0 mtrr: Pentium Pro MTRR support uhidev0 at uhub0 port 1 configuration 1 interface 0 "HP Virtual Keyboard" rev 1.10/0.02 addr 2 uhidev0: iclass 3/1 ukbd0 at uhidev0: 8 variable keys, 6 key codes, country code 33 wskbd1 at ukbd0 mux 1 wskbd1: connecting to wsdisplay0 uhidev1 at uhub0 port 1 configuration 1 interface 1 "HP Virtual Keyboard" rev 1.10/0.02 addr 2 uhidev1: iclass 3/1 ums0 at uhidev1: 3 buttons wsmouse0 at ums0 mux 0 vscsi0 at root scsibus1 at vscsi0: 256 targets softraid0 at root scsibus2 at softraid0: 256 targets sd2 at scsibus2 targ 1 lun 0: <OPENBSD, SR RAID 0, 005> SCSI2 0/direct fixed sd2: 571922MB, 512 bytes/sector, 1171298048 sectors root on sd2a (a30940d4688c6f8a.a) swap on sd2b dump on sd2b bnx0: address 68:b5:99:b7:38:e4 brgphy0 at bnx0 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8 bnx1: address 68:b5:99:b7:38:e6 brgphy1 at bnx1 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8 bnx2: address 68:b5:99:b7:38:dc brgphy2 at bnx2 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8 bnx3: address 68:b5:99:b7:38:de brgphy3 at bnx3 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8