On 2011-01-07 19.54, Ted Unangst wrote:
experiment with parallel ports building on a 64-way sparc64 T2 went.
With 32 build jobs it looked like this:
<landry_p22> 0.8%Int 48.9%Sys 6.0%Usr 0.0%Nic 44.3%Idle
<landry_p22> around that all the time
My understanding is that the T2 is closer to an 8-way machine. If we
could recognize the real cores and balance appropriately, 8 build jobs
shouldn't be too bad.
At least with a 4-core 8-thread i7 processor, make -j 8 scales reasonably
well.
Just to illustrate, a quick test on my 8-core (2 cpu x 4 core)
Supermicro AMD box (compile a GENERIC.MP kernel):
# make clean && make depend
# time make
...
3m26.78s real 2m43.73s user 0m35.08s system
# make clean && make depend
# time make -j8
...
0m47.40s real 2m52.75s user 3m1.70s system
On a first glance it doesn't scale all that well, about 4,4 times
quicker real time when running eight compiler tasks simultaneously
compared to the single one.
But the server isn't idle to begin with (it is run in quite heavy
production), and this sort of test is of course not processor-only.
Also, both tests were run with the MP kernel, so even the single-task
test would probably utilize several kernels at times.
Regards,
/Benny
dmesg below:
----8<--------8<--------8<--------8<--------8<--------8<---- (cut)
OpenBSD 4.7 (GENERIC.MP) #130: Wed Mar 17 20:48:50 MDT 2010
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 3756720128 (3582MB)
avail mem = 3650265088 (3481MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.4 @ 0xfb980 (77 entries)
bios0: vendor American Megatrends Inc. version "080014" date 10/13/2008
bios0: Supermicro H8DMT
acpi0 at bios0: rev 0
acpi0: tables DSDT FACP APIC MCFG OEMB SRAT EINJ BERT ERST HEST SSDT
acpi0: wakeup devices PS2K(S4) PS2M(S4) NSMB(S4) USB0(S4) USB2(S1)
NMAC(S5) NMAD(S5) P0P1(S4) HDAC(S4) BR10(S4) BR15(S4) SLPB(S4) PWRB(S4)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Quad-Core AMD Opteron(tm) Processor 2376, 2312.18 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,CX16,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu0: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB
64b/line 16-way L2 cache
cpu0: ITLB 32 4KB entries fully associative, 16 4MB entries fully
associative
cpu0: DTLB 48 4KB entries fully associative, 48 4MB entries fully
associative
cpu0: apic clock running at 201MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Quad-Core AMD Opteron(tm) Processor 2376, 2311.86 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,CX16,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu1: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB
64b/line 16-way L2 cache
cpu1: ITLB 32 4KB entries fully associative, 16 4MB entries fully
associative
cpu1: DTLB 48 4KB entries fully associative, 48 4MB entries fully
associative
cpu2 at mainbus0: apid 2 (application processor)
cpu2: Quad-Core AMD Opteron(tm) Processor 2376, 2311.86 MHz
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,CX16,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu2: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB
64b/line 16-way L2 cache
cpu2: ITLB 32 4KB entries fully associative, 16 4MB entries fully
associative
cpu2: DTLB 48 4KB entries fully associative, 48 4MB entries fully
associative
cpu3 at mainbus0: apid 3 (application processor)
cpu3: Quad-Core AMD Opteron(tm) Processor 2376, 2311.86 MHz
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,CX16,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu3: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB
64b/line 16-way L2 cache
cpu3: ITLB 32 4KB entries fully associative, 16 4MB entries fully
associative
cpu3: DTLB 48 4KB entries fully associative, 48 4MB entries fully
associative
cpu4 at mainbus0: apid 4 (application processor)
cpu4: Quad-Core AMD Opteron(tm) Processor 2376, 2311.86 MHz
cpu4:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,CX16,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu4: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB
64b/line 16-way L2 cache
cpu4: ITLB 32 4KB entries fully associative, 16 4MB entries fully
associative
cpu4: DTLB 48 4KB entries fully associative, 48 4MB entries fully
associative
cpu5 at mainbus0: apid 5 (application processor)
cpu5: Quad-Core AMD Opteron(tm) Processor 2376, 2311.86 MHz
cpu5:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,CX16,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu5: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB
64b/line 16-way L2 cache
cpu5: ITLB 32 4KB entries fully associative, 16 4MB entries fully
associative
cpu5: DTLB 48 4KB entries fully associative, 48 4MB entries fully
associative
cpu6 at mainbus0: apid 6 (application processor)
cpu6: Quad-Core AMD Opteron(tm) Processor 2376, 2311.86 MHz
cpu6:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,CX16,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu6: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB
64b/line 16-way L2 cache
cpu6: ITLB 32 4KB entries fully associative, 16 4MB entries fully
associative
cpu6: DTLB 48 4KB entries fully associative, 48 4MB entries fully
associative
cpu7 at mainbus0: apid 7 (application processor)
cpu7: Quad-Core AMD Opteron(tm) Processor 2376, 2311.86 MHz
cpu7:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,CX16,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu7: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB
64b/line 16-way L2 cache
cpu7: ITLB 32 4KB entries fully associative, 16 4MB entries fully
associative
cpu7: DTLB 48 4KB entries fully associative, 48 4MB entries fully
associative
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 11, 24 pins
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 1 (P0P1)
acpiprt2 at acpi0: bus 3 (BR10)
acpiprt3 at acpi0: bus 2 (BR15)
acpicpu0 at acpi0: PSS
acpicpu1 at acpi0: PSS
acpicpu2 at acpi0: PSS
acpicpu3 at acpi0: PSS
acpicpu4 at acpi0: PSS
acpicpu5 at acpi0: PSS
acpicpu6 at acpi0: PSS
acpicpu7 at acpi0: PSS
acpibtn0 at acpi0: SLPB
acpibtn1 at acpi0: PWRB
ipmi at mainbus0 not configured
pci0 at mainbus0 bus 0
"NVIDIA MCP55 Memory" rev 0xa2 at pci0 dev 0 function 0 not configured
pcib0 at pci0 dev 1 function 0 "NVIDIA MCP55 ISA" rev 0xa3
nviic0 at pci0 dev 1 function 1 "NVIDIA MCP55 SMBus" rev 0xa3
iic0 at nviic0
spdmem0 at iic0 addr 0x50: 2GB DDR2 SDRAM registered cmd/addr parity,
data ECC PC2-5300CL5
spdmem1 at iic0 addr 0x51: 2GB DDR2 SDRAM registered cmd/addr parity,
data ECC PC2-5300CL5
iic1 at nviic0
lm1 at iic1 addr 0x2d: W83627DHG
wbng0 at iic1 addr 0x2f: w83793g
iic1: addr 0x4b 00=25 01=00 02=43 03=48 04=25 05=00 06=43 07=48 08=25
09=00 0a=43 0b=48 0c=25 0d=00 0e=43 0f=48 10=25 11=00 12=43 13=48 14=25
15=00 16=43 17=48 18=25 19=00 1a=43 1b=48 1c=25 1d=00 1e=43 1f=48 20=25
21=00 22=43 23=48 24=25 25=00 26=43 27=48 28=25 29=00 2a=43 2b=48 2c=25
2d=00 2e=43 2f=48 30=25 31=00 32=43 33=48 34=25 35=00 36=43 37=48 38=25
39=00 3a=43 3b=48 3c=25 3d=00 3e=43 3f=48 40=25 41=00 42=43 43=48 44=25
45=00 46=43 47=48 48=25 49=00 4a=43 4b=48 4c=25 4d=00 4e=43 4f=48 50=25
51=00 52=43 53=48 54=25 55=00 56=43 57=48 58=25 59=00 5a=43 5b=48 5c=25
5d=00 5e=43 5f=48 60=25 61=00 62=43 63=48 64=25 65=00 66=43 67=48 68=25
69=00 6a=43 6b=48 6c=25 6d=00 6e=43 6f=48 70=25 71=00 72=43 73=48 74=25
75=00 76=43 77=48 78=25 79=00 7a=43 7b=48 7c=25 7d=00 7e=43 7f=48 80=25
81=00 82=43 83=48 84=25 85=00 86=43 87=48 88=25 89=00 8a=43 8b=48 8c=25
8d=00 8e=43 8f=48 90=25 91=00 92=43 93=48 94=25 95=00 96=43 97=48 98=25
99=00 9a=43 9b=48 9c=25 9d=00 9e=43 9f=48 a0=25 a1=00 a2=43 a3=48 a4=25
a5=00 a6=43 a7=48 a8=25 a9=00 aa=43 ab=48 ac=25 ad=00 ae=43 af=48 b0=25
b1=00 b2=43 b3=48 b4=25 b5=00 b6=43 b7=48 b8=25 b9=00 ba=43 bb=48 bc=25
bd=00 be=43 bf=48 c0=25 c1=00 c2=43 c3=48 c4=25 c5=00 c6=43 c7=48 c8=25
c9=00 ca=43 cb=48 cc=25 cd=00 ce=43 cf=48 d0=25 d1=00 d2=43 d3=48 d4=25
d5=00 d6=43 d7=48 d8=25 d9=00 da=43 db=48 dc=25 dd=00 de=43 df=48 e0=25
e1=00 e2=43 e3=48 e4=25 e5=00 e6=43 e7=48 e8=25 e9=00 ea=43 eb=48 ec=25
ed=00 ee=43 ef=48 f0=25 f1=00 f2=43 f3=48 f4=25 f5=00 f6=43 f7=48 f8=25
f9=00 fa=43 fb=48 fc=25 fd=00 fe=43 ff=48 words 00=2580 01=00ff 02=4300
03=4800 04=2580 05=00ff 06=4300 07=4800
ohci0 at pci0 dev 2 function 0 "NVIDIA MCP55 USB" rev 0xa1: apic 8 int 5
(irq 5), version 1.0, legacy support
ehci0 at pci0 dev 2 function 1 "NVIDIA MCP55 USB" rev 0xa2: apic 8 int 7
(irq 7)
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "NVIDIA EHCI root hub" rev 2.00/1.00 addr 1
pciide0 at pci0 dev 4 function 0 "NVIDIA MCP55 IDE" rev 0xa1: DMA,
channel 0 configured to compatibility, channel 1 configured to compatibility
pciide0: channel 0 disabled (no drives)
pciide0: channel 1 ignored (disabled)
pciide1 at pci0 dev 5 function 0 "NVIDIA MCP55 SATA" rev 0xa3: DMA
pciide1: using apic 8 int 10 (irq 10) for native-PCI interrupt
wd0 at pciide1 channel 0 drive 0: <SAMSUNG HD501LJ>
wd0: 16-sector PIO, LBA48, 476940MB, 976773168 sectors
wd0(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 6
wd1 at pciide1 channel 1 drive 0: <SAMSUNG HD501LJ>
wd1: 16-sector PIO, LBA48, 476940MB, 976773168 sectors
wd1(pciide1:1:0): using PIO mode 4, Ultra-DMA mode 6
pciide2 at pci0 dev 5 function 1 "NVIDIA MCP55 SATA" rev 0xa3: DMA
pciide2: using apic 8 int 11 (irq 11) for native-PCI interrupt
ppb0 at pci0 dev 6 function 0 "NVIDIA MCP55 PCI-PCI" rev 0xa2
pci1 at ppb0 bus 1
vga1 at pci1 dev 1 function 0 "XGI Technology Volari Z7" rev 0x00
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
nfe0 at pci0 dev 8 function 0 "NVIDIA MCP55 LAN" rev 0xa3: apic 8 int 5
(irq 5), address 00:30:48:d1:36:a2
eephy0 at nfe0 phy 2: 88E1149 Gigabit PHY, rev. 3
nfe1 at pci0 dev 9 function 0 "NVIDIA MCP55 LAN" rev 0xa3: apic 8 int 10
(irq 10), address 00:30:48:d1:36:a3
eephy1 at nfe1 phy 3: 88E1149 Gigabit PHY, rev. 3
ppb1 at pci0 dev 10 function 0 "NVIDIA MCP55 PCIE" rev 0xa3
pci2 at ppb1 bus 2
ppb2 at pci0 dev 15 function 0 "NVIDIA MCP55 PCIE" rev 0xa3
pci3 at ppb2 bus 3
pchb0 at pci0 dev 24 function 0 "AMD AMD64 10h HyperTransport" rev 0x00
pchb1 at pci0 dev 24 function 1 "AMD AMD64 10h Address Map" rev 0x00
pchb2 at pci0 dev 24 function 2 "AMD AMD64 10h DRAM Cfg" rev 0x00
km0 at pci0 dev 24 function 3 "AMD AMD64 10h Misc Cfg" rev 0x00
pchb3 at pci0 dev 24 function 4 "AMD AMD64 10h Link Cfg" rev 0x00
pchb4 at pci0 dev 25 function 0 "AMD AMD64 10h HyperTransport" rev 0x00
pchb5 at pci0 dev 25 function 1 "AMD AMD64 10h Address Map" rev 0x00
pchb6 at pci0 dev 25 function 2 "AMD AMD64 10h DRAM Cfg" rev 0x00
km1 at pci0 dev 25 function 3 "AMD AMD64 10h Misc Cfg" rev 0x00
pchb7 at pci0 dev 25 function 4 "AMD AMD64 10h Link Cfg" rev 0x00
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
wbsio0 at isa0 port 0x2e/2: W83627DHG rev 0x25
lm2 at wbsio0 port 0x290/8: W83627DHG
lm1 detached
usb1 at ohci0: USB revision 1.0
uhub1 at usb1 "NVIDIA OHCI root hub" rev 1.00/1.00 addr 1
mtrr: Pentium Pro MTRR support
uplcom0 at uhub1 port 2 "Prolific Technology Inc. USB-Serial Controller"
rev 1.10/3.00 addr 2
ucom0 at uplcom0
vscsi0 at root
scsibus0 at vscsi0: 256 targets
softraid0 at root
scsibus1 at softraid0: 1 targets
sd0 at scsibus1 targ 0 lun 0: <OPENBSD, SR RAID 1, 003> SCSI2 0/direct fixed
sd0: 475909MB, 512 bytes/sec, 974663471 sec total
root on wd0a swap on wd0b dump on wd0b
----8<--------8<--------8<--------8<--------8<--------8<---- (cut)
--
internetlabbet.se / work: +46 8 551 124 80 / "Words must
Benny LC6fgren / mobile: +46 70 718 11 90 / be weighed,
/ fax: +46 8 551 124 89 / not counted."
/ email: benny -at- internetlabbet.se
