Hello all, I have an issue with a new box I've put together with an Areca 1210 RAID card and I was hoping someone here might be able to point me in the right direction to help me solve it.
When writing to the disk(s), the whole system becomes incredibly slow until the write operation has finished. I've used dd to make 10GB files and then timed simple operations like ls and compared this to other OpenBSD servers I've got with single SATA drives - on the machine with the RAID card, ls takes 7 seconds to execute and the write operation takes 65 sec, on another OpenBSD server I have, the same operation takes 0.1 and 90 sec respectively. The slow down is not limited to disk operations AFAICT. Things like top, network stuff also get blocked whilst it seems processor and RAM are mostly idle/free. I had a spare single disk inside the RAID server which I put a copy of FreeBSD on, mounted the root OpenBSD Raid partition and performed a similar test. This time the write operation did not cause the rest of the system to wait. So far, I've ruled out soft updates and upgraded the card firmware to the most recent version and googled a hell of a lot to no avail Can anyone help me solve this or offer any clues as to where I should look for solutions? (Or what I *should* be googling for) The disks are 4 inexpensive 250GB SATA drives in a RAID 5 array and I'm running 5.0 generic amd64 on a Xeon dual core. Many Thanks, George dmesg folows.... OpenBSD 5.0 (GENERIC.MP) #63: Wed Aug 17 10:14:30 MDT 2011 dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP real mem = 2144927744 (2045MB) avail mem = 2073767936 (1977MB) mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.5 @ 0xdc010 (45 entries) bios0: vendor HP version "O15" date 04/03/2008 bios0: HP ProLiant ML110 G5 acpi0 at bios0: rev 2 acpi0: sleep states S0 S1 S4 S5 acpi0: tables DSDT FACP SPMI EINJ HEST BERT SSDT ERST MCFG APIC BOOT SPCR SSDT SSDT SSDT acpi0: wakeup devices USB4(S3) USB5(S3) USB7(S3) ESB2(S4) EXP1(S4) EXP2(S4) EXP3(S4) EXP4(S4) EXP5(S4) EXP6(S4) USB1(S3) USB2(S3) USB3(S3) USB6(S3) ESB1(S3) PCIB(S3) PWRB(S3) acpitimer0 at acpi0: 3579545 Hz, 24 bits acpimcfg0 at acpi0 addr 0xf0000000, bus 0-16 acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Xeon(R) CPU 3065 @ 2.33GHz, 2327.80 MHz cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36, CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,SMX ,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG cpu0: 4MB 64b/line 16-way L2 cache cpu0: apic clock running at 585MHz cpu1 at mainbus0: apid 1 (application processor) cpu1: Intel(R) Xeon(R) CPU 3065 @ 2.33GHz, 4096.40 MHz cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36, CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,SMX ,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG cpu1: 4MB 64b/line 16-way L2 cache ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins acpiprt0 at acpi0: bus 0 (PCI0) acpiprt1 at acpi0: bus 1 (PEG1) acpiprt2 at acpi0: bus -1 (PEG2) acpiprt3 at acpi0: bus 5 (EXP1) acpiprt4 at acpi0: bus -1 (EXP2) acpiprt5 at acpi0: bus -1 (EXP3) acpiprt6 at acpi0: bus -1 (EXP4) acpiprt7 at acpi0: bus 13 (EXP5) acpiprt8 at acpi0: bus 14 (EXP6) acpiprt9 at acpi0: bus 17 (PCIB) acpicpu0 at acpi0: C3 acpicpu1 at acpi0: C3 acpibtn0 at acpi0: PWRB ipmi at mainbus0 not configured pci0 at mainbus0 bus 0 pchb0 at pci0 dev 0 function 0 "Intel 3200/3210 Host" rev 0x01 ppb0 at pci0 dev 1 function 0 "Intel 3200/3210 PCIE" rev 0x01: msi pci1 at ppb0 bus 1 uhci0 at pci0 dev 26 function 0 "Intel 82801I USB" rev 0x02: apic 2 int 16 uhci1 at pci0 dev 26 function 1 "Intel 82801I USB" rev 0x02: apic 2 int 17 uhci2 at pci0 dev 26 function 2 "Intel 82801I USB" rev 0x02: apic 2 int 18 ehci0 at pci0 dev 26 function 7 "Intel 82801I USB" rev 0x02: apic 2 int 18 usb0 at ehci0: USB revision 2.0 uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1 ppb1 at pci0 dev 28 function 0 "Intel 82801I PCIE" rev 0x02: msi pci2 at ppb1 bus 5 ppb2 at pci2 dev 0 function 0 "Intel IOP333 PCIE-PCIX" rev 0x00 pci3 at ppb2 bus 6 arc0 at pci3 dev 14 function 0 "Areca ARC-1210" rev 0x00: apic 2 int 18 arc0: 4 ports, 256MB SDRAM, firmware V1.49 2010-12-02 scsibus0 at arc0: 16 targets sd0 at scsibus0 targ 0 lun 0: <Areca, RAID0, R001> SCSI3 0/direct fixed eui.0004d927fffff800 sd0: 715255MB, 512 bytes/sector, 1464843264 sectors ppb3 at pci2 dev 0 function 2 "Intel IOP333 PCIE-PCIX" rev 0x00 pci4 at ppb3 bus 7 ppb4 at pci0 dev 28 function 4 "Intel 82801I PCIE" rev 0x02: msi pci5 at ppb4 bus 13 vga1 at pci5 dev 0 function 0 "Matrox MGA G200e (ServerEngines)" rev 0x02 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) ppb5 at pci0 dev 28 function 5 "Intel 82801I PCIE" rev 0x02: msi pci6 at ppb5 bus 14 bge0 at pci6 dev 0 function 0 "Broadcom BCM5722" rev 0x00, BCM5755 C0 (0xa200): apic 2 int 17, address 00:21:5a:a4:ba:87 brgphy0 at bge0 phy 1: BCM5722 10/100/1000baseT PHY, rev. 0 uhci3 at pci0 dev 29 function 0 "Intel 82801I USB" rev 0x02: apic 2 int 16 uhci4 at pci0 dev 29 function 1 "Intel 82801I USB" rev 0x02: apic 2 int 17 uhci5 at pci0 dev 29 function 2 "Intel 82801I USB" rev 0x02: apic 2 int 18 ehci1 at pci0 dev 29 function 7 "Intel 82801I USB" rev 0x02: apic 2 int 16 usb1 at ehci1: USB revision 2.0 uhub1 at usb1 "Intel EHCI root hub" rev 2.00/1.00 addr 1 ppb6 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x92 pci7 at ppb6 bus 17 rl0 at pci7 dev 0 function 0 "Realtek 8139" rev 0x10: apic 2 int 21, address 00:40:f4:bb:ff:d6 rlphy0 at rl0 phy 0: RTL internal PHY pcib0 at pci0 dev 31 function 0 "Intel 82801IR LPC" rev 0x02 pciide0 at pci0 dev 31 function 2 "Intel 82801I SATA" rev 0x02: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI pciide0: using apic 2 int 17 for native-PCI interrupt wd0 at pciide0 channel 0 drive 0: <GB0250C8045> wd0: 16-sector PIO, LBA48, 238475MB, 488397168 sectors wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 6 ichiic0 at pci0 dev 31 function 3 "Intel 82801I SMBus" rev 0x02: apic 2 int 17 iic0 at ichiic0 spdmem0 at iic0 addr 0x50: 1GB DDR2 SDRAM ECC PC2-6400CL5 spdmem1 at iic0 addr 0x52: 1GB DDR2 SDRAM ECC PC2-6400CL5 pciide1 at pci0 dev 31 function 5 "Intel 82801I SATA" rev 0x02: DMA, channel 0 wired to native-PCI, channel 1 wired to native-PCI pciide1: using apic 2 int 18 for native-PCI interrupt atapiscsi0 at pciide1 channel 1 drive 0 scsibus1 at atapiscsi0: 2 targets cd0 at scsibus1 targ 0 lun 0: <HL-DT-ST, DVD-RAM GH15L, FA01> ATAPI 5/cdrom removable cd0(pciide1:1:0): using PIO mode 4, Ultra-DMA mode 5 usb2 at uhci0: USB revision 1.0 uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb3 at uhci1: USB revision 1.0 uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb4 at uhci2: USB revision 1.0 uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb5 at uhci3: USB revision 1.0 uhub5 at usb5 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb6 at uhci4: USB revision 1.0 uhub6 at usb6 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb7 at uhci5: USB revision 1.0 uhub7 at usb7 "Intel UHCI root hub" rev 1.00/1.00 addr 1 isa0 at pcib0 isadma0 at isa0 pckbc0 at isa0 port 0x60/5 pcppi0 at isa0 port 0x61 spkr0 at pcppi0 mtrr: Pentium Pro MTRR support uhub8 at uhub1 port 5 "Apple, Inc. Keyboard Hub" rev 2.00/96.15 addr 2 uhidev0 at uhub8 port 2 configuration 1 interface 0 "Apple, Inc Apple Keyboard" rev 2.00/0.69 addr 3 uhidev0: iclass 3/1 ukbd0 at uhidev0: 8 modifier keys, 5 key codes, country code 13 wskbd0 at ukbd0: console keyboard, using wsdisplay0 uhidev1 at uhub8 port 2 configuration 1 interface 1 "Apple, Inc Apple Keyboard" rev 2.00/0.69 addr 3 uhidev1: iclass 3/0 uhid0 at uhidev1: input=1, output=0, feature=0 uhidev2 at uhub5 port 2 configuration 1 interface 0 "ServerEngines SE USB Device" rev 1.10/0.01 addr 2 uhidev2: iclass 3/1 ukbd1 at uhidev2: 8 modifier keys, 6 key codes wskbd1 at ukbd1 mux 1 wskbd1: connecting to wsdisplay0 uhidev3 at uhub5 port 2 configuration 1 interface 1 "ServerEngines SE USB Device" rev 1.10/0.01 addr 2 uhidev3: iclass 3/1 ums0 at uhidev3: 8 buttons, Z dir wsmouse0 at ums0 mux 0 vscsi0 at root scsibus2 at vscsi0: 256 targets softraid0 at root scsibus3 at softraid0: 256 targets root on sd0a (fc35f505fe45a064.a) swap on sd0b dump on sd0b