On Thu, Jun 25, 2009 at 07:49:21PM +0200, Gregory Colpart wrote: > Hello, > > Sum-up: > ------- > > We try to use NFS server in different machines and network > environments and we have very poor performances. Our main test > is creating a big tar archive on local NFS server. With NFS > server on OpenBSD 4.5: speed result is about 500 Kbit/s for NFS > Linux clients, and about 2 Mbit/s for NFS OpenBSD clients. > > Details: > -------- > > Two years ago we deploy a NFS server with OpenBSD 4.0 on DELL > PowerEdge 1900 server (RAID 5 with PERC 5/i on SCSI disks, > Broadcom BCM5708 network card, see dmesg in attachment). NFS > clients are machines on the same local network (Linux, SunOS, > etc.). No problem was reported. We upgrade to 4.1, all was > always right. But after upgrading to 4.2, users begin to be > unhappy during big files transfers or big tarball creations (note > we are not really sure they did these operations before). Then we > try to optimize NFS (trying differents options - tcp/udp for > example - for clients or increasing nfsd number for server) and > change hardware (use another network card, another wires, another > switches). Always very slow... while there are no problem with > SunOS or Linux NFS servers. Moreover connections to OpenBSD NFS > server are often locked with classical messages: > nfs: server FOO not responding, still trying > nfs: server FOO OK > During the creation of a big tarball, nfsd process are often in > run state "D" (disk wait). We verify disk performances but they > are pretty good in local filesystem. We upgrade to 4.3. Same > behaviour. 4.4 too. In another office, we try with a > different machine (see dmesg in attachment) with OpenBSD 4.5 on a > new network environment. It's a little better, but too slow > again. > > Example when creating a big tar archive. > With OpenBSD NFS client, it's not too bad: > > obsd-nfs-client:/mnt/nfs% du -sh test/ > 1.5G > obsd-nfs-client:/mnt/nfs% tar cf test.tar test/ > ....during about 1.5 hours... > > With Linux NFS client, it's too slow: > > linux-nfs-client:/mnt/nfs% du -sh test/ > 1.5G > linux-nfs-client:/mnt/nfs% tar cf test.tar test/ > ....during about 7 hours... > > We are aware some sysadmins use OpenBSD NFS server with success > (we find happy users in openbsd-misc archives). But we don't. > Have you ideas for us ?
It would be much easier to help if you included your mount options on both clients. > > Regards, > -- > Gregory Colpart <r...@evolix.fr> GnuPG:1024D/C1027A0E > Evolix - Informatique et Logiciels Libres http://www.evolix.fr/ > OpenBSD 4.4 (GENERIC) #1021: Tue Aug 12 17:16:55 MDT 2008 > dera...@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC > cpu0: Intel(R) Xeon(R) CPU 5110 @ 1.60GHz ("GenuineIntel" 686-class) 1.60 GHz > cpu0: > FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,TM2,CX16,xTPR > real mem = 1068400640 (1018MB) > avail mem = 1024663552 (977MB) > mainbus0 at root > bios0 at mainbus0: AT/286+ BIOS, date 09/12/08, BIOS32 rev. 0 @ 0xffe90, > SMBIOS rev. 2.5 @ 0x3fb9c000 (67 entries) > bios0: vendor Dell Inc. version "2.5.0" date 09/12/2008 > bios0: Dell Inc. PowerEdge 1900 > acpi0 at bios0: rev 2 > acpi0: tables DSDT FACP APIC SPCR HPET MCFG WD__ SLIC ERST HEST BERT EINJ TCPA > acpi0: wakeup devices PCI0(S5) > acpitimer0 at acpi0: 3579545 Hz, 24 bits > acpihpet0 at acpi0: 14318179 Hz > acpiprt0 at acpi0: bus 0 (PCI0) > acpiprt1 at acpi0: bus 6 (PEX2) > acpiprt2 at acpi0: bus 7 (UPST) > acpiprt3 at acpi0: bus 8 (DWN1) > acpiprt4 at acpi0: bus 9 (DWN2) > acpiprt5 at acpi0: bus 10 (PE2X) > acpiprt6 at acpi0: bus 11 (PEX3) > acpiprt7 at acpi0: bus 12 (PEX4) > acpiprt8 at acpi0: bus 1 (PEX5) > acpiprt9 at acpi0: bus 2 (PE2P) > acpiprt10 at acpi0: bus 13 (PEX6) > acpiprt11 at acpi0: bus 4 (SBEX) > acpiprt12 at acpi0: bus 15 (COMP) > acpicpu0 at acpi0 > bios0: ROM list: 0xc0000/0x9000! 0xc9000/0x5400 0xec000/0x4000! > ipmi at mainbus0 not configured > cpu0 at mainbus0 > pci0 at mainbus0 bus 0: configuration mode 1 (no bios) > pchb0 at pci0 dev 0 function 0 "Intel 5000P Host" rev 0x92 > ppb0 at pci0 dev 2 function 0 "Intel 5000 PCIE" rev 0x92 > pci1 at ppb0 bus 6 > ppb1 at pci1 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01 > pci2 at ppb1 bus 7 > ppb2 at pci2 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01 > pci3 at ppb2 bus 8 > ppb3 at pci2 dev 1 function 0 "Intel 6321ESB PCIE" rev 0x01: irq 5 > pci4 at ppb3 bus 9 > ppb4 at pci1 dev 0 function 3 "Intel 6321ESB PCIE-PCIX" rev 0x01 > pci5 at ppb4 bus 10 > ppb5 at pci0 dev 3 function 0 "Intel 5000 PCIE" rev 0x92 > pci6 at ppb5 bus 11 > ppb6 at pci0 dev 4 function 0 "Intel 5000 PCIE" rev 0x92 > pci7 at ppb6 bus 12 > ppb7 at pci0 dev 5 function 0 "Intel 5000 PCIE" rev 0x92 > pci8 at ppb7 bus 1 > ppb8 at pci8 dev 0 function 0 "Intel IOP333 PCIE-PCIX" rev 0x00 > pci9 at ppb8 bus 2 > mfi0 at pci9 dev 14 function 0 "Dell PERC 5" rev 0x00: irq 6, 0x1f031028 > mfi0: logical drives 1, version 5.2.2-0072, 256MB RAM > scsibus0 at mfi0: 1 targets, initiator 64 > sd0 at scsibus0 targ 0 lun 0: <DELL, PERC 5/i, 1.03> SCSI3 0/direct fixed > sd0: 475648MB, 60636 cyl, 255 head, 63 sec, 512 bytes/sec, 974127104 sec total > ppb9 at pci8 dev 0 function 2 "Intel IOP333 PCIE-PCIX" rev 0x00 > pci10 at ppb9 bus 3 > ppb10 at pci0 dev 6 function 0 "Intel 5000 PCIE x8" rev 0x92 > pci11 at ppb10 bus 13 > ppb11 at pci0 dev 7 function 0 "Intel 5000 PCIE" rev 0x92 > pci12 at ppb11 bus 14 > pchb1 at pci0 dev 16 function 0 "Intel 5000 Error Reporting" rev 0x92 > pchb2 at pci0 dev 16 function 1 "Intel 5000 Error Reporting" rev 0x92 > pchb3 at pci0 dev 16 function 2 "Intel 5000 Error Reporting" rev 0x92 > pchb4 at pci0 dev 17 function 0 "Intel 5000 Reserved" rev 0x92 > pchb5 at pci0 dev 19 function 0 "Intel 5000 Reserved" rev 0x92 > pchb6 at pci0 dev 21 function 0 "Intel 5000 FBD" rev 0x92 > pchb7 at pci0 dev 22 function 0 "Intel 5000 FBD" rev 0x92 > ppb12 at pci0 dev 28 function 0 "Intel 6321ESB PCIE" rev 0x09 > pci13 at ppb12 bus 4 > ppb13 at pci13 dev 0 function 0 "ServerWorks PCIE-PCIX" rev 0xc3 > pci14 at ppb13 bus 5 > bnx0 at pci14 dev 0 function 0 "Broadcom BCM5708" rev 0x12: irq 5 > uhci0 at pci0 dev 29 function 0 "Intel 6321ESB USB" rev 0x09: irq 11 > uhci1 at pci0 dev 29 function 1 "Intel 6321ESB USB" rev 0x09: irq 10 > uhci2 at pci0 dev 29 function 2 "Intel 6321ESB USB" rev 0x09: irq 11 > uhci3 at pci0 dev 29 function 3 "Intel 6321ESB USB" rev 0x09: irq 10 > ehci0 at pci0 dev 29 function 7 "Intel 6321ESB USB" rev 0x09: irq 11 > usb0 at ehci0: USB revision 2.0 > uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1 > ppb14 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xd9 > pci15 at ppb14 bus 15 > vga1 at pci15 dev 13 function 0 "ATI ES1000" rev 0x02 > wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) > wsdisplay0: screen 1-5 added (80x25, vt100 emulation) > drm at vga1 unsupported > ichpcib0 at pci0 dev 31 function 0 "Intel 6321ESB LPC" rev 0x09: PM disabled > pciide0 at pci0 dev 31 function 1 "Intel 6321ESB IDE" rev 0x09: DMA, channel > 0 configured to compatibility, channel 1 configured to compatibility > atapiscsi0 at pciide0 channel 0 drive 0 > scsibus1 at atapiscsi0: 2 targets, initiator 7 > cd0 at scsibus1 targ 0 lun 0: <HL-DT-ST, DVD-ROM GDR8164B, 0D08> ATAPI > 5/cdrom removable > cd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2 > pciide0: channel 1 ignored (disabled) > usb1 at uhci0: USB revision 1.0 > uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1 > usb2 at uhci1: USB revision 1.0 > uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1 > usb3 at uhci2: USB revision 1.0 > uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1 > usb4 at uhci3: USB revision 1.0 > uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1 > isa0 at ichpcib0 > isadma0 at isa0 > com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo > com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo > pckbc0 at isa0 port 0x60/5 > pckbd0 at pckbc0 (kbd slot) > pckbc0: using irq 1 for kbd slot > wskbd0 at pckbd0: console keyboard, using wsdisplay0 > pcppi0 at isa0 port 0x61 > midi0 at pcppi0: <PC speaker> > spkr0 at pcppi0 > npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16 > biomask fdc5 netmask fde5 ttymask ffff > mtrr: Pentium Pro MTRR support > uhub5 at uhub0 port 7 "Cypress Semiconductor USB2 Hub" rev 2.00/0.0b addr 2 > uhidev0 at uhub2 port 1 configuration 1 interface 0 "DELL DELL USB Keyboard" > rev 1.10/1.05 addr 2 > uhidev0: iclass 3/1 > ukbd0 at uhidev0: 8 modifier keys, 6 key codes > wskbd1 at ukbd0 mux 1 > wskbd1: connecting to wsdisplay0 > softraid0 at root > root on sd0a swap on sd0b dump on sd0b > bnx0: address 00:19:b9:cc:42:06 > brgphy0 at bnx0 phy 1: BCM5708C 10/100/1000baseT PHY, rev. 6 > OpenBSD 4.5 (GENERIC) #1749: Sat Feb 28 14:51:18 MST 2009 > dera...@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC > cpu0: AMD Sempron(tm) ("AuthenticAMD" 686-class, 256KB L2 cache) 1.01 GHz > cpu0: > FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE > real mem = 267939840 (255MB) > avail mem = 250789888 (239MB) > mainbus0 at root > bios0 at mainbus0: AT/286+ BIOS, date 09/09/04, BIOS32 rev. 0 @ 0xfda90, > SMBIOS rev. 2.3 @ 0xf0630 (21 entries) > bios0: vendor American Megatrends Inc. version "Version 07.00T" date 04/02/01 > bios0: MSI MS-7021 > apm0 at bios0: Power Management spec V1.2 > apm0: AC on, battery charge unknown > acpi at bios0 function 0x0 not configured > pcibios0 at bios0: rev 2.1 @ 0xf0000/0x10000 > pcibios0: PCI IRQ Routing Table rev 1.0 @ 0xf7f00/192 (10 entries) > pcibios0: PCI Interrupt Router at 000:17:0 ("VIA VT8237 ISA" rev 0x00) > pcibios0: PCI bus #1 is the last bus > bios0: ROM list: 0xc0000/0xf400 0xcfc00/0x1800 > cpu0 at mainbus0: (uniprocessor) > pci0 at mainbus0 bus 0: configuration mode 1 (bios) > pchb0 at pci0 dev 0 function 0 "VIA VT8377 PCI" rev 0x80 > viaagp0 at pchb0: v3 > agp0 at viaagp0: aperture at 0xe0000000, size 0x10000000 > ppb0 at pci0 dev 1 function 0 "VIA VT8377 AGP" rev 0x00 > pci1 at ppb0 bus 1 > vga1 at pci1 dev 0 function 0 "NVIDIA GeForce FX 5200" rev 0xa1 > wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) > wsdisplay0: screen 1-5 added (80x25, vt100 emulation) > pciide0 at pci0 dev 15 function 0 "VIA VT82C571 IDE" rev 0x06: ATA133, > channel 0 configured to compatibility, channel 1 configured to compatibility > wd0 at pciide0 channel 0 drive 0: <Maxtor 6E040L0> > wd0: 16-sector PIO, LBA, 39205MB, 80293248 sectors > wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 6 > atapiscsi0 at pciide0 channel 1 drive 0 > scsibus0 at atapiscsi0: 2 targets > cd0 at scsibus0 targ 0 lun 0: <_NEC, DVD-ROM DV-5700A, 3.42> ATAPI 5/cdrom > removable > cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2 > uhci0 at pci0 dev 16 function 0 "VIA VT83C572 USB" rev 0x81: irq 11 > uhci1 at pci0 dev 16 function 1 "VIA VT83C572 USB" rev 0x81: irq 11 > uhci2 at pci0 dev 16 function 2 "VIA VT83C572 USB" rev 0x81: irq 5 > uhci3 at pci0 dev 16 function 3 "VIA VT83C572 USB" rev 0x81: irq 5 > ehci0 at pci0 dev 16 function 4 "VIA VT6202 USB" rev 0x86: irq 12 > usb0 at ehci0: USB revision 2.0 > uhub0 at usb0 "VIA EHCI root hub" rev 2.00/1.00 addr 1 > viapm0 at pci0 dev 17 function 0 "VIA VT8237 ISA" rev 0x00 > iic0 at viapm0 > iic0: addr 0x1b 06=f4 08=1e 09=0e 0b=ff 0c=0a 0d=0a 0e=f4 0f=07 10=0c 11=03 > 14=55 15=55 17=ff 18=ff 1c=02 1f=1e 20=ff 21=0a 22=07 26=30 29=ff words > 00=00ff 01=00ff 02=00ff 03=00ff 04=00ff 05=00ff 06=f4ff 07=00ff > iic0: addr 0x2f 00=10 01=07 02=00 03=00 04=07 05=00 06=00 07=00 14=14 15=62 > 16=03 17=02 words 00=10ff 01=07ff 02=00ff 03=00ff 04=07ff 05=00ff 06=00ff > 07=00ff > spdmem0 at iic0 addr 0x50: 256MB DDR SDRAM non-parity PC3200CL2.5 > auvia0 at pci0 dev 17 function 5 "VIA VT8233 AC97" rev 0x60: irq 12 > ac97: codec id 0x414c4760 (Avance Logic ALC655 rev 0) > audio0 at auvia0 > vr0 at pci0 dev 18 function 0 "VIA RhineII-2" rev 0x78: irq 11, address > 00:11:09:31:05:eb > rlphy0 at vr0 phy 1: RTL8201L 10/100 PHY, rev. 1 > usb1 at uhci0: USB revision 1.0 > uhub1 at usb1 "VIA UHCI root hub" rev 1.00/1.00 addr 1 > usb2 at uhci1: USB revision 1.0 > uhub2 at usb2 "VIA UHCI root hub" rev 1.00/1.00 addr 1 > usb3 at uhci2: USB revision 1.0 > uhub3 at usb3 "VIA UHCI root hub" rev 1.00/1.00 addr 1 > usb4 at uhci3: USB revision 1.0 > uhub4 at usb4 "VIA UHCI root hub" rev 1.00/1.00 addr 1 > isa0 at mainbus0 > isadma0 at isa0 > com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo > pckbc0 at isa0 port 0x60/5 > pckbd0 at pckbc0 (kbd slot) > pckbc0: using irq 1 for kbd slot > wskbd0 at pckbd0: console keyboard, using wsdisplay0 > pcppi0 at isa0 port 0x61 > midi0 at pcppi0: <PC speaker> > spkr0 at pcppi0 > lpt0 at isa0 port 0x378/4 irq 7 > wbsio0 at isa0 port 0x2e/2: W83697HF rev 0x12 > lm1 at wbsio0 port 0x290/8: W83697HF > npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16 > fdc0 at isa0 port 0x3f0/6 irq 6 drq 2 > biomask ff6d netmask ff6d ttymask ffff > mtrr: Pentium Pro MTRR support > softraid0 at root > root on wd0a swap on wd0b dump on wd0b
