>Number: 157418 >Category: kern >Synopsis: em driver lockup during boot on Supermicro X9SCM-F >Confidential: no >Severity: non-critical >Priority: low >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Mon May 30 08:40:05 UTC 2011 >Closed-Date: >Last-Modified: >Originator: Tomas Svensson >Release: 9,0-CURRENT (2011 May 12) >Organization: >Environment: Copyright (c) 1992-2011 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 9.0-CURRENT #0: Thu May 12 11:28:09 UTC 2011 r...@obrian.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC i386 WARNING: WITNESS option enabled, expect reduced performance. CPU: Intel(R) Xeon(R) CPU E31230 @ 3.20GHz (3192.81-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x206a7 Family = 6 Model = 2a Stepping = 7 Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=0x15bae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,<b24>,XSAVE,<b28>> AMD Features=0x28100000<NX,RDTSCP,LM> AMD Features2=0x1<LAHF> TSC: P-state invariant, performance statistics real memory = 4294967296 (4096 MB) avail memory = 3131559936 (2986 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: <SUPERM SMCI--MB> FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 SMT threads cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 cpu4 (AP): APIC ID: 4 cpu5 (AP): APIC ID: 5 cpu6 (AP): APIC ID: 6 cpu7 (AP): APIC ID: 7 ioapic0 <Version 2.0> irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: <SUPERM SMCI--MB> on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 cpu0: <ACPI CPU> on acpi0 cpu1: <ACPI CPU> on acpi0 cpu2: <ACPI CPU> on acpi0 cpu3: <ACPI CPU> on acpi0 cpu4: <ACPI CPU> on acpi0 cpu5: <ACPI CPU> on acpi0 cpu6: <ACPI CPU> on acpi0 cpu7: <ACPI CPU> on acpi0 pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 pci0: <ACPI PCI bus> on pcib0 pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0 pci1: <ACPI PCI bus> on pcib1 pcib2: <ACPI PCI-PCI bridge> irq 16 at device 1.1 on pci0 pci2: <ACPI PCI bus> on pcib2 pcib3: <PCI-PCI bridge> mem 0xfbd00000-0xfbd1ffff irq 17 at device 0.0 on pci2 pci3: <PCI bus> on pcib3 pcib4: <PCI-PCI bridge> irq 18 at device 1.0 on pci3 pci4: <PCI bus> on pcib4 igb0: <Intel(R) PRO/1000 Network Connection version - 2.2.3> port 0xd020-0xd03f mem 0xfbba0000-0xfbbbffff,0xfbb80000-0xfbb9ffff,0xfbc44000-0xfbc47fff irq 18 at device 0.0 on pci4 igb0: Using MSIX interrupts with 9 vectors igb0: Ethernet address: 00:25:90:0c:18:48 igb1: <Intel(R) PRO/1000 Network Connection version - 2.2.3> port 0xd000-0xd01f mem 0xfbb40000-0xfbb5ffff,0xfbb20000-0xfbb3ffff,0xfbc40000-0xfbc43fff irq 19 at device 0.1 on pci4 igb1: Using MSIX interrupts with 9 vectors igb1: Ethernet address: 00:25:90:0c:18:49 pcib5: <PCI-PCI bridge> irq 19 at device 2.0 on pci3 pci6: <PCI bus> on pcib5 igb2: <Intel(R) PRO/1000 Network Connection version - 2.2.3> port 0xc020-0xc03f mem 0xfb9a0000-0xfb9bffff,0xfb980000-0xfb99ffff,0xfba44000-0xfba47fff irq 19 at device 0.0 on pci6 igb2: Using MSIX interrupts with 9 vectors igb2: Ethernet address: 00:25:90:0c:18:4a igb3: <Intel(R) PRO/1000 Network Connection version - 2.2.3> port 0xc000-0xc01f mem 0xfb940000-0xfb95ffff,0xfb920000-0xfb93ffff,0xfba40000-0xfba43fff irq 16 at device 0.1 on pci6 igb3: Using MSIX interrupts with 9 vectors igb3: Ethernet address: 00:25:90:0c:18:4b pcib6: <ACPI PCI-PCI bridge> irq 19 at device 6.0 on pci0 pci8: <ACPI PCI bus> on pcib6 em0: <Intel(R) PRO/1000 Network Connection 7.2.3> port 0xf020-0xf03f mem 0xfbf00000-0xfbf1ffff,0xfbf24000-0xfbf24fff irq 20 at device 25.0 on pci0 em0: Using an MSI interrupt acquiring duplicate lock of same type: "network driver" 1st &dev_spec->swflag_mutex @ /usr/src/sys/dev/e1000/e1000_ich8lan.c:785 2nd &dev_spec->nvm_mutex @ /usr/src/sys/dev/e1000/e1000_ich8lan.c:751 KDB: stack backtrace: db_trace_self_wrapper(c0e8047a,30303031,6863695f,6e616c38,373a632e,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c09ddcdb,c0e83bf2,c0e1483a,c6561fd8,c14207fc,...) at kdb_backtrace+0x2a _witness_debugger(c0e83bf2,c0e14861,c0e1483a,2ef,0,...) at _witness_debugger+0x25 witness_checkorder(c6afe460,9,c0e1483a,2ef,0,...) at witness_checkorder+0x469 _mtx_lock_flags(c6afe460,0,c0e1483a,2ef,c1420868,...) at _mtx_lock_flags+0xc4 e1000_acquire_nvm_ich8lan(c6afa004,c14218f4,c06897eb,c6afa004,0,...) at e1000_acquire_nvm_ich8lan+0x2e e1000_read_nvm_ich8lan(c6afa004,50,1,c1420890,a004,...) at e1000_read_nvm_ich8lan+0x59 e1000_post_phy_reset_ich8lan(c6afa004,c6afe48c,0,c09af220,0,...) at e1000_post_phy_reset_ich8lan+0x7b4 e1000_reset_hw_ich8lan(c6afa004,c14209c0,c06600f2,c6afa004,0,...) at e1000_reset_hw_ich8lan+0x2c2 e1000_reset_hw(c6afa004,0,1,ffffffff,ffffffff,...) at e1000_reset_hw+0x1a em_attach(c690a000,c67db05c,c0f8b710,c0e510b9,80000003,...) at em_attach+0x13b2 device_attach(c690a000,4,c0e7f69e,a55) at device_attach+0x36f device_probe_and_attach(c690a000,c67d3700,c1420a60,c04fb3e4,c690a280,...) at device_probe_and_attach+0x4e bus_generic_attach(c690a280,c68c4000,1,c04fad10,0,c690a280,0,c68c4000) at bus_generic_attach+0x19 acpi_pci_attach(c690a280,c680805c,c0f8b710,c0e510b9,80000003,...) at acpi_pci_attach+0x194 device_attach(c690a280,4,c0e7f69e,a55) at device_attach+0x36f device_probe_and_attach(c690a280,c67d3b80,c1420af4,c04fd344,c67d3700,...) at device_probe_and_attach+0x4e bus_generic_attach(c67d3700,c0ec2271,0,c1420ae4,c68c4000,...) at bus_generic_attach+0x19 acpi_pcib_attach(c67d3700,c6897b54,0,c1420b14,2,...) at acpi_pcib_attach+0x194 acpi_pcib_acpi_attach(c67d3700,c684485c,c0f8b710,c0e510b9,80000003,...) at acpi_pcib_acpi_attach+0x246 device_attach(c67d3700,4,c0e7f69e,a55) at device_attach+0x36f device_probe_and_attach(c67d3700,0,c1420c20,c04f2012,c67d3b80,...) at device_probe_and_attach+0x4e bus_generic_attach(c67d3b80,c0f93480,c0ee18e0,4,c6850128,...) at bus_generic_attach+0x19 acpi_attach(c67d3b80,c684585c,c0f8b710,c0e510b9,80000003,...) at acpi_attach+0xdd2 device_attach(c67d3b80,4,c0e7f69e,a55) at device_attach+0x36f device_probe_and_attach(c67d3b80,c67d3e00,c1420ca8,c0cafc7e,c67d3e00,...) at device_probe_and_attach+0x4e bus_generic_attach(c67d3e00,a,c0d09b20,0) at bus_generic_attach+0x19 nexus_acpi_attach(c67d3e00,c686505c,c0f8b710,c0e510b9,80000003,...) at nexus_acpi_attach+0x7e device_attach(c67d3e00,4,c0e7f69e,a55) at device_attach+0x36f device_probe_and_attach(c67d3e00,c67d4000,c67d4000,c67d9000,c67d4000,...) at device_probe_and_attach+0x4e bus_generic_new_pass(c67d4000,c6585800,c0f8b640,c0ed2c84,fffffff,...) at bus_generic_new_pass+0xc5 bus_set_pass(7fffffff,c1420d5c,c0cb0d3c,fffffff,c1420d78,...) at bus_set_pass+0x81 root_bus_configure(fffffff,c1420d78,c095b63c,0,141ec00,...) at root_bus_configure+0x12 configure(0,141ec00,141ec00,141e000,1425000,...) at configure+0xc mi_startup() at mi_startup+0xac begin() at begin+0x2c em0: Ethernet address: 00:25:90:24:4d:43 ehci0: <EHCI (generic) USB 2.0 controller> mem 0xfbf23000-0xfbf233ff irq 16 at device 26.0 on pci0 usbus0: EHCI version 1.0 usbus0: <EHCI (generic) USB 2.0 controller> on ehci0 pcib7: <ACPI PCI-PCI bridge> irq 17 at device 28.0 on pci0 pci9: <ACPI PCI bus> on pcib7 pcib8: <ACPI PCI-PCI bridge> irq 17 at device 28.4 on pci0 pci10: <ACPI PCI bus> on pcib8 em1: <Intel(R) PRO/1000 Network Connection 7.2.3> port 0xe000-0xe01f mem 0xfbe00000-0xfbe1ffff,0xfbe20000-0xfbe23fff irq 16 at device 0.0 on pci10 em1: Using MSIX interrupts with 3 vectors em1: Ethernet address: 00:25:90:24:4d:42 ehci1: <EHCI (generic) USB 2.0 controller> mem 0xfbf22000-0xfbf223ff irq 23 at device 29.0 on pci0 usbus1: EHCI version 1.0 usbus1: <EHCI (generic) USB 2.0 controller> on ehci1 pcib9: <ACPI PCI-PCI bridge> at device 30.0 on pci0 pci11: <ACPI PCI bus> on pcib9 vgapci0: <VGA-compatible display> mem 0xfe000000-0xfe7fffff,0xfb800000-0xfb803fff,0xfb000000-0xfb7fffff irq 23 at device 3.0 on pci11 isab0: <PCI-ISA bridge> at device 31.0 on pci0 isa0: <ISA bus> on isab0 ahci0: <Intel Cougar Point AHCI SATA controller> port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfbf21000-0xfbf217ff irq 19 at device 31.2 on pci0 ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich0: <AHCI channel> at channel 0 on ahci0 pci0: <serial bus, SMBus> at device 31.3 (no driver attached) acpi_button0: <Power Button> on acpi0 hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 Event timer "HPET" frequency 14318180 Hz quality 550 attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart2: <16550 or compatible> port 0x3e8-0x3ef irq 10 on acpi0 pmtimer0 on isa0 orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff,0xc9000-0xc9fff,0xca000-0xcafff,0xcb000-0xcbfff pnpid ORM0000 on isa0 sc0: <System console> at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ata0 at port 0x1f0-0x1f7,0x3f6 irq 14 on isa0 ata1 at port 0x170-0x177,0x376 irq 15 on isa0 ppc0: parallel port not found. est0: <Enhanced SpeedStep Frequency Control> on cpu0 p4tcc0: <CPU Frequency Thermal Control> on cpu0 est1: <Enhanced SpeedStep Frequency Control> on cpu1 p4tcc1: <CPU Frequency Thermal Control> on cpu1 est2: <Enhanced SpeedStep Frequency Control> on cpu2 p4tcc2: <CPU Frequency Thermal Control> on cpu2 est3: <Enhanced SpeedStep Frequency Control> on cpu3 p4tcc3: <CPU Frequency Thermal Control> on cpu3 est4: <Enhanced SpeedStep Frequency Control> on cpu4 p4tcc4: <CPU Frequency Thermal Control> on cpu4 est5: <Enhanced SpeedStep Frequency Control> on cpu5 p4tcc5: <CPU Frequency Thermal Control> on cpu5 est6: <Enhanced SpeedStep Frequency Control> on cpu6 p4tcc6: <CPU Frequency Thermal Control> on cpu6 est7: <Enhanced SpeedStep Frequency Control> on cpu7 p4tcc7: <CPU Frequency Thermal Control> on cpu7 Timecounters tick every 1.000 msec usbus0: 480Mbps High Speed USB v2.0 usbus1: 480Mbps High Speed USB v2.0 ugen0.1: <Intel> at usbus0 uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0 ugen1.1: <Intel> at usbus1 uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1 ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: <ST3250312AS JC45> ATA-8 SATA 3.x device ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 238475MB (488397168 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 SMP: AP CPU #1 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #3 Launched! Timecounter "TSC" frequency 3192810212 Hz quality 800 WARNING: WITNESS option enabled, expect reduced performance. Root mount waiting for: usbus1 usbus0 uhub0: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered Root mount waiting for: usbus1 usbus0 ugen0.2: <vendor 0x8087> at usbus0 uhub2: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus0 ugen1.2: <vendor 0x8087> at usbus1 uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus1 Root mount waiting for: usbus1 usbus0 uhub2: 6 ports with 6 removable, self powered uhub3: 6 ports with 6 removable, self powered ugen0.3: <Winbond Electronics Corp> at usbus0 ums0: <Winbond Electronics Corp Hermon USB hidmouse Device, class 0/0, rev 1.10/0.01, addr 3> on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 ukbd0: <Winbond Electronics Corp Hermon USB hidmouse Device, class 0/0, rev 1.10/0.01, addr 3> on usbus0 kbd2 at ukbd0 Trying to mount root from ufs:/dev/ada0p2 [rw]...
hostb0@pci0:0:0:0: class=0x060000 card=0x062415d9 chip=0x01088086 rev=0x09 hdr=0x00 vendor = 'Intel Corporation' class = bridge subclass = HOST-PCI pcib1@pci0:0:1:0: class=0x060400 card=0x062415d9 chip=0x01018086 rev=0x09 hdr=0x01 vendor = 'Intel Corporation' class = bridge subclass = PCI-PCI pcib2@pci0:0:1:1: class=0x060400 card=0x062415d9 chip=0x01058086 rev=0x09 hdr=0x01 vendor = 'Intel Corporation' class = bridge subclass = PCI-PCI pcib6@pci0:0:6:0: class=0x060400 card=0x062415d9 chip=0x010d8086 rev=0x09 hdr=0x01 vendor = 'Intel Corporation' class = bridge subclass = PCI-PCI em0@pci0:0:25:0: class=0x020000 card=0x150215d9 chip=0x15028086 rev=0x05 hdr=0x00 vendor = 'Intel Corporation' class = network subclass = ethernet ehci0@pci0:0:26:0: class=0x0c0320 card=0x062415d9 chip=0x1c2d8086 rev=0x05 hdr=0x00 vendor = 'Intel Corporation' class = serial bus subclass = USB pcib7@pci0:0:28:0: class=0x060400 card=0x062415d9 chip=0x1c108086 rev=0xb5 hdr=0x01 vendor = 'Intel Corporation' class = bridge subclass = PCI-PCI pcib8@pci0:0:28:4: class=0x060400 card=0x062415d9 chip=0x1c188086 rev=0xb5 hdr=0x01 vendor = 'Intel Corporation' class = bridge subclass = PCI-PCI ehci1@pci0:0:29:0: class=0x0c0320 card=0x062415d9 chip=0x1c268086 rev=0x05 hdr=0x00 vendor = 'Intel Corporation' class = serial bus subclass = USB pcib9@pci0:0:30:0: class=0x060401 card=0x062415d9 chip=0x244e8086 rev=0xa5 hdr=0x01 vendor = 'Intel Corporation' device = '82801 Family (ICH2/3/4/5/6/7/8/9,63xxESB) Hub Interface to PCI Bridge' class = bridge subclass = PCI-PCI isab0@pci0:0:31:0: class=0x060100 card=0x062415d9 chip=0x1c548086 rev=0x05 hdr=0x00 vendor = 'Intel Corporation' class = bridge subclass = PCI-ISA ahci0@pci0:0:31:2: class=0x010601 card=0x062415d9 chip=0x1c028086 rev=0x05 hdr=0x00 vendor = 'Intel Corporation' class = mass storage subclass = SATA none0@pci0:0:31:3: class=0x0c0500 card=0x062415d9 chip=0x1c228086 rev=0x05 hdr=0x00 vendor = 'Intel Corporation' class = serial bus subclass = SMBus pcib3@pci0:2:0:0: class=0x060400 card=0x00000000 chip=0x851810b5 rev=0xac hdr=0x01 vendor = 'PLX Technology Inc.' device = 'PEX 8518 16-lane, 5-port PCI Express Switch' class = bridge subclass = PCI-PCI pcib4@pci0:3:1:0: class=0x060400 card=0x00000000 chip=0x851810b5 rev=0xac hdr=0x01 vendor = 'PLX Technology Inc.' device = 'PEX 8518 16-lane, 5-port PCI Express Switch' class = bridge subclass = PCI-PCI pcib5@pci0:3:2:0: class=0x060400 card=0x00000000 chip=0x851810b5 rev=0xac hdr=0x01 vendor = 'PLX Technology Inc.' device = 'PEX 8518 16-lane, 5-port PCI Express Switch' class = bridge subclass = PCI-PCI igb0@pci0:4:0:0: class=0x020000 card=0x10c915d9 chip=0x10c98086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' class = network subclass = ethernet igb1@pci0:4:0:1: class=0x020000 card=0x10c915d9 chip=0x10c98086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' class = network subclass = ethernet igb2@pci0:6:0:0: class=0x020000 card=0x10c915d9 chip=0x10c98086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' class = network subclass = ethernet igb3@pci0:6:0:1: class=0x020000 card=0x10c915d9 chip=0x10c98086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' class = network subclass = ethernet em1@pci0:10:0:0: class=0x020000 card=0x10d315d9 chip=0x10d38086 rev=0x00 hdr=0x00 vendor = 'Intel Corporation' device = 'Intel 82574L Gigabit Ethernet Controller (82574L)' class = network subclass = ethernet vgapci0@pci0:11:3:0: class=0x030000 card=0x062415d9 chip=0x0532102b rev=0x0a hdr=0x00 vendor = 'Matrox Electronic Systems Ltd.' class = display subclass = VGA >Description: On FreeBSD 9.0-CURRENT (2011 May 12) and also FreeBSD 8-STABLE and FreeBSD 8.2-RELEASE, if I compile the GENERIC kernel without modules (-DNO_MODULES) and without "makeoptions DEBUG=-g" the kernel hangs after printing: "em0: <Intel(R) PRO/1000 Network Connection 7.2.3> port 0xf020-0xf03f mem 0xfbf00000-0xfbf1ffff,0xfbf24000-0xfbf24fff irq 20 at device 25.0 on pci0 em0: Using an MSI interrupt" If I compile without modules but add "makeoptions DEBUG=-g" again the machine boots, and prints: "em0: Using an MSI interrupt acquiring duplicate lock of same type: "network driver" 1st &dev_spec->swflag_mutex @ /usr/src/sys/dev/e1000/e1000_ich8lan.c:785 2nd &dev_spec->nvm_mutex @ /usr/src/sys/dev/e1000/e1000_ich8lan.c:751" (see the full dmesg in the environment section) If I remove the device id E1000_DEV_ID_PCH2_LV_LM from the if_em.c file it also doesn't crash (but obviously doesn't find the network interface). The device that previously appeared as em1 now appears as em0. >How-To-Repeat: Compile the GENERIC kernel without "makeoptions DEBUG=-g" and without modules (-DNO_MODULES). Boot the kernel on a Supermicro X9SCM-F machine (or probably any machine with a network interface of the type "class=0x020000 card=0x150215d9 chip=0x15028086 rev=0x05 hdr=0x00" (E1000_DEV_ID_PCH2_LV_LM)). >Fix: >Release-Note: >Audit-Trail: >Unformatted: _______________________________________________ freebsd-bugs@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-bugs To unsubscribe, send any mail to "freebsd-bugs-unsubscr...@freebsd.org"