This server (FreeBSD 5.4 RELENG) is crashing once a week or more since 5.4 (maybe before).
It may be related with a full filesystem: I'm using snapshots on this server (using http://people.freebsd.org/~rse/snapshot/), and crack has occured after (~30mins) a snapshot that fills up to 100% the filesystem. Attached the dmesg and kgdb logs. I'm not so hacker, but hope that it can help to resolve this bug.
[GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so:
Undefined symbol "ps_pglobal_lookup"]
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "i386-marcel-freebsd".
#0 doadump () at pcpu.h:160
160 __asm __volatile("movl %%fs:0,%0" : "=r" (td));
(kgdb) bt full
#0 doadump () at pcpu.h:160
No locals.
#1 0xc06878d6 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:410
first_buf_printf = 1
#2 0xc0687cc4 in panic (fmt=0xc091a1ae "initiate_write_inodeblock_ufs2:
already started")
at /usr/src/sys/kern/kern_shutdown.c:566
td = (struct thread *) 0xc3641c00
bootopt = 260
newpanic = 0
ap = 0xc3641c00 "\\\214\220Ã -XÃ"
buf = "initiate_write_inodeblock_ufs2: already started", '\0' <repeats
208 times>
#3 0xc080ef5f in initiate_write_inodeblock_ufs2 (inodedep=0xc5be0280, bp=0x0)
at /usr/src/sys/ufs/ffs/ffs_softdep.c:3781
adp = (struct allocdirect *) 0xd75bd13c
lastadp = (struct allocdirect *) 0x1000
dp = (struct ufs2_dinode *) 0x0
fs = (struct fs *) 0xc21f6730
i = Unhandled dwarf expression opcode 0x93
(kgdb) quit
Copyright (c) 1992-2005 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 5.4-STABLE #0: Mon Jun 6 18:51:49 CEST 2005
[EMAIL PROTECTED]:/usr/obj/usr/src/sys/ZLIP
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 2.40GHz (2392.29-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0xf29 Stepping = 9
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Hyperthreading: 2 logical CPUs
real memory = 2147287040 (2047 MB)
avail memory = 2095828992 (1998 MB)
ACPI APIC Table: <DELL PE2600 >
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
cpu2 (AP): APIC ID: 6
cpu3 (AP): APIC ID: 7
ioapic0: Changing APIC ID to 8
ioapic1: Changing APIC ID to 9
ioapic2: Changing APIC ID to 10
ioapic2: WARNING: intbase 72 != expected base 48
ioapic3: Changing APIC ID to 11
ioapic3: WARNING: intbase 120 != expected base 96
ioapic4: Changing APIC ID to 12
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic2 <Version 2.0> irqs 72-95 on motherboard
ioapic3 <Version 2.0> irqs 120-143 on motherboard
ioapic4 <Version 2.0> irqs 144-167 on motherboard
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <DELL PE2600> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pci1: <base peripheral, interrupt controller> at device 28.0 (no driver
attached)
pcib2: <ACPI PCI-PCI bridge> at device 29.0 on pci1
pci2: <ACPI PCI bus> on pcib2
em0: <Intel(R) PRO/1000 Network Connection, Version - 1.7.35> port
0xece0-0xecff mem 0xfdec0000-0xfdedffff,0xfdee0000-0xfdefffff irq 24 at device
2.0 on pci2
em0: Ethernet address: 00:02:b3:d4:d3:a2
em0: Speed:N/A Duplex:N/A
pci1: <base peripheral, interrupt controller> at device 30.0 (no driver
attached)
pcib3: <ACPI PCI-PCI bridge> at device 31.0 on pci1
pci3: <ACPI PCI bus> on pcib3
em1: <Intel(R) PRO/1000 Network Connection, Version - 1.7.35> port
0xdce0-0xdcff mem 0xfdcc0000-0xfdcdffff,0xfdce0000-0xfdcfffff irq 28 at device
1.0 on pci3
em1: Ethernet address: 00:0b:db:92:0a:e4
em1: Speed:N/A Duplex:N/A
pcib4: <ACPI PCI-PCI bridge> at device 3.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pci4: <base peripheral, interrupt controller> at device 28.0 (no driver
attached)
pcib5: <ACPI PCI-PCI bridge> at device 29.0 on pci4
pci5: <ACPI PCI bus> on pcib5
pci4: <base peripheral, interrupt controller> at device 30.0 (no driver
attached)
pcib6: <ACPI PCI-PCI bridge> at device 31.0 on pci4
pci6: <ACPI PCI bus> on pcib6
bge0: <Broadcom BCM5703 Gigabit Ethernet, ASIC rev. 0x1002> mem
0xfd8f0000-0xfd8fffff irq 80 at device 3.0 on pci6
miibus0: <MII bus> on bge0
brgphy0: <BCM5703 10/100/1000baseTX PHY> on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX,
1000baseTX-FDX, auto
bge0: Ethernet address: 00:10:18:06:39:68
pcib7: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci7: <ACPI PCI bus> on pcib7
pci7: <base peripheral, interrupt controller> at device 28.0 (no driver
attached)
pcib8: <ACPI PCI-PCI bridge> at device 29.0 on pci7
pci8: <ACPI PCI bus> on pcib8
amr0: <LSILogic MegaRAID 1.51> mem 0xfebf0000-0xfebfffff irq 120 at device 8.0
on pci8
amr0: <LSILogic PERC 4/Di> Firmware 250O, BIOS 1.06, 128MB RAM
pci7: <base peripheral, interrupt controller> at device 30.0 (no driver
attached)
pcib9: <ACPI PCI-PCI bridge> at device 31.0 on pci7
pci10: <ACPI PCI bus> on pcib9
ahc0: <Adaptec 3960D Ultra160 SCSI adapter> port 0xbc00-0xbcff mem
0xfd3ff000-0xfd3fffff irq 148 at device 7.0 on pci10
aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/253 SCBs
ahc1: <Adaptec 3960D Ultra160 SCSI adapter> port 0xb800-0xb8ff mem
0xfd3fe000-0xfd3fefff irq 149 at device 7.1 on pci10
aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/253 SCBs
uhci0: <Intel 82801CA/CAM (ICH3) USB controller USB-A> port 0x9ce0-0x9cff irq
16 at device 29.0 on pci0
usb0: <Intel 82801CA/CAM (ICH3) USB controller USB-A> on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
pcib10: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci11: <ACPI PCI bus> on pcib10
pci11: <display, VGA> at device 4.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH3 UDMA100 controller> port
0xfc00-0xfc0f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 31.1 on pci0
ata0: channel #0 on atapci0
ata1: channel #1 on atapci0
fdc0: <floppy drive controller> port 0x3f7,0x3f0-0x3f5 irq 6 drq 2 on acpi0
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> port 0x64,0x60 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: model IntelliMouse Explorer, device ID 4
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
ppc0: <ECP parallel printer port> port 0x778-0x77f,0x378-0x37f irq 7 drq 1 on
acpi0
ppc0: Generic chipset (ECP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/8 bytes threshold
ppbus0: <Parallel port bus> on ppc0
plip0: <PLIP network interface> on ppbus0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
orm0: <ISA Option ROMs> at iomem 0xec000-0xeffff,0xc0000-0xc7fff on isa0
pmtimer0 on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 10.000 msec
acd0: CDROM <SAMSUNG CD-ROM SN-124/N103> at ata0-master PIO4
Waiting 15 seconds for SCSI devices to settle
amrd0: <LSILogic MegaRAID logical drive> on amr0
amrd0: 69758MB (142864384 sectors) RAID 1 (optimal)
ses0 at amr0 bus 0 target 6 lun 0
ses0: <PE/PV 1x6 SCSI BP 1.1> Fixed Processor SCSI-2 device
ses0: SAF-TE Compliant Device
da0 at ahc0 bus 0 target 0 lun 0
da0: <transtec 0001> Fixed Direct Access SCSI-3 device
da0: 160.000MB/s transfers (80.000MHz, offset 31, 16bit), Tagged Queueing
Enabled
da0: 200000MB (409600000 512 byte sectors: 255H 63S/T 25496C)
da1 at ahc0 bus 0 target 1 lun 0
da1: <transtec 0001> Fixed Direct Access SCSI-3 device
da1: 160.000MB/s transfers (80.000MHz, offset 31, 16bit), Tagged Queueing
Enabled
da1: 200000MB (409600000 512 byte sectors: 255H 63S/T 25496C)
da2 at ahc0 bus 0 target 2 lun 0
da2: <transtec 0001> Fixed Direct Access SCSI-3 device
da2: 160.000MB/s transfers (80.000MHz, offset 31, 16bit), Tagged Queueing
Enabled
da2: 200000MB (409600000 512 byte sectors: 255H 63S/T 25496C)
da3 at ahc0 bus 0 target 3 lun 0
da3: <transtec 0001> Fixed Direct Access SCSI-3 device
da3: 160.000MB/s transfers (80.000MHz, offset 31, 16bit), Tagged Queueing
Enabled
da3: 300000MB (614400000 512 byte sectors: 255H 63S/T 38244C)
da4 at ahc0 bus 0 target 4 lun 0
da4: <transtec 0001> Fixed Direct Access SCSI-3 device
da4: 160.000MB/s transfers (80.000MHz, offset 31, 16bit), Tagged Queueing
Enabled
da4: 266856MB (546521088 512 byte sectors: 255H 63S/T 34019C)
SMP: AP CPU #1 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #3 Launched!
Mounting root from ufs:/dev/amrd0s1a
WARNING: / was not properly dismounted
WARNING: /tmp was not properly dismounted
WARNING: /usr was not properly dismounted
WARNING: /var was not properly dismounted
/var: mount pending error: blocks 156 files 1
WARNING: /var/crash was not properly dismounted
WARNING: /anonftp was not properly dismounted
WARNING: /jukebox was not properly dismounted
WARNING: /anonftp/pub2 was not properly dismounted
WARNING: /savesm2 was not properly dismounted
/savesm2: mount pending error: blocks 3230304 files 1
WARNING: /sav was not properly dismounted
em1: Link is up 1000 Mbps Full Duplex
smime.p7s
Description: S/MIME Cryptographic Signature
