On Wed, Nov 30, 2005 at 01:33:14PM +0100, Claudio Jeker wrote:
First I want to say thank you very much to Claudio, I appreciate the
response and using pf sure seems like it SHOULD work, but it keeps
crashing on me :-(
Sorry this is so long, but I wanted to provide as much information as
possible. If there is any other information that will help, I will do
my best to provide it.
> On Tue, Nov 29, 2005 at 11:26:49PM -0700, andrew fresh wrote:
> > I want to load balancing across those 4 T1s and it is sounding like I
> > will not be able to do that and will have to figure out how to get these
> > 4 new lines into my old cisco router.
>
> It could be possible to use trunk with sppp but that needs some patching.
> At least a round-robin trunk should be possible.
Dang that would be handy, because using PF as below, I have 2 different
boxes that DDB on me. It seems like maybe they DDB when they get too
much outbound traffic, but I have not been able to determine what causes
it apart from having PF enabled. Ifstated being enabled or disabled
doesn't seem to make a difference. Neither do hardware changes. Same
issues with both the bsd and bsd.mp kernels.
I am getting 3 different DDB's. Mostly "kernel: page fault trap,
code=0" and "Panic: rtfree 2". I have also gotten some "Panic: sbdrop",
but not since I got the serial console attached. When I got the sbdrop,
trace showed calls to pf_* but I did not write it down as I thought I
would see it again with the
serial console.
It seems to DDB anywhere from 5 minutes to 90 minutes after a reboot.
Once I got 6.5 hours, but mostly closer to 10 minutes. The only thing
that seems to make a difference is disabling pf, I am up 17.5 hours now
with pf disabled.
DMESG and the trace/ps from the DDBs are below.
> > or do I have to do weird things with ifstated(8) (like 16 states for the
> > 4 lines and lots of route add/delete statements)?
>
> You most probably need ifstated to make sure that failed routes get
> removed (if link is down).
I wish it were automatic, but it seems to work, although I need more
testing.
$ wc -l /etc/ifstated.conf
258 /etc/ifstated.conf
> > or something with 'route-to' in pf?
> > http://marc.theaimsgroup.com/?l=openbsd-misc&m=112831360613745&w=2
> >
> > This seems to work in my test environment:
> > # t1s is an interface group containing all of the links to that provider
> > pass out on t1s route-to { \
> > (san0 10.35.0.2) \
> > (san1 10.35.1.2) \
> > (san2 10.35.2.2) \
> > (san3 10.35.3.2) \
> > } round-robin keep state
> > pass in on san0 reply-to (san0 10.35.0.2) keep state
> > pass in on san1 reply-to (san1 10.35.1.2) keep state
> > pass in on san2 reply-to (san2 10.35.2.2) keep state
> > pass in on san3 reply-to (san3 10.35.3.2) keep state
>
> I would probably do it the same way.
> I'm not sure if pf pays attetion to the link state of route-to interfaces.
This is my entire pf.conf (apart from macro definitions), it is as
simple as I could make it.
-- pf.conf
set skip on { lo }
scrub in
block in
pass out keep state
# inet is an interface group containing all 4 of the san interfaces
pass out on inet route-to { \
($inet_if0 $inet_dest0) \
($inet_if1 $inet_dest1) \
($inet_if2 $inet_dest2) \
($inet_if3 $inet_dest3) \
} round-robin keep state
pass in on $inet_if0 reply-to ($inet_if0 $inet_dest0) keep state
pass in on $inet_if1 reply-to ($inet_if1 $inet_dest1) keep state
pass in on $inet_if2 reply-to ($inet_if2 $inet_dest2) keep state
pass in on $inet_if3 reply-to ($inet_if3 $inet_dest3) keep state
pass on $int_if
-- dmesg from the first box
OpenBSD 3.8-stable (GENERIC.MP) #0: Thu Nov 3 14:39:08 MST 2005
[EMAIL PROTECTED]:/usr/src/sys/arch/i386/compile/GENERIC.MP
cpu0: Intel Pentium III Xeon ("GenuineIntel" 686-class) 699 MHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE
real mem = 1073319936 (1048164K)
avail mem = 972726272 (949928K)
using 4278 buffers containing 53768192 bytes (52508K) of memory
mainbus0 (root)
bios0 at mainbus0: AT/286+(00) BIOS, date 07/07/04, BIOS32 rev. 0 @ 0xffe90
pcibios0 at bios0: rev 2.1 @ 0xf0000/0x10000
pcibios0: PCI IRQ Routing Table rev 1.0 @ 0xfc350/208 (11 entries)
pcibios0: PCI Interrupt Router at 000:15:0 ("ServerWorks ROSB4
SouthBridge" rev 0x00)
pcibios0: PCI bus #0 is the last bus
bios0: ROM list: 0xc0000/0x8000 0xc8000/0xe00
mainbus0: Intel MP Specification (Version 1.4) (DELL POWEREDGE A2)
cpu0 at mainbus0: apid 1 (boot processor)
cpu0: apic clock running at 99 MHz
cpu1 at mainbus0: apid 0 (application processor)
cpu1: Intel Pentium III Xeon ("GenuineIntel" 686-class) 699 MHz
cpu1:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE
mainbus0: bus 0 is type PCI
mainbus0: bus 1 is type PCI
mainbus0: bus 2 is type PCI
mainbus0: bus 3 is type PCI
mainbus0: bus 4 is type PCI
mainbus0: bus 5 is type PCI
mainbus0: bus 6 is type PCI
mainbus0: bus 7 is type PCI
mainbus0: bus 8 is type PCI
mainbus0: bus 9 is type PCI
mainbus0: bus 10 is type PCI
mainbus0: bus 11 is type PCI
mainbus0: bus 12 is type PCI
mainbus0: bus 13 is type PCI
mainbus0: bus 14 is type PCI
mainbus0: bus 15 is type PCI
mainbus0: bus 16 is type PCI
mainbus0: bus 17 is type PCI
mainbus0: bus 18 is type ISA
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 11, 16 pins
ioapic0: misconfigured as apic 0, remapped to apic 2
ioapic1 at mainbus0: apid 3 pa 0xfec01000, version 11, 16 pins
ioapic1: misconfigured as apic 0, remapped to apic 3
pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
pchb0 at pci0 dev 0 function 0 "ServerWorks CNB20HE Host" rev 0x21
pci1 at pchb0 bus 3
fxp0 at pci1 dev 8 function 0 "Intel 82557" rev 0x08, i82559: apic 3 int 6 (irq
11), address 00:d0:b7:d4:f2:87
inphy0 at fxp0 phy 1: i82555 10/100 PHY, rev. 4
ppb0 at pci1 dev 9 function 0 "Intel i960 RN PCI-PCI" rev 0x02
pci2 at ppb0 bus 4
ami0 at pci1 dev 9 function 1 "Intel 80960RP ATU" rev 0x02: apic 3 int 7 (irq
10) Dell 467/32b
ami0: FW 1.06, BIOS v1p00, 128MB RAM
ami0: 2 channels, 16 targets, 1 logical drives
scsibus0 at ami0: 1 targets
sd0 at scsibus0 targ 0 lun 0: <AMI, Host drive #00, > SCSI2 0/direct fixed
sd0: 17278MB, 2202 cyl, 255 head, 63 sec, 512 bytes/sec, 35385344 sec total
scsibus1 at ami0: 16 targets
safte0 at scsibus1 targ 6 lun 0: <DELL, 1x4 U2W SCSI BP, 1.30> SCSI2
3/processor fixed
scsibus2 at ami0: 16 targets
san0 at pci1 dev 10 function 0 unknown vendor 0x1923 product 0x0300 rev 0x01
apic 3 int 8 (irq 11)
san1 at pci1 dev 11 function 0 unknown vendor 0x1923 product 0x0300 rev 0x01
apic 3 int 9 (irq 10)
pchb1 at pci0 dev 0 function 1 "ServerWorks CNB20HE Host" rev 0x01
pchb2 at pci0 dev 0 function 2 "ServerWorks I/O Bridge" rev 0x00
pchb3 at pci0 dev 0 function 3 "ServerWorks I/O Bridge" rev 0x00
pci3 at pchb3 bus 13
vga1 at pci0 dev 4 function 0 "ATI Mach64 GY" rev 0x7a
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
ahc1 at pci0 dev 5 function 0 "Adaptec AIC-7899 U160" rev 0x01: apic 3 int 1
(irq 11)
scsibus3 at ahc1: 16 targets
ahc2 at pci0 dev 5 function 1 "Adaptec AIC-7899 U160" rev 0x01: apic 3 int 2
(irq 10)
scsibus4 at ahc2: 16 targets
pcib0 at pci0 dev 15 function 0 "ServerWorks ROSB4 SouthBridge" rev 0x50
pciide0 at pci0 dev 15 function 1 "ServerWorks OSB4 IDE" rev 0x00: DMA
atapiscsi0 at pciide0 channel 0 drive 0
scsibus5 at atapiscsi0: 2 targets
cd0 at scsibus5 targ 0 lun 0: <SAMSUNG, CD-ROM SN-124, S003> SCSI0 5/cdrom
removable
cd0(pciide0:0:0): using PIO mode 4, DMA mode 2, Ultra-DMA mode 2
ohci0 at pci0 dev 15 function 2 "ServerWorks OSB4/CSB5 USB" rev 0x04:
apic 2 int 5 (irq 5), version 1.0, legacy support
usb0 at ohci0: USB revision 1.0
uhub0 at usb0
uhub0: ServerWorks OHCI root hub, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
sysbeep0 at pcppi0
lpt0 at isa0 port 0x378/4 irq 7
npx0 at isa0 port 0xf0/16: using exception 16
pccom0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
pccom0: console
pccom1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
biomask 0 netmask 0 ttymask 0
pctr: 686-class user-level performance counters enabled
mtrr: Pentium Pro MTRR support
dkcsum: sd0 matches BIOS drive 0x80
root on sd0a
rootdev=0x400 rrootdev=0xd00 rawdev=0xd02
WARNING: / was not properly unmounted
<6>san0: Bringing interface up.
<6>san0: Configuring A101 PMC T1/E1/J1 Front End
<6>san0: Link connecting...
<6>san0: Bringing interface up.
<6>san1: Bringing interface up.
<6>san1: Configuring A101 PMC T1/E1/J1 Front End
<6>san1: Link connecting...
<6>san1: Bringing interface up.
<6>san2: Bringing interface up.
<6>san2: Configuring A101 PMC T1/E1/J1 Front End
<6>san2: Link connecting...
<6>san2: Bringing interface up.
<6>san3: Bringing interface up.
<6>san3: Configuring A101 PMC T1/E1/J1 Front End
<6>san3: Link connecting...
<6>san3: Bringing interface up.
<7>san0: Unknown signal (3f).
<6>san0: T1 connected!
<6>san0: Link connected!
<7>san1: Unknown signal (3f).
<6>san1: T1 connected!
<6>san1: Link connected!
<7>san2: Unknown signal (3f).
<6>san2: T1 connected!
<6>san2: Link connected!
<7>san3: Unknown signal (3f).
<6>san3: T1 connected!
<6>san3: Link connected!
-- First panic on machine 1
ddb{0}> show panic
rtfree 2
ddb{0}> trace
Debugger(0,d7d8bf00,e9041360,d7d8bfd4,0) at Debugger+0x4
panic(d0505260,14,28,e9041550,0) at panic+0x63
rtfree(d7d8bfd4,c,0,d189f000) at rtfree+0xb2
pf_route(e9041550,d7d83764,2,d189f000,0,e9041450,d05ddf94,1) at pf_route+0x26d
pf_test(2,d189f000,e9041550,0) at pf_test+0x46a
pf_route(e9041710,d7d83764,2,d189f800,0,e9041610,d05ddf94,1) at pf_route+0x149
pf_test(2,d189f800,e9041710,0) at pf_test+0x46a
pf_route(e90418d0,d7d83764,2,d18a0000,0,e90417d0,d05ddf94,1) at pf_route+0x149
pf_test(2,d18a0000,e90418d0,0) at pf_test+0x46a
pf_route(e9041a90,d7d83764,2,d18a0800,0,e9041990,d05ddf94,1) at pf_route+0x149
pf_test(2,d18a0800,e9041a90,0) at pf_test+0x46a
pf_route(e9041c8c,d7d83764,2,d189f800,0,e9041b50,d05ddf94,1) at pf_route+0x149
pf_test(2,d189f800,e9041c8c,0) at pf_test+0x46a
ip_output(d7d8bf00,0,0,0,0) at ip_output+0x72a
icmp_send(d7d8bf00,0,64,0,d7d8bf00) at icmp_send+0x5a
icmp_reflect(d7d8bf00,3,3,0,0,9e0b942,504,0) at icmp_reflect+0x1f2
udp_input(d7e18d00,14,0,0,e9041f18) at udp_input+0x99b
ipv4_input(d7e18d00,d187dec0,0,e9040000) at ipv4_input+0x4f5
ipintr(58,10,d1880010,d1870010,e9040000) at ipintr+0x67
Bad frame pointer: 0xe9041f20
ddb{0}> machine ddb 1
Stopped at Debugger+0x4: leave
RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC!
DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION!
ddb{1}> trace
Debugger(d1881c00,d05f5640,d010222c,e9043ecc) at Debugger+0x4
i386_ipi_handler(b0,58,10,d05f0010,e9040010) at i386_ipi_handler+0x57
Xintripi() at Xintripi+0x47
--- interrupt ---
i386_softintlock(0,d0580058,10,e9040010,d0200010) at i386_softintlock+0x34
Xintrltimer() at Xintrltimer+0x47
--- interrupt ---
apm_cpu_idle(0,0,0,0,0) at apm_cpu_idle+0x4a
ddb{1}> ps
PID PPID PGRP UID S FLAGS WAIT COMMAND
10431 13195 10431 1000 3 0x2004086 ttyin ksh
13195 11397 11397 1000 3 0x2000184 select sshd
11397 24190 11397 0 3 0x2004084 netio sshd
12818 15994 12818 1000 3 0x2044186 ttyin systat
15994 9137 15994 1000 3 0x2004086 pause ksh
9137 17734 17734 1000 3 0x2000184 select sshd
17734 24190 17734 0 3 0x2004084 netio sshd
16262 1 16262 0 2 0x2004086 getty
8935 1 8935 0 3 0x2004086 ttyin getty
15199 1 15199 0 3 0x2004086 ttyin getty
17709 1 17709 0 3 0x2004086 ttyin getty
11813 1 11813 0 3 0x2004086 ttyin getty
24491 1 24491 0 3 0x2004086 ttyin getty
1970 1 1970 0 3 0x2000084 select cron
18920 1 7214 0 3 0x2000084 select snmpd
16511 1 16511 0 3 0x2000084 kqread ifstated
24190 1 24190 0 3 0x2000084 select sshd
23555 1 23555 0 3 0x2040184 select sendmail
26242 1 26242 0 3 0x2000184 select inetd
32543 6478 6478 75 3 0x2000184 poll bgpd
13649 6478 6478 75 3 0x2000184 poll bgpd
6478 1 6478 0 3 0x2000084 poll bgpd
21185 30811 30811 83 3 0x2000184 poll ntpd
30811 1 30811 0 3 0x2000084 poll ntpd
30985 13262 13262 74 3 0x2000184 bpf pflogd
13262 1 13262 0 3 0x2000084 netio pflogd
22989 10109 10109 73 3 0x2000184 poll syslogd
10109 1 10109 0 3 0x2000084 netio syslogd
12 0 0 0 3 0x2100204 crypto_wa crypto
11 0 0 0 3 0x2100204 aiodoned aiodoned
10 0 0 0 3 0x2100204 syncer update
9 0 0 0 3 0x2100204 cleaner cleaner
8 0 0 0 3 0x100204 reaper reaper
7 0 0 0 3 0x2100204 pgdaemon pagedaemon
6 0 0 0 3 0x2100204 pftm pfpurge
5 0 0 0 3 0x2100204 usbtsk usbtask
4 0 0 0 3 0x2100204 usbevt usb0
3 0 0 0 3 0x2100204 timeout safte0
2 0 0 0 2 0x2100204 kmthread
1 0 1 0 3 0x2004084 wait init
0 -1 0 0 3 0x2080204 scheduler swapper
-- Second panic on machine 1
kernel: page fault trap, code=0
Stopped at _bus_dmamap_unload+0x6: movl $0,0x18(%eax)
ddb{0}> trace
_bus_dmamap_unload(d0597160,68513878,e9041ed8,d0257a57,50) at
_bus_dmamap_unload+0x6
fxp_add_rfabuf(d1882000,d7db0e00,438f0058,a0010) at fxp_add_rfabuf+0xfd
fxp_intr(d1882000) at fxp_intr+0x16e
Xintr_ioapic0() at Xintr_ioapic0+0x74
--- interrupt ---
apm_cpu_idle(0,0,0,0,0) at apm_cpu_idle+0x4a
ddb{0}> machine ddb 1
Stopped at Debugger+0x4: leave
ddb{1}> trace
Debugger(d1881c00,d05f5640,0,0) at Debugger+0x4
i386_ipi_handler(b0,58,e9040010,d05f0010,e9040010) at i386_ipi_handler+0x57
Xintripi() at Xintripi+0x47
--- interrupt ---
i386_softintlock(0,58,10,10,10) at i386_softintlock+0x34
Xintrltimer() at Xintrltimer+0x47
--- interrupt ---
apm_cpu_idle(0,0,0,0,0) at apm_cpu_idle+0x4a
ddb{1}> ps
PID PPID PGRP UID S FLAGS WAIT COMMAND
32402 30021 32402 1001 3 0x2004086 ttyin ksh
30021 22476 22476 1001 3 0x2000184 select sshd
22476 12103 22476 0 3 0x2004084 netio sshd
18099 7201 18099 1000 3 0x2004086 ttyin ksh
7201 9151 9151 1000 3 0x2000184 select sshd
9151 12103 9151 0 3 0x2004084 netio sshd
17748 1 17748 0 3 0x2004086 ttyin getty
35 1 35 0 3 0x2004086 ttyin getty
31195 1 31195 0 3 0x2004086 ttyin getty
18830 1 18830 0 3 0x2004086 ttyin getty
12315 1 12315 0 3 0x2004086 ttyin getty
4085 1 4085 0 3 0x2004086 ttyin getty
6532 1 6532 0 3 0x2000084 select cron
10227 1 25103 0 3 0x2000084 select snmpd
30268 1 30268 0 3 0x2000084 kqread ifstated
13042 1 13042 0 3 0x2040184 select sendmail
12103 1 12103 0 3 0x2000084 select sshd
14531 1 14531 0 3 0x2000184 select inetd
6770 21782 21782 75 3 0x2000184 poll bgpd
9027 21782 21782 75 3 0x2000184 poll bgpd
21782 1 21782 0 3 0x2000084 poll bgpd
10220 31794 31794 83 3 0x2000184 poll ntpd
31794 1 31794 0 3 0x2000084 poll ntpd
15786 17539 17539 74 3 0x2000184 bpf pflogd
17539 1 17539 0 3 0x2000084 netio pflogd
31061 6138 6138 73 3 0x2000184 poll syslogd
6138 1 6138 0 3 0x2000084 netio syslogd
12 0 0 0 3 0x2100204 crypto_wa crypto
11 0 0 0 3 0x2100204 aiodoned aiodoned
10 0 0 0 3 0x2100204 syncer update
9 0 0 0 3 0x2100204 cleaner cleaner
8 0 0 0 3 0x100204 reaper reaper
7 0 0 0 3 0x2100204 pgdaemon pagedaemon
6 0 0 0 3 0x2100204 pftm pfpurge
5 0 0 0 3 0x2100204 usbtsk usbtask
4 0 0 0 3 0x2100204 usbevt usb0
3 0 0 0 3 0x2100204 timeout safte0
2 0 0 0 3 0x2100204 kmalloc kmthread
1 0 1 0 3 0x2004084 wait init
0 -1 0 0 3 0x2080204 scheduler swapper
-- dmesg machine 2
Copyright (c) 1982, 1986, 1989, 1991, 1993
The Regents of the University of California. All rights reserved.
Copyright (c) 1995-2005 OpenBSD. All rights reserved.
http://www.OpenBSD.org
OpenBSD 3.8-stable (GENERIC) #0: Thu Nov 3 14:20:06 MST 2005
[EMAIL PROTECTED]:/usr/src/sys/arch/i386/compile/GENERIC
cpu0: Intel Pentium III ("GenuineIntel" 686-class) 852 MHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE
real mem = 536453120 (523880K)
avail mem = 482594816 (471284K)
using 4278 buffers containing 26927104 bytes (26296K) of memory
mainbus0 (root)
bios0 at mainbus0: AT/286+(00) BIOS, date 07/15/99, BIOS32 rev. 0 @ 0xfdb50
apm0 at bios0: Power Management spec V1.2 (BIOS mgmt disabled)
apm0: APM power management enable: power management disabled (1)
apm0: APM engage (device 1): power management disabled (1)
apm0: AC on, battery charge unknown
apm0: flags b0102 dobusy 0 doidle 1
pcibios0 at bios0: rev 2.1 @ 0xf0000/0x10000
pcibios0: PCI BIOS has 12 Interrupt Routing table entries
pcibios0: PCI Interrupt Router at 000:07:0 ("Intel 82371AB PIIX4 ISA" rev 0x00)
pcibios0: PCI bus #1 is the last bus
WARNING: can't reserve area for BIOS PROM.
bios0: ROM list: 0xc0000/0x8000
cpu0 at mainbus0
pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
pchb0 at pci0 dev 0 function 0 "Intel 82440BX AGP" rev 0x00
ppb0 at pci0 dev 1 function 0 "Intel 82440BX AGP" rev 0x00
pci1 at ppb0 bus 1
vga1 at pci1 dev 0 function 0 "ATI Mach64 GZ" rev 0x7a
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
pcib0 at pci0 dev 7 function 0 "Intel 82371AB PIIX4 ISA" rev 0x02
pciide0 at pci0 dev 7 function 1 "Intel 82371AB IDE" rev 0x01: DMA,
channel 0 wired to compatibility, channel 1 wired to compatibility
wd0 at pciide0 channel 0 drive 0: <QUANTUM FIREBALL_TM1280A>
wd0: 16-sector PIO, LBA, 1222MB, 2503872 sectors
wd0(pciide0:0:0): using PIO mode 4, DMA mode 2
pciide0: channel 1 disabled (no drives)
uhci0 at pci0 dev 7 function 2 "Intel 82371AB USB" rev 0x01: irq 11
usb0 at uhci0: USB revision 1.0
uhub0 at usb0
uhub0: Intel UHCI root hub, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
"Intel 82371AB Power" rev 0x02 at pci0 dev 7 function 3 not configured
siop0 at pci0 dev 11 function 0 "Symbios Logic 53c896" rev 0x05: irq 5, can't
map on-board RAM
scsibus0 at siop0: 16 targets
siop1 at pci0 dev 11 function 1 "Symbios Logic 53c896" rev 0x05: irq 9, can't
map on-board RAM
scsibus1 at siop1: 16 targets
eap0 at pci0 dev 12 function 0 "Ensoniq AudioPCI97" rev 0x08: irq 9
ac97: codec id 0x43525903 (Cirrus Logic CS4297 rev 3)
ac97: codec features headphone, 18 bit DAC, 18 bit ADC, No 3D Stereo
audio0 at eap0
midi0 at eap0: <AudioPCI MIDI UART>
fxp0 at pci0 dev 13 function 0 "Intel 82557" rev 0x08, i82559: irq 11,
address 00:e0:81:10:93:5c
inphy0 at fxp0 phy 1: i82555 10/100 PHY, rev. 4
san0 at pci0 dev 17 function 0 unknown vendor 0x1923 product 0x0300 rev 0x01
irq5
san1 at pci0 dev 19 function 0 unknown vendor 0x1923 product 0x0300 rev 0x01
irq11
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
midi1 at pcppi0: <PC speaker>
spkr0 at pcppi0
sysbeep0 at pcppi0
lpt0 at isa0 port 0x378/4 irq 7
lm0 at isa0 port 0x290/8: W83782D
npx0 at isa0 port 0xf0/16: using exception 16
pccom0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
pccom0: console
pccom1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
biomask ff65 netmask ff65 ttymask ffe7
pctr: 686-class user-level performance counters enabled
mtrr: Pentium Pro MTRR support
dkcsum: wd0 matches BIOS drive 0x80
root on wd0a
rootdev=0x0 rrootdev=0x300 rawdev=0x302
Automatic boot in progress: starting file system checks.
/dev/rwd0a: file system is clean; not checking
/dev/rwd0h: file system is clean; not checking
/dev/rwd0d: file system is clean; not checking
/dev/rwd0g: file system is clean; not checking
/dev/rwd0e: file system is clean; not checking
/dev/rwd0f: file system is clean; not checking
setting tty flags
pf enabled
net.inet.ip.forwarding: 0 -> 1
starting network
add net 66.185.224.0: gateway 66.185.224.3
san0: Bringing interface up.
san0: Configuring A101 PMC T1/E1/J1 Front End
san0: Link connecting...
san0: Bringing interface up.
san1: Bringing interface up.
san1: Configuring A101 PMC T1/E1/J1 Front End
san1: Link connecting...
san1: Bringing interface up.
san0: Unknown signal (3f).
san0: T1 connected!
san0: Link connected!
san1: Unknown signal (3f).
san1: T1 connected!
san1: Link connected!
san2: Bringing interface up.
san2: Configuring A101 PMC T1/E1/J1 Front End
san2: Link connecting...
san2: Bringing interface up.
san3: Bringing interface up.
san3: Configuring A101 PMC T1/E1/J1 Front End
san3: Link connecting...
san3: Bringing interface up.
san2: Unknown signal (3f).
san2: T1 connected!
san2: Link connected!
san3: Unknown signal (00).
san3: T1 connected!
san3: Link connected!
starting system logger
starting rpc daemons: ntpd.
savecore: no core dump
checking quotas: done.
building ps databases: kvm dev.
clearing /tmp
starting pre-securelevel daemons:.
setting kernel security level: kern.securelevel: 0 -> 1
creating runtime link editor directory cache.
preserving editor files
starting network daemons: bgpd sendmail inetd sshd.
starting local daemons: snmpd.
standard daemons: cron.
Thu Dec 1 12:11:12 MST 2005
-- First panic on machine 2
kernel: page fault trap, code=0
Stopped at ether_input+0x3d: testb $0x1,0(%ecx)
ddb> trace
ether_input(d0f8a040,3f3f3f3f,d69c4000,d69c4000,d69c4000) at ether_input+0x3d
ether_input_mbuf(d0f8a040,d69c4000,1f96,d0f65000) at ether_input_mbuf+0x23
fxp_intr(d0f8a000) at fxp_intr+0x1af
Xrecurse_legacy11() at Xrecurse_legacy11+0x8a
--- interrupt ---
apm_cpu_idle(b0,d05cce20,d05ccca0,7fffffff,d021ae5f) at apm_cpu_idle+0x42
idle_loop(d067a280,28,0,0,80000000) at idle_loop+0x5
bpendtsleep(d05ccca0,4,d050e3d1,0,0,ffffffff,d04c73b2,0) at bpendtsleep
uvm_scheduler(d05ccc9c,3,0,d04c73b2,20000000) at uvm_scheduler+0x6b
check_console(0,0,0,0,0) at check_console
ddb> ps
PID PPID PGRP UID S FLAGS WAIT COMMAND
31650 28764 31650 1000 3 0x4086 ttyin ksh
28764 9222 9222 1000 3 0x184 select sshd
9222 28621 9222 0 3 0x4084 netio sshd
3036 1 3036 0 3 0x4086 ttyin getty
17118 1 17118 0 3 0x4086 ttyin getty
22848 1 22848 0 3 0x4086 ttyin getty
5258 1 5258 0 3 0x4086 ttyin getty
26699 1 26699 0 3 0x4086 ttyin getty
23445 1 23445 0 3 0x84 select cron
8686 1 20058 0 3 0x84 select snmpd
29040 1 29040 0 3 0x40184 select sendmail
28621 1 28621 0 3 0x84 select sshd
22727 1 22727 0 3 0x184 select inetd
29574 11272 11272 75 3 0x184 poll bgpd
5084 11272 11272 75 3 0x184 poll bgpd
11272 1 11272 0 3 0x84 poll bgpd
27131 24851 24851 83 3 0x184 poll ntpd
24851 1 24851 0 3 0x84 poll ntpd
23470 18889 18889 74 3 0x184 bpf pflogd
18889 1 18889 0 3 0x84 netio pflogd
12822 15114 15114 73 3 0x184 poll syslogd
15114 1 15114 0 3 0x84 netio syslogd
12 0 0 0 3 0x100204 crypto_wa crypto
11 0 0 0 3 0x100204 aiodoned aiodoned
10 0 0 0 3 0x100204 syncer update
9 0 0 0 3 0x100204 cleaner cleaner
8 0 0 0 3 0x100204 reaper reaper
7 0 0 0 3 0x100204 pgdaemon pagedaemon
6 0 0 0 3 0x100204 pftm pfpurge
5 0 0 0 3 0x100204 usbtsk usbtask
4 0 0 0 3 0x100204 usbevt usb0
3 0 0 0 3 0x100204 apmev apm0
2 0 0 0 3 0x100204 kmalloc kmthread
1 0 1 0 3 0x4084 wait init
0 -1 0 0 3 0x80204 scheduler swapper
-- This happened after the above panic when I did the boot sync
ddb> boot sync
syncing disks... panic: tsleep
Stopped at Debugger+0x4: leave
RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS
PANIC!
DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION!
ddb> trace
Debugger(1,d0f79c00,d0f79c94,d05ccca0,d6abbba4) at Debugger+0x4
panic(d04f58d0,d6abbba4,d0f7a000,0,d6a71ba0) at panic+0x63
ltsleep(d6abbba4,11,d04f8f2c,0,0) at ltsleep+0x9d
getblk(d6a260a0,80,4000,0,0) at getblk+0x161
bread(d6a260a0,80,4000,ffffffff,d06f19d8,d05ccca0,d06f19ec,d02f6f38) at
bread+0x1d
ffs_update(d6a25470,0,0,0,0) at ffs_update+0x140
ffs_fsync(d06f1a54,0,d06f1a7c,d023bf1b,d0580680) at ffs_fsync+0x140
VOP_FSYNC(d6a26460,d6a36000,2,d05ccca0) at VOP_FSYNC+0x34
ffs_sync_vnode(d6a26460,d06f1af4,d05ccca0,0) at ffs_sync_vnode+0x5c
vfs_mount_foreach_vnode(d0fb7800,d02e7000,d06f1af4,d6a36000,d0102050) at
vfs_mo
unt_foreach_vnode+0x2b
ffs_sync(d0fb7800,2,d6a36000,d05ccca0,d0fb7800,10,d05d2e00,d05ccca0) at
ffs_sync+0x61
sys_sync(d05ccca0,0,0,d057fa44,0) at sys_sync+0x87
vfs_shutdown(d06f1bd4,0,d06f1bac,d01e8cf8,4800) at vfs_shutdown+0x6b
boot(4800,d04f0c6f,d06f1bcc,0,0) at boot+0x15a
db_boot_crash_cmd(d0254fa1,0,ffffffff,d06f1bd4,d057dd00) at
db_boot_crash_cmd
db_command(d057dd00,d057db20,d06f1cdc,d01e8b41,d06f1cb8) at
db_command+0xff
db_command_loop(0,d06f1d74,d06f1d1c,d0337e33,6) at db_command_loop+0x8a
db_trap(6,0,d06f1d2c,d0340fb1,d05eae20) at db_trap+0x86
kdb_trap(6,0,d06f1d74,3f3f3f3f) at kdb_trap+0xab
trap() at trap+0xa9
--- trap (number 6) ---
ether_input(d0f8a040,3f3f3f3f,d69c4000,d69c4000,d69c4000) at
ether_input+0x3d
ether_input_mbuf(d0f8a040,d69c4000,1f96,d0f65000) at
ether_input_mbuf+0x23
fxp_intr(d0f8a000) at fxp_intr+0x1af
Xrecurse_legacy11() at Xrecurse_legacy11+0x8a
--- interrupt ---
apm_cpu_idle(b0,d05cce20,d05ccca0,7fffffff,d021ae5f) at
apm_cpu_idle+0x42
idle_loop(d067a280,28,0,0,80000000) at idle_loop+0x5
bpendtsleep(d05ccca0,4,d050e3d1,0,0,ffffffff,d04c73b2,0) at bpendtsleep
uvm_scheduler(d05ccc9c,3,0,d04c73b2,20000000) at uvm_scheduler+0x6b
check_console(0,0,0,0,0) at check_console
ddb> boot sync
rebooting...
-- END
l8rZ,
--
andrew - ICQ# 253198 - JID: [EMAIL PROTECTED]
Proud member: http://www.mad-techies.org
BOFH excuse of the day: SCSI's too wide.
