Hi,
I'm currently experiencing what I would call a strange behavior (maybe a
total config fuck up on my side, who knows...).
I'm basically having 2 boxes acting as a CARP gateway for my servers.
Adressing:
- Box 1 (bge1): 46.21.116.1
- Box 2 (bge1): 46.21.116.2
- CARP116: 46.21.116.5
- CARP0: 213.215.29.254 (underlying interface is em1)
Problem: I can ping 46.21.116.5 either from the outside world or my
inside machines (even the machine not in carp master state), but not
from the carp master machine.
This sounds really odd to me since a nearly (bnx instead of bge +
different IP addresses) identical setup is not exhibiting this behavior.
carp0 doesn't exhibit this strange behavior (IE: I can ping
213.215.29.254 from the master box).
I either missed something obvious or...need to stop drugs...
Please note this behavior is consistent between 5.4 and 5.5-snapshot
from Jan 24th 2014.
Do any of you have a clue about this issue ?
Thanks
$ ping -c10 46.21.116.5
PING 46.21.116.5 (46.21.116.5): 56 data bytes
--- 46.21.116.5 ping statistics ---
10 packets transmitted, 0 packets received, 100.0% packet loss
$ bgpctl show fib 46.21.116.5
flags: * = valid, B = BGP, C = Connected, S = Static
N = BGP Nexthop reachable via this route
r = reject route, b = blackhole route
flags prio destination gateway
* 0 46.21.116.5/32 46.21.116.5
$ cat /etc/hostname.bge1
inet 46.21.116.1 255.255.255.240
inet6 2a02:27d0:116::1 112
$ cat /etc/hostname.carp116
inet 46.21.116.5 255.255.255.240 46.21.116.15 vhid 116 carpdev bge1 pass
XXXXXXXXXX advbase 1 advskew 0
inet6 2a02:27d0:116::5 112 vhid 116 carpdev bge1 pass XXXXXXXXXX advbase 1
advskew 0
$ cat /etc/hostname.carp0
inet 213.215.29.254 255.255.254.0 213.215.29.255 vhid 1 carpdev em1 pass
YYYYYYYY advbase 1 advskew 0
inet6 2a02:27d0:0:ffff::100 64 vhid 1 carpdev em1 pass YYYYYYYY advbase 1
advskew 0
$ netstat -rn | grep '^46.21.116.5'
46.21.116.5 46.21.116.5 UH 0 15 - 4 carp116
$ netstat -rn | grep '^213.215.29'
213.215.29.254 213.215.29.254 UH 0 0 - 4 carp0
$ ping -qc10 213.215.29.254
PING 213.215.29.254 (213.215.29.254): 56 data bytes
--- 213.215.29.254 ping statistics ---
10 packets transmitted, 10 packets received, 0.0% packet loss
round-trip min/avg/max/std-dev = 0.015/0.023/0.067/0.015 ms
$ ifconfig bge1
bge1: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu
1500
lladdr 00:24:e8:58:49:64
priority: 0
media: Ethernet autoselect (1000baseT full-duplex,rxpause,txpause)
status: active
inet 46.21.116.1 netmask 0xfffffff0 broadcast 46.21.116.15
inet6 fe80::224:e8ff:fe58:4964%bge1 prefixlen 64 scopeid 0x6
inet6 2a02:27d0:116::1 prefixlen 112
$ ifconfig carp116
carp116: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr 00:00:5e:00:01:74
priority: 0
carp: MASTER carpdev bge1 vhid 116 advbase 1 advskew 0
groups: carp
status: master
inet6 fe80::200:5eff:fe00:174%carp116 prefixlen 64 scopeid 0xb
inet 46.21.116.5 netmask 0xfffffff0 broadcast 46.21.116.15
inet6 2a02:27d0:116::5 prefixlen 112
$ ifconfig em1
em1: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu
1500
lladdr 00:15:17:be:d0:4c
priority: 0
media: Ethernet autoselect (1000baseT full-duplex,rxpause,txpause)
status: active
inet 213.215.28.1 netmask 0xfffffe00 broadcast 213.215.29.255
inet6 fe80::215:17ff:febe:d04c%em1 prefixlen 64 scopeid 0x2
inet6 2a02:27d0:0:ffff::1 prefixlen 64
$ ifconfig carp0
carp0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr 00:00:5e:00:01:01
priority: 0
carp: MASTER carpdev em1 vhid 1 advbase 1 advskew 0
groups: carp
status: master
inet6 fe80::200:5eff:fe00:101%carp0 prefixlen 64 scopeid 0xa
inet 213.215.29.254 netmask 0xfffffe00 broadcast 213.215.29.255
inet6 2a02:27d0:0:ffff::100 prefixlen 64
$ dmesg
OpenBSD 5.5-beta (GENERIC.MP) #279: Fri Jan 24 11:50:37 MST 2014
t...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 4272553984 (4074MB)
avail mem = 4150603776 (3958MB)
warning: no entropy supplied by boot loader
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0xcfb9c000 (55 entries)
bios0: vendor Dell Inc. version "1.3.0" date 08/15/2008
bios0: Dell Inc. PowerEdge R300
acpi0 at bios0: rev 2
acpi0: sleep states S0 S4 S5
acpi0: tables DSDT FACP APIC SPCR HPET MCFG WD__ SLIC ERST HEST BERT EINJ TCPA
acpi0: wakeup devices PCI0(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU L5410 @ 2.33GHz, 2333.66 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG,LAHF,PERF
cpu0: 6MB 64b/line 16-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 333MHz
cpu0: mwait min=64, max=64, C-substates=0.2.2.2.0, IBE
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Xeon(R) CPU L5410 @ 2.33GHz, 2333.34 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG,LAHF,PERF
cpu1: 6MB 64b/line 16-way L2 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 2 (application processor)
cpu2: Intel(R) Xeon(R) CPU L5410 @ 2.33GHz, 2333.34 MHz
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG,LAHF,PERF
cpu2: 6MB 64b/line 16-way L2 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 3 (application processor)
cpu3: Intel(R) Xeon(R) CPU L5410 @ 2.33GHz, 2333.34 MHz
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG,LAHF,PERF
cpu3: 6MB 64b/line 16-way L2 cache
cpu3: smt 0, core 3, package 0
ioapic0 at mainbus0: apid 4 pa 0xfec00000, version 20, 24 pins
ioapic0: misconfigured as apic 0, remapped to apid 4
acpihpet0 at acpi0: 14318179 Hz
acpimcfg0 at acpi0 addr 0xe0000000, bus 0-255
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 5 (PEX4)
acpiprt2 at acpi0: bus 7 (PEX6)
acpiprt3 at acpi0: bus 1 (SBE4)
acpiprt4 at acpi0: bus 2 (SBE5)
acpiprt5 at acpi0: bus 13 (COMP)
acpicpu0 at acpi0: C3
acpicpu1 at acpi0: C3
acpicpu2 at acpi0: C3
acpicpu3 at acpi0: C3
ipmi at mainbus0 not configured
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel 5100 Host" rev 0x90
ppb0 at pci0 dev 2 function 0 "Intel 5100 PCIE" rev 0x90
pci1 at ppb0 bus 3
ppb1 at pci0 dev 3 function 0 "Intel 5100 PCIE" rev 0x90
pci2 at ppb1 bus 4
ppb2 at pci0 dev 4 function 0 "Intel 5100 PCIE" rev 0x90: msi
pci3 at ppb2 bus 5
mpi0 at pci3 dev 0 function 0 "Symbios Logic SAS1068E" rev 0x08: msi
scsibus0 at mpi0: 112 targets
sd0 at scsibus0 targ 0 lun 0: <Dell, VIRTUAL DISK, 1028> SCSI3 0/direct fixed
naa.600508e00000000035576d6421b0ad04
sd0: 152064MB, 512 bytes/sector, 311427072 sectors
ses0 at scsibus0 targ 8 lun 0: <DP, BACKPLANE, 1.05> SCSI3 13/enclosure
services fixed t10.DP_BACKPLANE000000
ppb3 at pci0 dev 5 function 0 "Intel 5100 PCIE" rev 0x90
pci4 at ppb3 bus 6
ppb4 at pci0 dev 6 function 0 "Intel 5100 PCIE" rev 0x90: msi
pci5 at ppb4 bus 7
ppb5 at pci5 dev 0 function 0 "IDT 89HPES12N3A" rev 0x0e
pci6 at ppb5 bus 8
ppb6 at pci6 dev 2 function 0 "IDT 89HPES12N3A" rev 0x0e
pci7 at ppb6 bus 9
em0 at pci7 dev 0 function 0 "Intel 82571EB" rev 0x06: apic 4 int 19, address
00:15:17:be:d0:4d
em1 at pci7 dev 0 function 1 "Intel 82571EB" rev 0x06: apic 4 int 18, address
00:15:17:be:d0:4c
ppb7 at pci6 dev 4 function 0 "IDT 89HPES12N3A" rev 0x0e
pci8 at ppb7 bus 10
em2 at pci8 dev 0 function 0 "Intel 82571EB" rev 0x06: apic 4 int 17, address
00:15:17:be:d0:4f
em3 at pci8 dev 0 function 1 "Intel 82571EB" rev 0x06: apic 4 int 16, address
00:15:17:be:d0:4e
ppb8 at pci0 dev 7 function 0 "Intel 5100 PCIE" rev 0x90
pci9 at ppb8 bus 11
pchb1 at pci0 dev 16 function 0 "Intel 5100 FSB" rev 0x90
pchb2 at pci0 dev 16 function 1 "Intel 5100 FSB" rev 0x90
pchb3 at pci0 dev 16 function 2 "Intel 5100 FSB" rev 0x90
pchb4 at pci0 dev 17 function 0 "Intel 5100 Reserved" rev 0x90
pchb5 at pci0 dev 19 function 0 "Intel 5100 Reserved" rev 0x90
pchb6 at pci0 dev 21 function 0 "Intel 5100 DDR" rev 0x90
pchb7 at pci0 dev 22 function 0 "Intel 5100 DDR" rev 0x90
ppb9 at pci0 dev 28 function 0 "Intel 82801I PCIE" rev 0x02
pci10 at ppb9 bus 12
ppb10 at pci0 dev 28 function 4 "Intel 82801I PCIE" rev 0x02
pci11 at ppb10 bus 1
bge0 at pci11 dev 0 function 0 "Broadcom BCM5722" rev 0x00, BCM5755 C0
(0xa200): msi, address 00:24:e8:58:49:63
brgphy0 at bge0 phy 1: BCM5722 10/100/1000baseT PHY, rev. 0
ppb11 at pci0 dev 28 function 5 "Intel 82801I PCIE" rev 0x02
pci12 at ppb11 bus 2
bge1 at pci12 dev 0 function 0 "Broadcom BCM5722" rev 0x00, BCM5755 C0
(0xa200): msi, address 00:24:e8:58:49:64
brgphy1 at bge1 phy 1: BCM5722 10/100/1000baseT PHY, rev. 0
uhci0 at pci0 dev 29 function 0 "Intel 82801I USB" rev 0x02: apic 4 int 21
uhci1 at pci0 dev 29 function 1 "Intel 82801I USB" rev 0x02: apic 4 int 20
uhci2 at pci0 dev 29 function 2 "Intel 82801I USB" rev 0x02: apic 4 int 21
ehci0 at pci0 dev 29 function 7 "Intel 82801I USB" rev 0x02: apic 4 int 21
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb12 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x92
pci13 at ppb12 bus 13
radeondrm0 at pci13 dev 7 function 0 "ATI ES1000" rev 0x02
drm0 at radeondrm0
radeondrm0: apic 4 int 19
pcib0 at pci0 dev 31 function 0 "Intel 82801IR LPC" rev 0x02
pciide0 at pci0 dev 31 function 2 "Intel 82801I SATA" rev 0x02: DMA, channel 0
configured to native-PCI, channel 1 configured to native-PCI
pciide0: using apic 4 int 23 for native-PCI interrupt
atapiscsi0 at pciide0 channel 0 drive 1
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <TEAC, DVD-ROM DV28SV, D.0J> ATAPI 5/cdrom
removable
cd0(pciide0:0:1): using PIO mode 4, Ultra-DMA mode 5
pciide1 at pci0 dev 31 function 5 "Intel 82801I SATA" rev 0x02: DMA, channel 0
wired to native-PCI, channel 1 wired to native-PCI
pciide1: using apic 4 int 22 for native-PCI interrupt
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
uhub4 at uhub0 port 1 "Dell product 0xa001" rev 2.00/0.00 addr 2
uhidev0 at uhub4 port 1 configuration 1 interface 0 "Dell DRAC5" rev 1.10/0.00
addr 3
uhidev0: iclass 3/1
ukbd0 at uhidev0: 8 variable keys, 6 key codes
wskbd1 at ukbd0 mux 1
uhidev1 at uhub4 port 1 configuration 1 interface 1 "Dell DRAC5" rev 1.10/0.00
addr 3
uhidev1: iclass 3/1
ums0 at uhidev1: 3 buttons, Z dir
wsmouse0 at ums0 mux 0
uhub5 at uhub0 port 5 "Cypress Semiconductor USB2 Hub" rev 2.00/90.15 addr 4
uhidev2 at uhub2 port 1 configuration 1 interface 0 "Avocent USB DSRIQ" rev
1.10/1.00 addr 2
uhidev2: iclass 3/1
ukbd1 at uhidev2: 8 variable keys, 6 key codes, country code 8
wskbd2 at ukbd1 mux 1
uhidev3 at uhub2 port 1 configuration 1 interface 1 "Avocent USB DSRIQ" rev
1.10/1.00 addr 2
uhidev3: iclass 3/1, 3 report ids
ums1 at uhidev3 reportid 1: 5 buttons, Z dir
wsmouse1 at ums1 mux 0
uhid0 at uhidev3 reportid 2: input=2, output=0, feature=0
uhid1 at uhidev3 reportid 3: input=1, output=0, feature=0
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 256 targets
root on sd0a swap on sd0b dump on sd0b
drm: initializing kernel modesetting (RV100 0x1002:0x515E 0x1028:0x020F).
radeondrm0: VRAM: 128M 0x00000000D0000000 - 0x00000000D7FFFFFF (32M used)
radeondrm0: GTT: 512M 0x00000000B0000000 - 0x00000000CFFFFFFF
ttm_pool_mm_shrink_init stub
drm: PCI GART of 512M enabled (table at 0x0000000008C51000).
error: [drm:pid0:r100_cp_init_microcode] *ERROR* radeon_cp: Failed to load
firmware "radeon-r100_cp"
error: [drm:pid0:r100_cp_init] *ERROR* Failed to load firmware!
error: [drm:pid0:r100_startup] *ERROR* failed initializing CP (-2).
error: [drm:pid0:r100_init] *ERROR* Disabling GPU acceleration
drm: radeon: cp finalized
radeondrm0: 1024x768
wsdisplay0 at radeondrm0 mux 1: console (std, vt100 emulation), using wskbd0
wskbd1: connecting to wsdisplay0
wskbd2: connecting to wsdisplay0
wsdisplay0: screen 1-5 added (std, vt100 emulation)
carp0: state transition: BACKUP -> MASTER
carp116: state transition: BACKUP -> MASTER
