Hello OpenBSD team,
We are facing an issue with OSPF related routes and would like to request your help as it seems to be a OSPF to FIB route replication issue. This happened already once in a different location, that one is running OpenBSD 6.3 and the site of the current report is OpenBSD 6.5 *Describing:* We have a setup with a FW cluster of 2 hosts talking OSPF to 2 Ubuntu boxes running Quagga. The 2 Ubuntu boxes run keepalived between them to install a secondary IP address on the interface, the service IP address. OSPF is configured to advertise this floating service IP and it's advertised only when it's available in the interface. OSPF is configured to not become DR/BDR in Ubuntu hosts *Initial state:* Service is active in ubuntu host A, everything working. root@fw1:~# ospfctl show nei ID Pri State DeadTime Address Iface Uptime (...) 10.10.53.28 1 FULL/OTHER 00:00:04 10.10.53.28 vlan1353 00:16:01 172.16.50.3 1 FULL/DR 00:00:04 10.10.53.27 vlan1353 03w2d10h 10.10.53.29 1 FULL/OTHER 00:00:04 10.10.53.29 vlan1353 00:04:38 *Facing the issue:* Ubuntu host A is shutdown, keepalived converges to host B and OSPF advertises the network, but service IP is unreachable. FW receives the correct update and we see the new nexthop correct in "ospfctl show rib", root@fw1:~# ospfctl show rib |grep 10.250.250.153 10.250.250.153/32 10.10.53.29 Intra-Area Network 110 00:03:10 root@fw1:~# however FIB still points to old nexthop, the 10.10.53.28. The new nexthop should end in .29. root@fw1:~# route -n get 10.250.250.153 route to: 10.250.250.153 destination: 10.250.250.153 mask: 255.255.255.255 gateway: 10.10.53.28 interface: vlan1353 if address: 10.10.53.26 priority: 32 (ospf) flags: <UP,GATEWAY,DONE,MPATH> use mtu expire 8298 0 0 root@fw1:~# in logs we see this message: Oct 10 07:41:53 fw1 ospfd[44713]: send_rtmsg: action 1, prefix 10.250.250.153/32: File exists Oct 10 07:42:03 fw1 ospfd[44713]: send_rtmsg: action 1, prefix 10.250.250.153/32: File exists This prefix is the service IP. *The FIX (manual):* To fix this we need to delete the route manually and since after deleting it doesn't get the new route automatically installed in FIB, we then reload the FIB. Sequence of commands: root@fw1:~# route -n show | grep 10.250.250 10.250.250.53/32 10.10.11.155 UG 0 510172 - 48 vlan1150 10.250.250.153/32 10.10.53.28 UGP 1 18861 - 32 vlan1353 10.250.250.153/32 10.10.11.155 UG 0 0 - 48 vlan1150 root@fw1:~# route del 10.250.250.153/32 10.10.53.28 del host 10.250.250.153/32: gateway 10.10.53.28 root@fw1:~# route -n show | grep 10.250.250 10.250.250.53/32 10.10.11.155 UG 0 510185 - 48 vlan1150 10.250.250.153/32 10.10.11.155 UG 0 1550 - 48 vlan1150 root@fw1:~# route -n show | grep 10.250.250 10.250.250.53/32 10.10.11.155 UG 0 510187 - 48 vlan1150 10.250.250.153/32 10.10.11.155 UG 0 3806 - 48 vlan1150 root@fw1:~# route -n show | grep 10.250.250 10.250.250.53/32 10.10.11.155 UG 0 510187 - 48 vlan1150 10.250.250.153/32 10.10.11.155 UG 0 4711 - 48 vlan1150 root@fw1:~# root@fw1:~# route -n show | grep 10.250.250 10.250.250.53/32 10.10.11.155 UG 0 510188 - 48 vlan1150 10.250.250.153/32 10.10.11.155 UG 0 7373 - 48 vlan1150 root@fw1:~# root@fw1:~# root@fw1:~# route -n show | grep 10.250.250 10.250.250.53/32 10.10.11.155 UG 0 510188 - 48 vlan1150 10.250.250.153/32 10.10.11.155 UG 0 8505 - 48 vlan1150 root@fw1:~# root@fw1:~# ospfctl fib reload reload request sent. root@fw1:~# root@fw1:~# route -n show | grep 10.250.250 10.250.250.53/32 10.10.11.155 UG 0 20 - 48 vlan1150 10.250.250.153/32 10.10.53.29 UG 0 106 - 32 vlan1353 10.250.250.153/32 10.10.11.155 UG 0 0 - 48 vlan1150 root@fw1:~# At this point service is restored, and the problem is not reproduce-able anymore. The difference I see is that the new route doesn't have the Multipath flag anymore. *Details about OpenBSD:* *dmesg.boot:* OpenBSD 6.5 (GENERIC.MP) #5: Thu Aug 29 20:38:30 CEST 2019 r...@syspatch-65-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP real mem = 16930836480 (16146MB) avail mem = 16408076288 (15647MB) mpath0 at root scsibus0 at mpath0: 256 targets mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.8 @ 0x7af09000 (59 entries) bios0: vendor Dell Inc. version "2.0.1" date 04/11/2016 bios0: Dell Inc. PowerEdge R430 acpi0 at bios0: rev 2 acpi0: sleep states S0 S5 acpi0: tables DSDT FACP MCEJ WD__ SLIC HPET APIC MCFG MSCT SLIT SRAT SSDT SSDT SSDT PRAD DMAR HEST BERT ERST EINJ acpi0: wakeup devices PCI0(S4) BR1A(S4) BR2A(S4) BR2C(S4) BR3A(S4) BR3C(S4) XHC_(S0) RP01(S4) RP02(S4) RP03(S4) RP04(S4) RP05(S4) RP08(S4) QRP0(S4) QR1A(S4) QR2A(S4) [...] acpitimer0 at acpi0: 3579545 Hz, 24 bits acpihpet0 at acpi0: 14318179 Hz acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1698.25 MHz, 06-4f-01 cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu0: 256KB 64b/line 8-way L2 cache cpu0: cannot disable silicon debug cpu0: smt 0, core 0, package 0 mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges cpu0: apic clock running at 99MHz cpu0: mwait min=64, max=64, C-substates=0.2.1.2, IBE cpu1 at mainbus0: apid 2 (application processor) cpu1: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1994.90 MHz, 06-4f-01 cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu1: 256KB 64b/line 8-way L2 cache cpu1: cannot disable silicon debug cpu1: smt 0, core 1, package 0 cpu2 at mainbus0: apid 4 (application processor) cpu2: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1996.05 MHz, 06-4f-01 cpu2: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu2: 256KB 64b/line 8-way L2 cache cpu2: cannot disable silicon debug cpu2: smt 0, core 2, package 0 cpu3 at mainbus0: apid 6 (application processor) cpu3: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1993.78 MHz, 06-4f-01 cpu3: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu3: 256KB 64b/line 8-way L2 cache cpu3: cannot disable silicon debug cpu3: smt 0, core 3, package 0 cpu4 at mainbus0: apid 8 (application processor) cpu4: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1995.83 MHz, 06-4f-01 cpu4: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu4: 256KB 64b/line 8-way L2 cache cpu4: cannot disable silicon debug cpu4: smt 0, core 4, package 0 cpu5 at mainbus0: apid 10 (application processor) cpu5: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1996.72 MHz, 06-4f-01 cpu5: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu5: 256KB 64b/line 8-way L2 cache cpu5: cannot disable silicon debug cpu5: smt 0, core 5, package 0 cpu6 at mainbus0: apid 12 (application processor) cpu6: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1996.18 MHz, 06-4f-01 cpu6: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu6: 256KB 64b/line 8-way L2 cache cpu6: cannot disable silicon debug cpu6: smt 0, core 6, package 0 cpu7 at mainbus0: apid 16 (application processor) cpu7: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1996.67 MHz, 06-4f-01 cpu7: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu7: 256KB 64b/line 8-way L2 cache cpu7: cannot disable silicon debug cpu7: smt 0, core 8, package 0 cpu8 at mainbus0: apid 18 (application processor) cpu8: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1995.10 MHz, 06-4f-01 cpu8: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu8: 256KB 64b/line 8-way L2 cache cpu8: cannot disable silicon debug cpu8: smt 0, core 9, package 0 cpu9 at mainbus0: apid 20 (application processor) cpu9: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1995.86 MHz, 06-4f-01 cpu9: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu9: 256KB 64b/line 8-way L2 cache cpu9: cannot disable silicon debug cpu9: smt 0, core 10, package 0 cpu10 at mainbus0: apid 22 (application processor) cpu10: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1994.39 MHz, 06-4f-01 cpu10: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu10: 256KB 64b/line 8-way L2 cache cpu10: cannot disable silicon debug cpu10: smt 0, core 11, package 0 cpu11 at mainbus0: apid 24 (application processor) cpu11: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1995.51 MHz, 06-4f-01 cpu11: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu11: 256KB 64b/line 8-way L2 cache cpu11: cannot disable silicon debug cpu11: smt 0, core 12, package 0 cpu12 at mainbus0: apid 26 (application processor) cpu12: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1996.08 MHz, 06-4f-01 cpu12: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu12: 256KB 64b/line 8-way L2 cache cpu12: cannot disable silicon debug cpu12: smt 0, core 13, package 0 cpu13 at mainbus0: apid 28 (application processor) cpu13: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1995.72 MHz, 06-4f-01 cpu13: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu13: 256KB 64b/line 8-way L2 cache cpu13: cannot disable silicon debug cpu13: smt 0, core 14, package 0 cpu14 at mainbus0: apid 1 (application processor) cpu14: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.69 MHz, 06-4f-01 cpu14: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu14: 256KB 64b/line 8-way L2 cache cpu14: cannot disable silicon debug cpu14: smt 1, core 0, package 0 cpu15 at mainbus0: apid 3 (application processor) cpu15: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.69 MHz, 06-4f-01 cpu15: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu15: 256KB 64b/line 8-way L2 cache cpu15: cannot disable silicon debug cpu15: smt 1, core 1, package 0 cpu16 at mainbus0: apid 5 (application processor) cpu16: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.68 MHz, 06-4f-01 cpu16: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu16: 256KB 64b/line 8-way L2 cache cpu16: cannot disable silicon debug cpu16: smt 1, core 2, package 0 cpu17 at mainbus0: apid 7 (application processor) cpu17: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.69 MHz, 06-4f-01 cpu17: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu17: 256KB 64b/line 8-way L2 cache cpu17: cannot disable silicon debug cpu17: smt 1, core 3, package 0 cpu18 at mainbus0: apid 9 (application processor) cpu18: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.69 MHz, 06-4f-01 cpu18: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu18: 256KB 64b/line 8-way L2 cache cpu18: cannot disable silicon debug cpu18: smt 1, core 4, package 0 cpu19 at mainbus0: apid 11 (application processor) cpu19: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.69 MHz, 06-4f-01 cpu19: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu19: 256KB 64b/line 8-way L2 cache cpu19: cannot disable silicon debug cpu19: smt 1, core 5, package 0 cpu20 at mainbus0: apid 13 (application processor) cpu20: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.69 MHz, 06-4f-01 cpu20: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu20: 256KB 64b/line 8-way L2 cache cpu20: cannot disable silicon debug cpu20: smt 1, core 6, package 0 cpu21 at mainbus0: apid 17 (application processor) cpu21: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.69 MHz, 06-4f-01 cpu21: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu21: 256KB 64b/line 8-way L2 cache cpu21: cannot disable silicon debug cpu21: smt 1, core 8, package 0 cpu22 at mainbus0: apid 19 (application processor) cpu22: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.69 MHz, 06-4f-01 cpu22: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu22: 256KB 64b/line 8-way L2 cache cpu22: cannot disable silicon debug cpu22: smt 1, core 9, package 0 cpu23 at mainbus0: apid 21 (application processor) cpu23: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.69 MHz, 06-4f-01 cpu23: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu23: 256KB 64b/line 8-way L2 cache cpu23: cannot disable silicon debug cpu23: smt 1, core 10, package 0 cpu24 at mainbus0: apid 23 (application processor) cpu24: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.69 MHz, 06-4f-01 cpu24: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu24: 256KB 64b/line 8-way L2 cache cpu24: cannot disable silicon debug cpu24: smt 1, core 11, package 0 cpu25 at mainbus0: apid 25 (application processor) cpu25: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.69 MHz, 06-4f-01 cpu25: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu25: 256KB 64b/line 8-way L2 cache cpu25: cannot disable silicon debug cpu25: smt 1, core 12, package 0 cpu26 at mainbus0: apid 27 (application processor) cpu26: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.69 MHz, 06-4f-01 cpu26: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu26: 256KB 64b/line 8-way L2 cache cpu26: cannot disable silicon debug cpu26: smt 1, core 13, package 0 cpu27 at mainbus0: apid 29 (application processor) cpu27: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz, 1997.69 MHz, 06-4f-01 cpu27: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,RDSEED,ADX,SMAP,PT,SENSOR,ARAT,XSAVEOPT,MELTDOWN cpu27: 256KB 64b/line 8-way L2 cache cpu27: cannot disable silicon debug cpu27: smt 1, core 14, package 0 ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins ioapic1 at mainbus0: apid 9 pa 0xfec01000, version 20, 24 pins acpimadt0: unknown apic structure type 7f acpimadt0: unknown apic structure type 7f acpimadt0: unknown apic structure type 7f acpimcfg0 at acpi0 acpimcfg0: addr 0x80000000, bus 0-255 acpiprt0 at acpi0: bus 255 (UNC0) acpiprt1 at acpi0: bus 0 (PCI0) acpiprt2 at acpi0: bus 1 (BR1A) acpiprt3 at acpi0: bus -1 (BR2A) acpiprt4 at acpi0: bus -1 (BR2C) acpiprt5 at acpi0: bus 4 (BR3A) acpiprt6 at acpi0: bus 5 (BR3C) acpiprt7 at acpi0: bus 6 (RP01) acpiprt8 at acpi0: bus 7 (RP02) acpiprt9 at acpi0: bus 2 (RP03) acpiprt10 at acpi0: bus 3 (RP04) acpiprt11 at acpi0: bus -1 (RP05) acpiprt12 at acpi0: bus -1 (RP08) acpiprt13 at acpi0: bus -1 (QRP0) acpiprt14 at acpi0: bus 1 (QR1A) acpiprt15 at acpi0: bus -1 (QR2A) acpiprt16 at acpi0: bus -1 (QR2C) acpiprt17 at acpi0: bus 4 (QR3A) acpiprt18 at acpi0: bus -1 (QR3B) acpiprt19 at acpi0: bus 5 (QR3C) acpiprt20 at acpi0: bus -1 (QR3D) acpicpu0 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu1 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu2 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu3 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu4 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu5 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu6 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu7 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu8 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu9 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu10 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu11 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu12 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu13 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu14 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu15 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu16 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu17 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu18 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu19 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu20 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu21 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu22 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu23 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu24 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu25 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu26 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpicpu27 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) acpipci0 at acpi0 UNC0: 0x00000010 0x00000011 0x00000000 "ACPI0004" at acpi0 not configured "PNP0C33" at acpi0 not configured "PNP0C14" at acpi0 not configured acpipci1 at acpi0 PCI0: 0x00000010 0x00000011 0x00000000 "PNP0003" at acpi0 not configured "PNP0C14" at acpi0 not configured acpicmos0 at acpi0 ipmi at mainbus0 not configured cpu0: using Broadwell MDS workaround pci0 at mainbus0 bus 0 pchb0 at pci0 dev 0 function 0 "Intel Xeon-D Host" rev 0x01 ppb0 at pci0 dev 1 function 0 "Intel Xeon-D PCIE" rev 0x01 pci1 at ppb0 bus 1 mfii0 at pci1 dev 0 function 0 "Symbios Logic MegaRAID SAS3008" rev 0x02: msi mfii0: "PERC H330 Mini", firmware 25.4.0.0017 scsibus1 at mfii0: 32 targets scsibus2 at mfii0: 256 targets sd0 at scsibus2 targ 0 lun 0: <ATA, INTEL SSDSC2BB12, DL2B> SCSI4 0/direct fixed naa.55cd2e404c7d1a24 sd0: 114473MB, 512 bytes/sector, 234441648 sectors, thin ppb1 at pci0 dev 3 function 0 "Intel Xeon-D PCIE" rev 0x01: msi pci2 at ppb1 bus 4 em0 at pci2 dev 0 function 0 "Intel I350" rev 0x01: msi, address a0:36:9f:a8:90:f8 em1 at pci2 dev 0 function 1 "Intel I350" rev 0x01: msi, address a0:36:9f:a8:90:f9 em2 at pci2 dev 0 function 2 "Intel I350" rev 0x01: msi, address a0:36:9f:a8:90:fa em3 at pci2 dev 0 function 3 "Intel I350" rev 0x01: msi, address a0:36:9f:a8:90:fb ppb2 at pci0 dev 3 function 2 "Intel Xeon-D PCIE" rev 0x01: msi pci3 at ppb2 bus 5 ix0 at pci3 dev 0 function 0 "Intel 82599" rev 0x01: msi, address 90:e2:ba:f1:c2:44 ix1 at pci3 dev 0 function 1 "Intel 82599" rev 0x01: msi, address 90:e2:ba:f1:c2:45 "Intel Xeon-D Address Map" rev 0x01 at pci0 dev 5 function 0 not configured "Intel Xeon-D Hot Plug" rev 0x01 at pci0 dev 5 function 1 not configured "Intel Xeon-D RAS" rev 0x01 at pci0 dev 5 function 2 not configured "Intel Xeon-D I/O APIC" rev 0x01 at pci0 dev 5 function 4 not configured "Intel C610 MS SPSR" rev 0x05 at pci0 dev 17 function 0 not configured ahci0 at pci0 dev 17 function 4 "Intel C610 AHCI" rev 0x05: msi, AHCI 1.3 scsibus3 at ahci0: 32 targets "Intel C610 MEI" rev 0x05 at pci0 dev 22 function 0 not configured "Intel C610 MEI" rev 0x05 at pci0 dev 22 function 1 not configured ehci0 at pci0 dev 26 function 0 "Intel C610 USB" rev 0x05: apic 8 int 18 usb0 at ehci0: USB revision 2.0 uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 addr 1 ppb3 at pci0 dev 28 function 0 "Intel C610 PCIE" rev 0xd5: msi pci4 at ppb3 bus 6 ppb4 at pci0 dev 28 function 1 "Intel C610 PCIE" rev 0xd5: msi pci5 at ppb4 bus 7 ppb5 at pci5 dev 0 function 0 "Renesas SH7758 PCIE Switch" rev 0x00 pci6 at ppb5 bus 8 ppb6 at pci6 dev 0 function 0 "Renesas SH7758 PCIE Switch" rev 0x00 pci7 at ppb6 bus 9 ppb7 at pci7 dev 0 function 0 "Renesas SH7758 PCIE-PCI" rev 0x00 pci8 at ppb7 bus 10 vga1 at pci8 dev 0 function 0 "Matrox MGA G200eR" rev 0x01 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) ppb8 at pci0 dev 28 function 2 "Intel C610 PCIE" rev 0xd5: msi pci9 at ppb8 bus 2 2:0:0: mem address conflict 0xfffc0000/0x40000 2:0:1: mem address conflict 0xfffc0000/0x40000 bge0 at pci9 dev 0 function 0 "Broadcom BCM5720" rev 0x00, BCM5720 A0 (0x5720000), APE firmware NCSI 1.3.16.0: msi, address 18:66:da:63:2c:19 brgphy0 at bge0 phy 1: BCM5720C 10/100/1000baseT PHY, rev. 0 bge1 at pci9 dev 0 function 1 "Broadcom BCM5720" rev 0x00, BCM5720 A0 (0x5720000), APE firmware NCSI 1.3.16.0: msi, address 18:66:da:63:2c:1a brgphy1 at bge1 phy 2: BCM5720C 10/100/1000baseT PHY, rev. 0 ppb9 at pci0 dev 28 function 3 "Intel C610 PCIE" rev 0xd5: msi pci10 at ppb9 bus 3 3:0:0: mem address conflict 0xfffc0000/0x40000 3:0:1: mem address conflict 0xfffc0000/0x40000 bge2 at pci10 dev 0 function 0 "Broadcom BCM5720" rev 0x00, BCM5720 A0 (0x5720000), APE firmware NCSI 1.3.16.0: msi, address 18:66:da:63:2c:1b brgphy2 at bge2 phy 1: BCM5720C 10/100/1000baseT PHY, rev. 0 bge3 at pci10 dev 0 function 1 "Broadcom BCM5720" rev 0x00, BCM5720 A0 (0x5720000), APE firmware NCSI 1.3.16.0: msi, address 18:66:da:63:2c:1c brgphy3 at bge3 phy 2: BCM5720C 10/100/1000baseT PHY, rev. 0 ehci1 at pci0 dev 29 function 0 "Intel C610 USB" rev 0x05: apic 8 int 18 usb1 at ehci1: USB revision 2.0 uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 addr 1 pcib0 at pci0 dev 31 function 0 "Intel C610 LPC" rev 0x05 ahci1 at pci0 dev 31 function 2 "Intel C610 AHCI" rev 0x05: msi, AHCI 1.3 scsibus4 at ahci1: 32 targets isa0 at pcib0 isadma0 at isa0 com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo com1: console pckbc0 at isa0 port 0x60/5 irq 1 irq 12 pcppi0 at isa0 port 0x61 spkr0 at pcppi0 pci11 at mainbus0 bus 255 "Intel Xeon-D QPI Link" rev 0x01 at pci11 dev 11 function 0 not configured "Intel Xeon-D QPI Link" rev 0x01 at pci11 dev 11 function 1 not configured "Intel Xeon-D QPI Link" rev 0x01 at pci11 dev 11 function 2 not configured "Intel Xeon-D QPI Debug" rev 0x01 at pci11 dev 11 function 3 not configured "Intel Xeon-D Cache" rev 0x01 at pci11 dev 12 function 0 not configured "Intel Xeon-D Cache" rev 0x01 at pci11 dev 12 function 1 not configured "Intel Xeon-D Cache" rev 0x01 at pci11 dev 12 function 2 not configured "Intel Xeon-D Cache" rev 0x01 at pci11 dev 12 function 3 not configured "Intel E5 v4 Cache" rev 0x01 at pci11 dev 12 function 4 not configured "Intel E5 v4 Cache" rev 0x01 at pci11 dev 12 function 5 not configured vendor "Intel", unknown product 0x6fe6 (class system subclass miscellaneous, rev 0x01) at pci11 dev 12 function 6 not configured vendor "Intel", unknown product 0x6fe7 (class system subclass miscellaneous, rev 0x01) at pci11 dev 12 function 7 not configured vendor "Intel", unknown product 0x6fe8 (class system subclass miscellaneous, rev 0x01) at pci11 dev 13 function 0 not configured vendor "Intel", unknown product 0x6fe9 (class system subclass miscellaneous, rev 0x01) at pci11 dev 13 function 1 not configured vendor "Intel", unknown product 0x6fea (class system subclass miscellaneous, rev 0x01) at pci11 dev 13 function 2 not configured vendor "Intel", unknown product 0x6feb (class system subclass miscellaneous, rev 0x01) at pci11 dev 13 function 3 not configured vendor "Intel", unknown product 0x6fec (class system subclass miscellaneous, rev 0x01) at pci11 dev 13 function 4 not configured vendor "Intel", unknown product 0x6fed (class system subclass miscellaneous, rev 0x01) at pci11 dev 13 function 5 not configured "Intel Xeon-D Cache" rev 0x01 at pci11 dev 15 function 0 not configured "Intel E5 v4 Cache" rev 0x01 at pci11 dev 15 function 1 not configured vendor "Intel", unknown product 0x6ffa (class system subclass miscellaneous, rev 0x01) at pci11 dev 15 function 2 not configured vendor "Intel", unknown product 0x6ffb (class system subclass miscellaneous, rev 0x01) at pci11 dev 15 function 3 not configured "Intel Xeon-D Cache" rev 0x01 at pci11 dev 15 function 4 not configured "Intel Xeon-D Cache" rev 0x01 at pci11 dev 15 function 5 not configured "Intel Xeon-D Cache" rev 0x01 at pci11 dev 15 function 6 not configured "Intel Xeon-D PCIE" rev 0x01 at pci11 dev 16 function 0 not configured "Intel E5 v4 R2PCIe Agent" rev 0x01 at pci11 dev 16 function 1 not configured "Intel Xeon-D Ubox" rev 0x01 at pci11 dev 16 function 5 not configured "Intel Xeon-D Ubox" rev 0x01 at pci11 dev 16 function 6 not configured "Intel Xeon-D Ubox" rev 0x01 at pci11 dev 16 function 7 not configured "Intel Xeon-D Home Agent" rev 0x01 at pci11 dev 18 function 0 not configured "Intel Xeon-D Home Agent" rev 0x01 at pci11 dev 18 function 1 not configured vendor "Intel", unknown product 0x6f70 (class system subclass miscellaneous, rev 0x01) at pci11 dev 18 function 2 not configured vendor "Intel", unknown product 0x6f60 (class system subclass miscellaneous, rev 0x01) at pci11 dev 18 function 4 not configured vendor "Intel", unknown product 0x6f38 (class DASP subclass Time and Frequency, rev 0x01) at pci11 dev 18 function 5 not configured vendor "Intel", unknown product 0x6f78 (class system subclass miscellaneous, rev 0x01) at pci11 dev 18 function 6 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 19 function 0 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 19 function 1 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 19 function 2 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 19 function 3 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 19 function 6 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 19 function 7 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 20 function 0 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 20 function 1 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 20 function 2 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 20 function 3 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 20 function 4 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 20 function 5 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 20 function 6 not configured "Intel Xeon-D Memory" rev 0x01 at pci11 dev 20 function 7 not configured "Intel E5 v4 RAS" rev 0x01 at pci11 dev 22 function 0 not configured vendor "Intel", unknown product 0x6f79 (class system subclass miscellaneous, rev 0x01) at pci11 dev 22 function 1 not configured vendor "Intel", unknown product 0x6f6a (class system subclass miscellaneous, rev 0x01) at pci11 dev 22 function 2 not configured vendor "Intel", unknown product 0x6f6b (class system subclass miscellaneous, rev 0x01) at pci11 dev 22 function 3 not configured "Intel E5 v4 DDRIO" rev 0x01 at pci11 dev 22 function 6 not configured "Intel E5 v4 DDRIO" rev 0x01 at pci11 dev 22 function 7 not configured "Intel E5 v4 Thermal" rev 0x01 at pci11 dev 23 function 0 not configured vendor "Intel", unknown product 0x6fd1 (class system subclass miscellaneous, rev 0x01) at pci11 dev 23 function 1 not configured vendor "Intel", unknown product 0x6fd2 (class system subclass miscellaneous, rev 0x01) at pci11 dev 23 function 2 not configured vendor "Intel", unknown product 0x6fd3 (class system subclass miscellaneous, rev 0x01) at pci11 dev 23 function 3 not configured "Intel E5 v4 DDRIO" rev 0x01 at pci11 dev 23 function 4 not configured "Intel E5 v4 DDRIO" rev 0x01 at pci11 dev 23 function 5 not configured "Intel E5 v4 DDRIO" rev 0x01 at pci11 dev 23 function 6 not configured "Intel E5 v4 DDRIO" rev 0x01 at pci11 dev 23 function 7 not configured "Intel Xeon-D PCU" rev 0x01 at pci11 dev 30 function 0 not configured "Intel Xeon-D PCU" rev 0x01 at pci11 dev 30 function 1 not configured "Intel Xeon-D PCU" rev 0x01 at pci11 dev 30 function 2 not configured "Intel Xeon-D PCU" rev 0x01 at pci11 dev 30 function 3 not configured "Intel Xeon-D PCU" rev 0x01 at pci11 dev 30 function 4 not configured "Intel Xeon-D PCU" rev 0x01 at pci11 dev 31 function 0 not configured "Intel Xeon-D PCU" rev 0x01 at pci11 dev 31 function 2 not configured vmm0 at mainbus0: VMX/EPT (using slow L1TF mitigation) uhub2 at uhub0 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev 2.00/0.05 addr 2 uhub3 at uhub2 port 6 configuration 1 interface 0 "no manufacturer Gadget USB HUB" rev 2.00/0.00 addr 3 umass0 at uhub3 port 4 configuration 1 interface 0 "Avocent Mass Storage Function" rev 2.00/0.00 addr 4 umass0: using SCSI over Bulk-Only scsibus5 at umass0: 2 targets, initiator 0 cd0 at scsibus5 targ 1 lun 0: <iDRAC, Virtual CD, 0329> SCSI0 5/cdrom removable sd1 at scsibus5 targ 1 lun 1: <iDRAC, Virtual Floppy, 0329> SCSI0 0/direct removable uhub4 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev 2.00/0.05 addr 2 vscsi0 at root scsibus6 at vscsi0: 256 targets softraid0 at root scsibus7 at softraid0: 256 targets cd0 detached sd1 detached scsibus5 detached umass0 detached root on sd0a (cf62ddf0c36e5d7e.a) swap on sd0b dump on sd0b umass0 at uhub3 port 4 configuration 1 interface 0 "Avocent Mass Storage Function" rev 2.00/0.00 addr 4 umass0: using SCSI over Bulk-Only scsibus5 at umass0: 2 targets, initiator 0 cd0 at scsibus5 targ 1 lun 0: <iDRAC, Virtual CD, 0329> SCSI0 5/cdrom removable sd1 at scsibus5 targ 1 lun 1: <iDRAC, Virtual Floppy, 0329> SCSI0 0/direct removable carp1353: state transition: BACKUP -> MASTER carp1650: state transition: BACKUP -> MASTER carp2004: state transition: BACKUP -> MASTER carp260: state transition: BACKUP -> MASTER carp261: state transition: BACKUP -> MASTER carp266: state transition: BACKUP -> MASTER carp267: state transition: BACKUP -> MASTER carp268: state transition: BACKUP -> MASTER carp269: state transition: BACKUP -> MASTER carp464: state transition: BACKUP -> MASTER *syspatch -l* 001_rip6cksum 002_srtp 003_mds 004_bgpd 005_libssl 006_tcpsack 007_smtpd 008_swapgs 009_resume 010_frag6ecn 011_expat *OSPF configuration* *FW1* router-id 172.16.50.2 redistribute static auth-type crypt auth-md 1 "***********" auth-md-keyid 1 hello-interval 1 router-dead-time 5 area 0.0.0.0 { interface lo1 { passive } interface vlan1150 { metric 1 } interface vlan1353 { metric 100 } interface vlan463 { metric 100 } interface carp464 { passive } interface carp1650 { passive } interface vlan2004 { passive } interface vlan364 { passive } } *FW2* router-id 172.16.50.3 redistribute static auth-type crypt auth-md 1 "**********" auth-md-keyid 1 hello-interval 1 router-dead-time 5 area 0.0.0.0 { interface lo1 { passive } interface vlan1150 { metric 1 } interface vlan1353 { metric 101 } interface vlan463 { metric 102 } interface carp464 { passive } interface carp1650 { passive } interface vlan2004 { passive metric 1000 } interface vlan364 { passive metric 1000 } } *Ubuntu Hosts:* *Host A* * * Current configuration: ! ! interface ens192 ip ospf authentication message-digest ip ospf dead-interval 5 ip ospf hello-interval 1 ip ospf message-digest-key 1 md5 ********** no link-detect ! interface lo ! router ospf ospf router-id 10.10.53.28 passive-interface default no passive-interface ens192 network 10.10.53.24/29 area 0.0.0.0 network 10.250.250.153/32 area 0.0.0.0 area 0.0.0.0 authentication message-digest ! line vty ! end ** *Host B* * * Current configuration: ! ! interface ens192 ip ospf authentication message-digest ip ospf dead-interval 5 ip ospf hello-interval 1 ip ospf message-digest-key 1 md5 ********* no link-detect ! interface lo ! router ospf ospf router-id 10.10.53.29 passive-interface default no passive-interface ens192 network 10.10.53.24/29 area 0.0.0.0 network 10.250.250.153/32 area 0.0.0.0 area 0.0.0.0 authentication message-digest ! line vty ! end ** * * Can you please provide us help with this issue ?* * Thank you. ** -- Best regards, João Alves