Dear @misc
We want to try use aggr pseudo LACP device.
We have a working setup with trunk interface:
oBSD: hostname.trunk0
trunkproto lacp trunkport oce0 trunkport oce1 172.20.253.11 netmask
255.255.255.255 description "xxxx"
trunk0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 9000
lladdr 28:80:23:e0:ab:40
description: C1 LACP
index 25 priority 0 llprio 3
trunk: trunkproto lacp
trunk id: [(8000,28:80:23:e0:ab:40,40CD,0000,0000),
(7F9B,00:23:04:ee:be:0a,8002,0000,0000)]
trunkport oce1 active,collecting,distributing
trunkport oce0 active,collecting,distributing
groups: trunk
media: Ethernet autoselect
status: active
inet 172.20.253.11 netmask 0xffffffff
Nexus 3K:
----------------
Cisco LACP|vPC config is very simple:
interface Ethernet1/2
description FW2-oce1
switchport mode trunk
channel-group 2 mode active
interface port-channel2
speed 10000
description FW2
switchport mode trunk
vpc 2
lacp rate normal
vPC domain id : 10
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : primary
Number of vPCs configured : 8
Peer Gateway : Disabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Auto-recovery status : Disabled
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ --------------------------------------------------
1 Po99 up 1-2,10,12-13,20,30,40,50-53,60,62,101
vPC status
----------------------------------------------------------------------------
id Port Status Consistency Reason Active vlans
------ ----------- ------ ----------- -------------------------- -----------
2 Po2 up success success 1-2,10,12-1
3,20,30,40,
50-53,60,62
,101
If we change trunk driver to aggr driver:
oBSD: hostname.aggr1
trunkport oce0 trunkport oce1 172.20.253.12 netmask 255.255.255.255
description ""
LACP is not working:
oce0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr fe:e1:ba:d0:cc:92
index 1 priority 0 llprio 3
trunk: trunkdev aggr1
media: Ethernet autoselect (10GbaseSR full-duplex,rxpause,txpause)
status: active
oce1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr fe:e1:ba:d0:cc:92
index 2 priority 0 llprio 3
trunk: trunkdev aggr1
media: Ethernet autoselect (10GbaseSR full-duplex,rxpause,txpause)
status: active
aggr1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> mtu 1500
lladdr fe:e1:ba:d0:cc:92
description: C1 LACP
index 7 priority 0 llprio 7
trunk: trunkproto lacp
trunk id: [(8000,fe:e1:ba:d0:cc:92,0007,0000,0000),
(0000,00:00:00:00:00:00,0000,0000,0000)]
oce0 lacp actor system pri 0x8000 mac fe:e1:ba:d0:cc:92, key
0x7, port pri 0x8000 number 0x1
oce0 lacp actor state activity,aggregation,defaulted
oce0 lacp partner system pri 0x0 mac 00:00:00:00:00:00, key
0x0, port pri 0x0 number 0x0
oce0 lacp partner state activity,sync
oce0 port
oce1 lacp actor system pri 0x8000 mac fe:e1:ba:d0:cc:92, key
0x7, port pri 0x8000 number 0x2
oce1 lacp actor state activity,aggregation,defaulted
oce1 lacp partner system pri 0x0 mac 00:00:00:00:00:00, key
0x0, port pri 0x0 number 0x0
oce1 lacp partner state activity,sync
oce1 port
groups: aggr
media: Ethernet autoselect
status: no carrier
inet 172.20.253.12 netmask 0xffffffff
N3K logs:
2019 Nov 14 15:28:16 s1b %ETHPORT-5-SPEED: Interface Ethernet1/2,
operational speed changed to 10 Gbps
2019 Nov 14 15:28:16 s1b %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/2,
operational duplex mode changed to Full
2019 Nov 14 15:28:16 s1b %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface
Ethernet1/2, operational Receive Flow Control state changed to off
2019 Nov 14 15:28:16 s1b %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface
Ethernet1/2, operational Transmit Flow Control state changed to off
2019 Nov 14 15:28:16 s1b %ETHPORT-5-SPEED: Interface port-channel1,
operational speed changed to 10 Gbps
2019 Nov 14 15:28:16 s1b %ETHPORT-5-IF_DUPLEX: Interface port-channel1,
operational duplex mode changed to Full
2019 Nov 14 15:28:16 s1b %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface
port-channel1, operational Receive Flow Control state changed to off
2019 Nov 14 15:28:16 s1b %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface
port-channel1, operational Transmit Flow Control state changed to off
2019 Nov 14 15:28:26 s1b %LACP-5-LACP_SUSPEND_INDIVIDUAL: LACP port
Ethernet1/2(0x1a000000) of port-channel port-channel1(0x16000000) not
receiving any LACP BPDUs suspending (individual) port
LACP interface status:
Interface Ethernet1/2 is individual
Channel group is 1 port channel is Po2
PDUs sent: 398962
PDUs rcvd: 381753
Markers sent: 0
Markers rcvd: 40
Marker response sent: 40
Marker response rcvd: 0
Unknown packets rcvd: 0
Illegal packets rcvd: 0
Lag Id: [ [(0, 0-0-0-0-0-0, 0, 0, 0), (0, 0-0-0-0-0-0, 0, 0, 0)] ]
Operational as aggregated link since Thu Nov 14 14:11:10 2019
Local Port: Eth1/2 MAC Address= 0-23-4-ee-be-a
System Identifier=0x8000,0-23-4-ee-be-a
Port Identifier=0x8000,0x101
Operational key=32769
LACP_Activity=active
LACP_Timeout=Long Timeout (30s)
Synchronization=IN_SYNC
Collecting=true
Distributing=true
Partner information refresh timeout=Long Timeout (90s)
Actor Admin State=(Ac-1:To-1:Ag-1:Sy-0:Co-0:Di-0:De-0:Ex-0)
Actor Oper State=(Ac-1:To-0:Ag-1:Sy-1:Co-1:Di-1:De-1:Ex-0)
Neighbor: 0x0
MAC Address= 0-0-0-0-0-0
System Identifier=0x0, Port Identifier=0x0,0x0
Operational key=0
LACP_Activity=unknown
LACP_Timeout=Long Timeout (30s)
Synchronization=NOT_IN_SYNC
Collecting=false
Distributing=false
Partner Admin State=(Ac-0:To-1:Ag-0:Sy-0:Co-0:Di-0:De-0:Ex-0)
Partner Oper State=(Ac-0:To-0:Ag-0:Sy-0:Co-0:Di-0:De-0:Ex-0)
Aggregate or Individual(True=1)= 1
If I try disable LACP BPDUs check on port channel interface:
no lacp suspend-individual
or enabe "lacp graceful-convergence".
still not working, if i removed aggr interface, and make new trunk
interface with LACP, it works great.
I dont know whats wrong :(
Anyone have any ideas?
--
Üdvözlettel,
Szél Gábor
WanTax Kft.
------------
tel.: +36 20 3838 171
fax: +36 82 357 585
email: gabor.s...@wantax.hu
web: http://wantax.hu
web: http://halozatom.hu