Hello aain, It seems my problem is related to STP. After rebooting a switch, VPC peer-link is disabled by spanning tree :
N3K-eqx-pa3-2(config)# show spanning-tree detail | inc Peer-link Port 8186 (port-channel4091, vPC Peer-link) of MST0000 is alternate blocking any reason to that ? I'm using version 7.0(3)I7(6) on both switches. Regards, Cédric Le mer. 9 oct. 2019 à 16:13, BASSAGET Cédric <[email protected]> a écrit : > Hello, > > I'm facing something I can't explain and I don't understand what is the > problem. I have a lab setup with two n3k switches and 2 linux hosts. If > somebody can tell me if there's something wrong with my setup, it would be > very helpfull. > > Here's my setup : > > on each n3k : > vpc domain 1, consistency OK, peer-link port-channel 4091, > keepalive-link port-channel 4090 > int eth1/13 = port-channel 13 = vpc 13 > int eth1/14 = port-channel 14 = vpc 14 > > on each linux host : iface bond1, mode 802.3ad > n3k-1 iface enp130s0f1 <-> n3k-1 eth1/13 > n3k-1 iface enp130s0f0 <-> n3k-2 eth1/13 > n3k-2 iface enp130s0f1 <-> n3k-1 eth1/14 > n3k-2 iface enp130s0f0 <-> n3k-2 eth1/14 > > test : ping linux1 (3c:fd:fe:a7:9c:58) -> linux2 (3c:fd:fe:10:02:a0) > > If I unplug one of the two n3k, everything continue to work as expected. > if I unplug n3k-1 eth1/13 : linux hosts can't see each other. > > ### before unplugging n3k-1 eth1/13 : > ################ n3k-1 : mac-address table vlan 40 : > + 40 3cfd.fe10.02a0 dynamic 0 F F Po14 > + 40 3cfd.fea7.9c58 dynamic 0 F F Po13 > > ################ n3k-2 : mac-address table vlan 40 : > + 40 3cfd.fe10.02a0 dynamic 0 F F Po14 > + 40 3cfd.fea7.9c58 dynamic 0 F F Po13 > > > ### after unplugging n3k-1 eth1/13 > ################ n3k-1 : sh mac-address table vlan 40 > + 40 3cfd.fe10.02a0 dynamic 0 F F Po14 > 40 3cfd.fea7.9c58 dynamic 0 F F Po4091 > ################ n3k-2 : sh mac-address table vlan 40 > + 40 3cfd.fe10.02a0 dynamic 0 F F Po14 > + 40 3cfd.fea7.9c58 dynamic 0 F F Po13 > > ICMP echo request : > linux1 (3c:fd:fe:a7:9c:58) -> n3k-2 eth1/13 -> n3k-2 eth1/14 -> linux2 > (3c:fd:fe:10:02:a0) > ICMP echo reply : > linux2 (3c:fd:fe:10:02:a0) -> n3k-1 eth1/14 -> ???? > > ICMP echo reply is sent on the interface which is still UP on n3k-1. I > guess n3k-1 sends it to n3k-2 via VPC peer-link (Po4091). Then I don't know > what happens, but ICMP reply is never received by linux1 host. > > ################################ > ################ Configs > ################################ > > ################ n3k-1 : > vpc domain 1 > peer-switch > role priority 32000 > peer-keepalive destination 10.10.10.2 source 10.10.10.1 vrf vpc_keepalive > delay restore 250 > auto-recovery reload-delay 300 > > interface port-channel4090 > no switchport > vrf member vpc_keepalive > ip address 10.10.10.1/30 > > interface port-channel4091 > switchport mode trunk > spanning-tree port type network > vpc peer-link > > > interface port-channel13 > switchport mode trunk > switchport trunk allowed vlan 40 > vpc 13 > > interface port-channel14 > switchport mode trunk > switchport trunk allowed vlan 40 > vpc 14 > > interface Ethernet1/13 > switchport mode trunk > switchport trunk allowed vlan 40 > channel-group 13 mode active > no shutdown > > interface Ethernet1/14 > switchport mode trunk > switchport trunk allowed vlan 40 > channel-group 14 mode active > no shutdown > > > ################ n3k-2 : > vpc domain 1 > peer-switch > role priority 33000 > peer-keepalive destination 10.10.10.1 source 10.10.10.2 vrf vpc_keepalive > delay restore 250 > auto-recovery reload-delay 300 > > interface port-channel4090 > no switchport > vrf member vpc_keepalive > ip address 10.10.10.2/30 > > interface port-channel4091 > switchport mode trunk > spanning-tree port type network > vpc peer-link > > > interface port-channel13 > switchport mode trunk > switchport trunk allowed vlan 40 > vpc 13 > > interface port-channel14 > switchport mode trunk > switchport trunk allowed vlan 40 > vpc 14 > > interface Ethernet1/13 > switchport mode trunk > switchport trunk allowed vlan 40 > channel-group 13 mode active > no shutdown > > interface Ethernet1/14 > switchport mode trunk > switchport trunk allowed vlan 40 > channel-group 14 mode active > no shutdown > > > ################ linux 1 & linux 2 : > > #cat /proc/net/bonding/bond1 > Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011) > > Bonding Mode: IEEE 802.3ad Dynamic link aggregation > Transmit Hash Policy: layer3+4 (1) > MII Status: up > MII Polling Interval (ms): 100 > Up Delay (ms): 0 > Down Delay (ms): 0 > > 802.3ad info > LACP rate: slow > Min links: 0 > Aggregator selection policy (ad_select): stable > System priority: 65535 > System MAC address: 3c:fd:fe:a7:9c:58 > Active Aggregator Info: > Aggregator ID: 2 > Number of ports: 2 > Actor Key: 15 > Partner Key: 32781 > Partner Mac Address: 00:23:04:ee:be:01 > > Slave Interface: enp130s0f0 > MII Status: up > Speed: 10000 Mbps > Duplex: full > Link Failure Count: 2 > Permanent HW addr: 3c:fd:fe:a7:9c:58 > Slave queue ID: 0 > Aggregator ID: 2 > Actor Churn State: none > Partner Churn State: none > Actor Churned Count: 0 > Partner Churned Count: 0 > details actor lacp pdu: > system priority: 65535 > system mac address: 3c:fd:fe:a7:9c:58 > port key: 15 > port priority: 255 > port number: 1 > port state: 61 > details partner lacp pdu: > system priority: 32667 > system mac address: 00:23:04:ee:be:01 > oper key: 32781 > port priority: 32768 > port number: 269 > port state: 61 > > Slave Interface: enp130s0f1 > MII Status: up > Speed: 10000 Mbps > Duplex: full > Link Failure Count: 16 > Permanent HW addr: 3c:fd:fe:a7:9c:59 > Slave queue ID: 0 > Aggregator ID: 2 > Actor Churn State: none > Partner Churn State: none > Actor Churned Count: 0 > Partner Churned Count: 0 > details actor lacp pdu: > system priority: 65535 > system mac address: 3c:fd:fe:a7:9c:58 > port key: 15 > port priority: 255 > port number: 2 > port state: 61 > details partner lacp pdu: > system priority: 32667 > system mac address: 00:23:04:ee:be:01 > oper key: 32781 > port priority: 32768 > port number: 16653 > port state: 61 > > ################ linux 1 : > # ifconfig bond1.40 > bond1.40: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 > inet x.x.x.x netmask 255.255.255.224 broadcast x.x.x.x > inet6 fe80::3efd:feff:fea7:9c58 prefixlen 64 scopeid 0x20<link> > ether 3c:fd:fe:a7:9c:58 txqueuelen 1000 (Ethernet) > > ################ linux 2 : > # ifconfig bond1.40 > bond1.40: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 > inet x.x.x.x netmask 255.255.255.224 broadcast x.x.x.x > inet6 fe80::3efd:feff:fe10:2a0 prefixlen 64 scopeid 0x20<link> > ether 3c:fd:fe:10:02:a0 txqueuelen 1000 (Ethernet) > > > Thanks for your help. > Regards, > Cédric > _______________________________________________ cisco-nsp mailing list [email protected] https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
