The backtrace ends up in the Mellanox DPDK driver, so the bug is most probably in DPDK. The fact that (2) works but not (1) might hint towards a race condition / timing issue.
ben > -----Original Message----- > From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of chetan bhasin > Sent: lundi 2 mars 2020 07:53 > To: vpp-dev <vpp-dev@lists.fd.io> > Subject: [vpp-dev] Facing issue while bringing up vpp 19.08 with Bonding > configuration and Mellanox nics > > Hello Everyone, > > We are trying to bring-up stable/vpp1908 with bonded configuration > 1) its getting crash in case we mention > "startup-config /root/vanilla_1908/vpp/vpp.conf" , > 2)if we bring up vpp first and then apply configuration using exec command > , it works fine > "exec /root/vanilla_1908/vpp/vpp.conf" > > Note - point (1) mentioned above is working fine with stable/vpp2001. > There is dpdk version difference as well between stable/vpp1908(dpdk > 19.05) vs stable/vpp2001 (dpdk 19.08) > > Can anybody please suggest an area in vpp we can look into or there could > be bug in dpdk 19.05 resolved in dpdk19.08. > > Configuration :(vpp.conf) > create bond mode active-backup > bond add BondEthernet0 TwentyFiveGigabitEthernet5d/0/0 > bond add BondEthernet0 TwentyFiveGigabitEthernet5d/0/1 > set interface state BondEthernet0 up > create sub-interfaces BondEthernet0 811 > set interface tag BondEthernet0.811 vbond10.811 > set interface state BondEthernet0.811 up > set interface ip address BondEthernet0.811 192.168.10.11/24 > <http://192.168.10.11/24> > create sub-interfaces BondEthernet0 812 > set interface tag BondEthernet0.812 vbond10.812 > set interface state BondEthernet0.812 up > set interface ip address BondEthernet0.812 192.168.20.11/24 > <http://192.168.20.11/24> > ip route add 16.0.0.0/8 <http://16.0.0.0/8> via 192.168.10.1 > ip route add 48.0.0.0/8 <http://48.0.0.0/8> via 192.168.20.1 > set interface state TwentyFiveGigabitEthernet5d/0/0 up > set interface state TwentyFiveGigabitEthernet5d/0/1 up > > > VPP CLI's > vpp# show hardware-interfaces > > BondEthernet0 3 up BondEthernet0 > Link speed: unknown > Ethernet address b8:83:03:8b:ef:44 > TwentyFiveGigabitEthernet5d/0/0 1 up > TwentyFiveGigabitEthernet5d/0/0 > Link speed: 25 Gbps > Ethernet address b8:83:03:8b:ef:44 > Mellanox ConnectX-4 Family > carrier up full duplex mtu 9206 > flags: admin-up pmd rx-ip4-cksum > rx: queues 4 (max 65535), desc 1024 (min 0 max 65535 align 1) > tx: queues 4 (max 65535), desc 4096 (min 0 max 65535 align 1) > TwentyFiveGigabitEthernet5d/0/1 2 up > TwentyFiveGigabitEthernet5d/0/1 > Link speed: 25 Gbps > Ethernet address b8:83:03:8b:ef:44 > Mellanox ConnectX-4 Family > carrier up full duplex mtu 9206 > flags: admin-up pmd rx-ip4-cksum > rx: queues 4 (max 65535), desc 1024 (min 0 max 65535 align 1) > tx: queues 4 (max 65535), desc 4096 (min 0 max 65535 align 1) > pci: device 15b3:1015 subsystem 1590:00d3 address 0000:5d:00.01 numa 0 > max rx packet len: 65536 > > > > Back-trace looks like as below > #0 mlx5_read_dev_counters (dev=dev@entry=0x7f71ebf50940 > <rte_eth_devices>, stats=stats@entry=0x1fffc3518) > at /nfs-bfs/workspace/gkeown/integra/mainline/ngp/mainline/third- > party/vpp/vanilla_1908/build-root/build-vpp-native/external/dpdk- > 19.05/drivers/net/mlx5/mlx5_stats.c:186 > #1 0x00007f71eae756b4 in mlx5_stats_init (dev=dev@entry=0x7f71ebf50940 > <rte_eth_devices>) > at /nfs-bfs/workspace/gkeown/integra/mainline/ngp/mainline/third- > party/vpp/vanilla_1908/build-root/build-vpp-native/external/dpdk- > 19.05/drivers/net/mlx5/mlx5_stats.c:309 > #2 0x00007f71eae70b27 in mlx5_dev_start (dev=0x7f71ebf50940 > <rte_eth_devices>) > at /nfs-bfs/workspace/gkeown/integra/mainline/ngp/mainline/third- > party/vpp/vanilla_1908/build-root/build-vpp-native/external/dpdk- > 19.05/drivers/net/mlx5/mlx5_trigger.c:178 > #3 0x00007f71eabc8e18 in rte_eth_dev_start (port_id=0) > at /nfs-bfs/workspace/gkeown/integra/mainline/ngp/mainline/third- > party/vpp/vanilla_1908/build-root/build-vpp-native/external/dpdk- > 19.05/lib/librte_ethdev/rte_ethdev.c:1429 > #4 0x00007f71eb74fffd in dpdk_device_start (xd=xd@entry=0x7f71ef09fb80) > at /nfs-bfs/workspace/gkeown/integra/mainline/ngp/mainline/third- > party/vpp/vanilla_1908/src/plugins/dpdk/device/common.c:168 > #5 0x00007f71eb7555c8 in dpdk_interface_admin_up_down (vnm=<optimized > out>, hw_if_index=<optimized out>, flags=<optimized out>) > at /nfs-bfs/workspace/gkeown/integra/mainline/ngp/mainline/third- > party/vpp/vanilla_1908/src/plugins/dpdk/device/device.c:427 > #6 0x00007f72f196d9c8 in vnet_sw_interface_set_flags_helper > (vnm=vnm@entry=0x7f72f2191f20 <vnet_main>, sw_if_index=<optimized out>, > flags=VNET_SW_INTERFACE_FLAG_ADMIN_UP, helper_flags=(unknown: 0), > helper_flags@entry=VNET_INTERFACE_SET_FLAGS_HELPER_WANT_REDISTRIBUTE) > at /nfs-bfs/workspace/gkeown/integra/mainline/ngp/mainline/third- > party/vpp/vanilla_1908/src/vnet/interface.c:455 > #7 0x00007f72f196f10d in vnet_sw_interface_set_flags > (vnm=vnm@entry=0x7f72f2191f20 <vnet_main>, sw_if_index=<optimized out>, > flags=<optimized out>) > at /nfs-bfs/workspace/gkeown/integra/mainline/ngp/mainline/third- > party/vpp/vanilla_1908/src/vnet/interface.c:504 > #8 0x00007f72f197ecca in set_state (vm=<optimized out>, > input=0x7f71f141bed0, cmd=<optimized out>) > at /nfs-bfs/workspace/gkeown/integra/mainline/ngp/mainline/third- > party/vpp/vanilla_1908/src/vnet/interface_cli.c:902 > #9 0x00007f72f1014f4e in vlib_cli_dispatch_sub_commands > (vm=vm@entry=0x7f72f1299300 <vlib_global_main>, > cm=cm@entry=0x7f72f1299530 <vlib_global_main+560>, > input=input@entry=0x7f71f141bed0, parent_command_index=<optimized out>) > at /nfs-bfs/workspace/gkeown/integra/mainline/ngp/mainline/third- > party/vpp/vanilla_1908/src/vlib/cli.c:649 > #10 0x00007f72f1015764 in vlib_cli_dispatch_sub_commands > (vm=vm@entry=0x7f72f1299300 <vlib_global_main>, > cm=cm@entry=0x7f72f1299530 <vlib_global_main+560>, > input=input@entry=0x7f71f141bed0, parent_command_index=<optimized out>) > at /nfs-bfs/workspace/gkeown/integra/mainline/ngp/mainline/third- > party/vpp/vanilla_1908/src/vlib/cli.c:609 > #11 0x00007f72f1015764 in vlib_cli_dispatch_sub_commands > (vm=vm@entry=0x7f72f1299300 <vlib_global_main>, > > Thanks, > Chetan >
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#15642): https://lists.fd.io/g/vpp-dev/message/15642 Mute This Topic: https://lists.fd.io/mt/71668712/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-