Hello All, In *19.08** VPP version* we are seeing a crash while accessing the *load_balance_pool* in *load_balanc_get*() function. This is happening after *enabling worker threads*. As such the FIB programming is happening in the main thread and in one of the worker threads we see this crash. Also, this is seen when we *scale to 300K+ ipv4 routes.*
Here is the complete stack, Thread 10 "vpp_wk_0" received signal SIGSEGV, Segmentation fault. [Switching to Thread 0x7fbe4aa8e700 (LWP 333)] 0x00007fbef10636f8 in clib_bitmap_get (ai=0x1313131313131313, i=61) at /home/ubuntu/Scale/libvpp/src/vppinfra/bitmap.h:201 201 return i0 < vec_len (ai) && 0 != ((ai[i0] >> i1) & 1); Thread 10 (Thread 0x7fbe4aa8e700 (LWP 333)): #0 0x00007fbef10636f8 in clib_bitmap_get (ai=0x1313131313131313, i=61) at /home/ubuntu/Scale/libvpp/src/vppinfra/bitmap.h:201 #1 0x00007fbef10676a8 in load_balance_get (lbi=61) at /home/ubuntu/Scale/libvpp/src/vnet/dpo/load_balance.h:222 #2 0x00007fbef106890c in ip4_lookup_inline (vm=0x7fbe8a5aa080, node=0x7fbe8b3fd380, frame=0x7fbe8a5edb40) at /home/ubuntu/Scale/libvpp/src/vnet/ip/ip4_forward.h:369 #3 0x00007fbef1068ead in ip4_lookup_node_fn_avx2 (vm=0x7fbe8a5aa080, node=0x7fbe8b3fd380, frame=0x7fbe8a5edb40) at /home/ubuntu/Scale/libvpp/src/vnet/ip/ip4_forward.c:95 #4 0x00007fbef0c6afec in dispatch_node (vm=0x7fbe8a5aa080, node=0x7fbe8b3fd380, type=VLIB_NODE_TYPE_INTERNAL, dispatch_state=VLIB_NODE_STATE_POLLING, frame=0x7fbe8a5edb40, last_time_stamp=381215594286358) at /home/ubuntu/Scale/libvpp/src/vlib/main.c:1207 #5 0x00007fbef0c6b7ad in dispatch_pending_node (vm=0x7fbe8a5aa080, pending_frame_index=2, last_time_stamp=381215594286358) at /home/ubuntu/Scale/libvpp/src/vlib/main.c:1375 #6 0x00007fbef0c6d3f0 in vlib_main_or_worker_loop (vm=0x7fbe8a5aa080, is_main=0) at /home/ubuntu/Scale/libvpp/src/vlib/main.c:1826 #7 0x00007fbef0c6dc73 in vlib_worker_loop (vm=0x7fbe8a5aa080) at /home/ubuntu/Scale/libvpp/src/vlib/main.c:1934 #8 0x00007fbef0cac791 in vlib_worker_thread_fn (arg=0x7fbe8de2a340) at /home/ubuntu/Scale/libvpp/src/vlib/threads.c:1754 #9 0x00007fbef092da48 in clib_calljmp () from /home/ubuntu/Scale/libvpp/build-root/install-vpp_debug-native/vpp/lib/libvppinfra.so.1.0.1 #10 0x00007fbe4aa8dec0 in ?? () #11 0x00007fbef0ca700c in vlib_worker_thread_bootstrap_fn (arg=0x7fbe8de2a340) at /home/ubuntu/Scale/libvpp/src/vlib/threads.c:573 Thanks in Advance, Rajith
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#16617): https://lists.fd.io/g/vpp-dev/message/16617 Mute This Topic: https://lists.fd.io/mt/74627827/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-