Hi Damjan, Absolutely. I raw one case with the default number of NAT workers (10) which has poor performance, and another case with a fewer number of NAT workers (4) showing great performance. They're separated by two different files, both are attached.
John
vpp# sh run Thread 0 vpp_main (lcore 1) Time 20.7, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks api-rx-from-ring any wait 0 0 1 1.13e4 0.00 cdp-process any wait 0 0 2 6.32e3 0.00 dpdk-process any wait 0 0 7 6.07e6 0.00 fib-walk any wait 0 0 10 5.81e3 0.00 ikev2-manager-process any wait 0 0 21 4.66e3 0.00 ip4-reassembly-expire-walk any wait 0 0 2 6.61e3 0.00 ip6-icmp-neighbor-discovery-ev any wait 0 0 21 4.11e3 0.00 ip6-reassembly-expire-walk any wait 0 0 2 6.16e3 0.00 lisp-retry-service any wait 0 0 10 6.29e3 0.00 statseg-collector-process time wait 0 0 2 5.39e3 0.00 unix-cli-local:1 active 0 0 7 3.20e6 0.00 unix-epoll-input polling 46896 0 0 1.64e6 0.00 vpe-oam-process any wait 0 0 10 5.05e3 0.00 --------------- Thread 1 vpp_wk_0 (lcore 2) Time 20.7, average vectors/node 1.01, last 128 main loops 0.00 per node 0.00 vector rates in 8.1284e4, out 1.1746e5, drop 4.3071e1, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks HundredGigabitEthernet65/0/1-o active 747464 747591 0 1.43e2 1.00 HundredGigabitEthernet65/0/1-t active 747464 747591 0 4.00e2 1.00 HundredGigabitEthernetb3/0/1-o active 1675943 1679595 0 1.47e2 1.00 HundredGigabitEthernetb3/0/1-t active 1675943 1679595 0 2.24e2 1.00 dpdk-input polling 116041927 1679595 0 2.46e4 .01 error-drop active 890 890 0 4.26e2 1.00 ethernet-input active 1675943 1679595 0 2.78e2 1.00 ip4-icmp-echo-request active 1 1 0 3.23e3 1.00 ip4-icmp-input active 1 1 0 9.34e2 1.00 ip4-input-no-checksum active 1675942 1679594 0 2.44e2 1.00 ip4-load-balance active 2394167 2427187 0 1.24e2 1.01 ip4-local active 1 1 0 3.31e3 1.00 ip4-lookup active 2394166 2427186 0 2.08e2 1.01 ip4-rewrite active 2394166 2427186 0 1.90e2 1.01 lldp-input active 1 1 0 3.08e3 1.00 nat44-in2out active 1675942 1679594 0 3.09e2 1.00 nat44-in2out-worker-handoff active 1675942 1679594 0 2.56e2 1.00 nat44-out2in active 748354 748481 0 6.37e2 1.00 --------------- Thread 2 vpp_wk_1 (lcore 3) Time 20.7, average vectors/node 1.00, last 128 main loops 0.00 per node 0.00 vector rates in 3.6237e4, out 0.0000e0, drop 5.7589e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks arp-input active 6 6 0 7.54e3 1.00 dpdk-input polling 135842540 748775 0 5.87e4 0.00 error-drop active 119 119 0 3.71e2 1.00 ethernet-input active 748642 748775 0 2.48e2 1.00 ip4-input-no-checksum active 748636 748768 0 2.43e2 1.00 lldp-input active 1 1 0 3.54e3 1.00 nat44-out2in active 112 112 0 6.99e2 1.00 nat44-out2in-worker-handoff active 748636 748768 0 6.45e2 1.00 --------------- Thread 3 vpp_wk_2 (lcore 4) Time 20.7, average vectors/node 1.02, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 5.0331e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks error-drop active 100 104 0 6.29e3 1.04 nat44-out2in active 104 104 0 2.99e4 1.00 unix-epoll-input polling 38989 0 0 1.66e6 0.00 --------------- Thread 4 vpp_wk_3 (lcore 5) Time 20.7, average vectors/node 1.10, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 4.8395e-2, drop 3.3876e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks HundredGigabitEthernetb3/0/1-o active 1 1 0 1.90e3 1.00 HundredGigabitEthernetb3/0/1-t active 1 1 0 6.62e3 1.00 error-drop active 56 70 0 3.89e3 1.25 ip4-icmp-echo-request active 1 1 0 2.93e3 1.00 ip4-icmp-input active 1 1 0 1.91e3 1.00 ip4-load-balance active 2 2 0 1.65e3 1.00 ip4-local active 1 1 0 5.13e3 1.00 ip4-lookup active 1 1 0 5.03e3 1.00 ip4-rewrite active 1 1 0 2.58e3 1.00 nat44-out2in active 71 71 0 2.53e4 1.00 unix-epoll-input polling 31127 0 0 1.52e6 0.00 --------------- Thread 5 vpp_wk_4 (lcore 6) Time 20.7, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks unix-epoll-input polling 31091 0 0 1.53e6 0.00 --------------- Thread 6 vpp_wk_5 (lcore 7) Time 20.7, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks unix-epoll-input polling 31060 0 0 1.66e6 0.00 --------------- Thread 7 vpp_wk_6 (lcore 8) Time 20.7, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks unix-epoll-input polling 29206 0 0 1.62e6 0.00 --------------- Thread 8 vpp_wk_7 (lcore 9) Time 20.7, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks unix-epoll-input polling 46129 0 0 1.40e6 0.00 --------------- Thread 9 vpp_wk_8 (lcore 10) Time 20.7, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks unix-epoll-input polling 18237 0 0 1.65e6 0.00 --------------- Thread 10 vpp_wk_9 (lcore 11) Time 20.7, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks unix-epoll-input polling 23525 0 0 1.65e6 0.00
vpp# show run Thread 0 vpp_main (lcore 1) Time 16.1, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks api-rx-from-ring any wait 0 0 1 1.05e4 0.00 cdp-process any wait 0 0 1 6.69e3 0.00 dhcp-client-process any wait 0 0 1 2.62e3 0.00 dpdk-process any wait 0 0 6 6.77e6 0.00 fib-walk any wait 0 0 8 5.55e3 0.00 ikev2-manager-process any wait 0 0 16 3.22e3 0.00 ip-route-resolver-process any wait 0 0 1 2.26e3 0.00 ip4-reassembly-expire-walk any wait 0 0 1 4.66e3 0.00 ip6-icmp-neighbor-discovery-ev any wait 0 0 16 3.34e3 0.00 ip6-reassembly-expire-walk any wait 0 0 1 6.44e3 0.00 lisp-retry-service any wait 0 0 8 6.06e3 0.00 statseg-collector-process time wait 0 0 1 5.88e3 0.00 unix-cli-local:1 active 0 0 9 2.59e6 0.00 unix-epoll-input polling 33172 0 0 1.59e6 0.00 vpe-oam-process any wait 0 0 8 3.88e3 0.00 --------------- Thread 1 vpp_wk_0 (lcore 2) Time 16.1, average vectors/node 1.00, last 128 main loops 0.00 per node 0.00 vector rates in 2.8266e3, out 0.0000e0, drop 1.7100e1, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks arp-input active 10 10 0 4.18e3 1.00 dpdk-input polling 101685246 45455 0 7.74e5 0.00 error-drop active 275 275 0 4.84e2 1.00 ethernet-input active 45378 45455 0 2.64e2 1.00 ip4-input-no-checksum active 45368 45445 0 2.54e2 1.00 nat44-in2out-worker-handoff active 45368 45445 0 3.26e2 1.00 nat44-out2in active 265 265 0 7.88e2 1.00 --------------- Thread 2 vpp_wk_1 (lcore 3) Time 16.1, average vectors/node 1.00, last 128 main loops 0.00 per node 0.00 vector rates in 1.1827e2, out 6.2183e-2, drop 9.8249e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks HundredGigabitEthernetb3/0/1-o active 1 1 0 9.38e2 1.00 HundredGigabitEthernetb3/0/1-t active 1 1 0 1.23e3 1.00 arp-input active 12 12 0 3.99e3 1.00 dpdk-input polling 101765784 1902 0 1.85e7 0.00 error-drop active 158 158 0 2.89e2 1.00 ethernet-input active 1901 1902 0 2.93e2 1.00 ip4-icmp-echo-request active 1 1 0 2.15e3 1.00 ip4-icmp-input active 1 1 0 1.75e3 1.00 ip4-input-no-checksum active 1889 1890 0 3.42e2 1.00 ip4-load-balance active 2 2 0 1.05e3 1.00 ip4-local active 1 1 0 4.09e3 1.00 ip4-lookup active 1 1 0 2.68e3 1.00 ip4-rewrite active 1 1 0 1.00e3 1.00 nat44-out2in active 147 147 0 3.69e2 1.00 nat44-out2in-worker-handoff active 1889 1890 0 5.45e2 1.00 --------------- Thread 3 vpp_wk_2 (lcore 4) Time 16.1, average vectors/node 1.05, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 3.7932e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks error-drop active 55 61 0 5.40e3 1.11 nat44-out2in active 61 61 0 2.63e4 1.00 unix-epoll-input polling 30059 0 0 1.43e6 0.00 --------------- Thread 4 vpp_wk_3 (lcore 5) Time 16.1, average vectors/node 1.01, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 2.6117e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks error-drop active 41 42 0 5.81e3 1.02 nat44-out2in active 42 42 0 2.85e4 1.00 unix-epoll-input polling 24492 0 0 1.58e6 0.00 --------------- Thread 5 vpp_wk_4 (lcore 6) Time 16.1, average vectors/node 1.20, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 2.9848e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks error-drop active 32 48 0 5.59e3 1.50 nat44-out2in active 48 48 0 1.94e4 1.00 unix-epoll-input polling 27076 0 0 1.59e6 0.00 --------------- Thread 6 vpp_wk_5 (lcore 7) Time 16.1, average vectors/node 1.00, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 1.6168e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks error-drop active 26 26 0 7.12e3 1.00 nat44-out2in active 26 26 0 2.86e4 1.00 unix-epoll-input polling 35848 0 0 1.44e6 0.00 --------------- Thread 7 vpp_wk_6 (lcore 8) Time 16.1, average vectors/node 1.00, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 9.3275e-1, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks error-drop active 15 15 0 7.36e3 1.00 nat44-out2in active 15 15 0 3.04e4 1.00 unix-epoll-input polling 29956 0 0 1.44e6 0.00 --------------- Thread 8 vpp_wk_7 (lcore 9) Time 16.1, average vectors/node 1.11, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 2.4252e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks error-drop active 31 39 0 4.43e3 1.26 nat44-out2in active 39 39 0 2.54e4 1.00 unix-epoll-input polling 24437 0 0 1.59e6 0.00 --------------- Thread 9 vpp_wk_8 (lcore 10) Time 16.1, average vectors/node 4.37, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 2.8963e3, drop 4.6638e0, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks HundredGigabitEthernet65/0/1-o active 950 1164 0 9.69e2 1.23 HundredGigabitEthernet65/0/1-t active 950 1164 0 2.59e3 1.23 HundredGigabitEthernetb3/0/1-o active 950 45412 0 3.48e1 47.80 HundredGigabitEthernetb3/0/1-t active 950 45412 0 1.43e2 47.80 error-drop active 33 75 0 1.39e3 2.27 ip4-load-balance active 1588 46576 0 4.22e1 29.33 ip4-lookup active 1588 46576 0 1.14e2 29.33 ip4-rewrite active 1588 46576 0 8.73e1 29.33 nat44-in2out active 45335 45412 0 1.57e3 1.00 nat44-in2out-slowpath active 4 6 0 1.68e4 1.50 nat44-out2in active 1238 1239 0 1.52e4 1.00 unix-epoll-input polling 19152 0 0 1.57e6 0.00 --------------- Thread 10 vpp_wk_9 (lcore 11) Time 16.1, average vectors/node 1.00, last 128 main loops 0.00 per node 0.00 vector rates in 0.0000e0, out 0.0000e0, drop 4.3528e-1, punt 0.0000e0 Name State Calls Vectors Suspends Clocks Vectors/Call Perf Ticks error-drop active 7 7 0 4.12e3 1.00 nat44-out2in active 7 7 0 3.62e4 1.00 unix-epoll-input polling 21897 0 0 1.38e6 0.00
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#11744): https://lists.fd.io/g/vpp-dev/message/11744 Mute This Topic: https://lists.fd.io/mt/28802889/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-