Hi Dom, That’s a really high vector rate. What cpu are you using?
I’ve tried your config locally and I’m getting under 10Gbps with high rx drops. On the other hand, with vcl test client/server apps, after a bit of tweaking, I can saturate my 40Gbps nics with udpc (udp connection pinned to a thread). On the server side rx-miss was 8854 server: ./vcl_server 1234 -p udpc client: ./vcl_client -p udpc 6.0.1.1 1234 -U -N 1000000 -T 32768 Remember to first ensure that arp tables are populated (with ping from cli) to avoid dropping the first udp packet. Also, in my testing I pin the vcl apps to cores on the same numa as vpp’s workers and the nics using taskset. It could be that the echo apps need a bit of optimization. Regards, Florin > On Feb 20, 2020, at 8:31 AM, dchons via Lists.Fd.Io > <dchons=akouto....@lists.fd.io> wrote: > > Hi Florin, > > I'm not sure why the echo app was crashing on me yesterday, built the debug > version, no crash, so I rebuilt the release version and also no crash. For > some reason, even though udp-cksum now shows as an active rx offload, the > function ip4_local_check_l4_csum is still being called, but I added a return > statement right at the top to see how much overhead it really introduces, and > it didn't really make a difference, so I'm thinking that is not the > bottleneck. > > Do you think the rx-miss counter shown below is relevant, and if so, any tips > on what that suggests? > > vpp# sh interface > > Name Idx State MTU (L3/IP4/IP6/MPLS) > Counter Count > TenGigabitEthernet5/0/0 1 up 9000/0/0/0 rx > packets 35702325 > rx bytes > 42584946555 > drops > 122 > ip4 > 35702203 > rx-miss > 16959304 > > vpp# sh runtime > Thread 1 vpp_wk_0 (lcore 22) > Time 90.3, 10 sec internal node vector rate 0.00 > vector rates in 3.9519e5, out 0.0000e0, drop 4.7598e-1, punt 0.0000e0 > Name State Calls Vectors > Suspends Clocks Vectors/Call > dpdk-input polling 129415453 35702246 > 0 6.94e2 .28 > drop active 43 43 > 0 1.82e3 1.00 > error-drop active 43 43 > 0 1.47e3 1.00 > ethernet-input active 148777 35702246 > 0 1.93e1 239.97 > ip4-input-no-checksum active 148767 35702203 > 0 3.15e1 239.99 > ip4-local active 148767 35702203 > 0 5.03e2 239.99 > ip4-lookup active 148767 35702203 > 0 4.19e1 239.99 > ip4-udp-lookup active 148767 35702203 > 0 4.34e1 239.99 > llc-input active 41 41 > 0 1.45e3 1.00 > lldp-input active 2 2 > 0 1.73e4 1.00 > session-queue polling 100382138 0 > 0 2.82e2 0.00 > udp4-input active 148767 35702203 > 0 4.01e3 239.99 > unix-epoll-input polling 126267 0 > 0 1.04e4 0.00 > > Thanks! > Dom >
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#15479): https://lists.fd.io/g/vpp-dev/message/15479 Mute This Topic: https://lists.fd.io/mt/71401293/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
