Re: [vpp-dev] vpp_echo UDP performance

2020-02-20 Thread Florin Coras
Hi Dom, That’s a really high vector rate. What cpu are you using? I’ve tried your config locally and I’m getting under 10Gbps with high rx drops. On the other hand, with vcl test client/server apps, after a bit of tweaking, I can saturate my 40Gbps nics with udpc (udp connection pinned to a t

Re: [vpp-dev] vpp_echo UDP performance

2020-02-20 Thread dchons via Lists.Fd.Io
Hi Florin, I'm not sure why the echo app was crashing on me yesterday, built the debug version, no crash, so I rebuilt the release version and also no crash. For some reason, even though udp-cksum now shows as an active rx offload, the function ip4_local_check_l4_csum is still being called, but

Re: [vpp-dev] vpp_echo UDP performance

2020-02-19 Thread Florin Coras
Hi Dom, Was about to suggest that you used this [1] but I see you already figured it up. Let me know what’s wrong with the echo app once you get a chance to debug it. Regards, Florin [1] https://gerrit.fd.io/r/c/vpp/+/25286 > On Feb 19, 2020, at 2:14 PM, dchons via Lists.Fd.Io > wrote: >

Re: [vpp-dev] vpp_echo UDP performance

2020-02-19 Thread dchons via Lists.Fd.Io
Hi again, For what it's worth, I added a hack in src/plugins/dpdk/device/init.c and set xd->port_conf.rxmode.offloads |= DEV_RX_OFFLOAD_UDP_CKSUM , and now I have: vpp# sh hardware-interfaces Name                Idx   Link  Hardware TenGigabitEthernet5/0/0            1    down  TenGigabitEtherne

Re: [vpp-dev] vpp_echo UDP performance

2020-02-19 Thread dchons via Lists.Fd.Io
Hi Florin, Thanks for the suggestion. It looks like in my case *ip4_local_l4_csum_validate* is being called: Breakpoint 1, ip4_local_l4_csum_validate (vm=0x7fffb4ecef40, p=0x10026d9980, ip=0x10026d9a8e, is_udp=1 '\001', error=0x7fffb517b1d8 "\016\023", good_tcp_udp=0x7fffb517b19d "\177\001\001

Re: [vpp-dev] vpp_echo UDP performance

2020-02-19 Thread Florin Coras
Hi Dom, Now that you mention it, it’s the same for my nics. Nonetheless, the packets that reach ip4-local are marked as having a valid l4 checksum. Check in ip4_local_check_l4_csum_x2 and ip4_local_check_l4_csum if ip4_local_l4_csum_validate is called or not. If not, there’s no extra overhead

Re: [vpp-dev] vpp_echo UDP performance

2020-02-19 Thread dchons via Lists.Fd.Io
[Edited Message Follows] ** Edit **: Corrected typo, udp-cksum not active in rx-offloads, but is active in tx-offloads Hi Florin, Thanks for the response. I'm not so concerned about the packet drops (as you point out it is to be expected), however increasing the number of rx descriptors did h

Re: [vpp-dev] vpp_echo UDP performance

2020-02-19 Thread dchons via Lists.Fd.Io
Hi Florin, Same NIC on both machines: root# dpdk-devbind --status Network devices using DPDK-compatible driver :05:00.0 'Ethernet 10G 2P X520 Adapter 154d' drv=uio_pci_generic unused=ixgbe -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages se

Re: [vpp-dev] vpp_echo UDP performance

2020-02-19 Thread Florin Coras
Hi Don, Inline. > On Feb 19, 2020, at 11:54 AM, dchons via Lists.Fd.Io > wrote: > > Hi Florin, > > Thanks for the response. I'm not so concerned about the packet drops (as you > point out it is to be expected), however increasing the number of rx > descriptors did help a lot, so thank you

Re: [vpp-dev] vpp_echo UDP performance

2020-02-19 Thread dchons via Lists.Fd.Io
Hi Florin, Thanks for the response. I'm not so concerned about the packet drops (as you point out it is to be expected), however increasing the number of rx descriptors did help a lot, so thank you very much for that! I'm still at around 6.5 Gbps, "sh session verbose" shows the following: *Clie

Re: [vpp-dev] vpp_echo UDP performance

2020-02-19 Thread Florin Coras
Hi Dom, UDP is without any flow/congestion control. That is, there is nothing to push back on the sender when it over drives the receiver. Increasing the number of rx descriptors probably helps a bit but unless the rx nic is faster, I don’t know if there’s anything else that could avoid the dr

[vpp-dev] vpp_echo UDP performance

2020-02-19 Thread dchons via Lists.Fd.Io
Hello, I've been trying to do some basic performance testing on 20.01 using the vpp_echo application, and while I'm getting the expected performance with TCP, I'm not quite able to achieve what I would expect with UDP. The NICs are 10G X520, and on TCP I get around 9.5 Gbps, but with UDP I get