Hi all, I've been running some performance tests and not quite getting the results I was hoping for, and have a couple of related questions I was hoping someone could provide some tips with. For context, here's a summary of the results of TCP tests I've run on two VMs (CentOS 7 OpenStack instances, host-1 is the client and host-2 is the server):
* Running iperf3 natively before the interfaces are assigned to DPDK/VPP: *10 Gbps TCP throughput* * Running iperf3 with VCL/HostStack: *3.5 Gbps TCP throughput* * Running a modified version of the *tcp_echo* application (similar results with socket and svm api): *610 Mbps throughput* Things I've tried to improve performance: * Anything I could apply from https://wiki.fd.io/view/VPP/How_To_Optimize_Performance_(System_Tuning) * Added tcp { cc-algo cubic } to VPP startup config * Using isolcpu and VPP startup config options, allocated first 2, then 4 and finally 6 of the 8 available cores to VPP main & worker threads * In VPP startup config set "buffers-per-numa 65536" and "default data-size 4096" * Updated grub boot options to include hugepagesz=1GB hugepages=64 default_hugepagesz=1GB My goal is to achieve at least the same throughput using VPP as I get when I run iperf3 natively on the same network interfaces (in this case 10 Gbps). A couple of related questions: * Given the items above, do any VPP or kernel configuration items jump out that I may have missed that could justify the difference in native vs VPP performance or help get the two a bit closer? * In the modified tcp_echo application, *n_sent = app_send_stream(...)* is called in a loop always using the same length (1400 bytes) in my test version. The return value *n_sent* indicates that the average bytes sent is only around 130 bytes per call after some run time. Are there any parameters or options that might improve this? Any tips or pointers to documentation that might shed some light would be hugely appreciated! Regards, Dom
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#14772): https://lists.fd.io/g/vpp-dev/message/14772 Mute This Topic: https://lists.fd.io/mt/65863639/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
