Hi Matthew, Thank you very much for your detailed response!
I saw the aesni drivers exclusion from the dpdk.mk file, but I feel it that was done in purpose and in the same time I was confused by the "dpdk/cryptodev [warn ]: dpdk_cryptodev_init: Not enough cryptodev resources" warning. I switched between different crypto engines by disabling the rest of the plugins from the startup.conf file to have a single one available on a time. Sure, I am using multiples threads (workers) and multiples queues. One of the best achieved performance was to go with 8 workers and 4 queues (I have 2 interfaces) so the worker distribution is looking like this: vpp# show interface rx-placement Thread 1 (vpp_wk_0): node dpdk-input: lan queue 0 (polling) Thread 2 (vpp_wk_1): lan queue 1 (polling) Thread 3 (vpp_wk_2): lan queue 2 (polling) Thread 4 (vpp_wk_3): lan queue 3 (polling) Thread 5 (vpp_wk_4): wan queue 0 (polling) Thread 6 (vpp_wk_5): wan queue 1 (polling) Thread 7 (vpp_wk_6): wan queue 2 (polling) Thread 8 (vpp_wk_7): wan queue 3 (polling) I was using a single IPSec tunnel, after reading this: https://lfnetworking.org/how-fd-io-20-01-release-improves-multicore-ipsec/ which one, btw, reading now one more time, after the ipsec experience and your explanation, it makes more sense to me. By creating multiples IPSec tunnels and using async mode I was able to increase the throughput for large packet sizes, going close to 20Gbps for 8900 bytes per packet. I am using routed IPSec and, for a single IPSec tunnle I am avoiding fragmentation by setting the right MTU on the sender VM interface. I will do a test for fragmentation case in the future, thank you for the tip. Best regards, Gabi
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21509): https://lists.fd.io/g/vpp-dev/message/21509 Mute This Topic: https://lists.fd.io/mt/91520137/21656 Mute #dpdk:https://lists.fd.io/g/vpp-dev/mutehashtag/dpdk Mute #ipsec:https://lists.fd.io/g/vpp-dev/mutehashtag/ipsec Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
