Hi All,
FD.io CSIT-2001 report has been published on FD.io docs site:
https://docs.fd.io/csit/rls2001/report/
Many thanks to All in CSIT, VPP and wider FD.io community who
contributed and worked hard to make CSIT-2001 happen!
Below three summaries:
- Intel Xeon 2n-skx, 3n-skx and 2n-clx Testbeds microcode issue.
- CSIT-2001 Release Summary, a high-level summary.
- Points of Note in CSIT-2001 Report, with specific links to report.
Welcome all comments, best by email to csit-...@lists.fd.io.
Cheers,
-Maciek
------------------------------------------------------------------------
NOTE: Intel Xeon 2n-skx, 3n-skx and 2n-clx Testbeds microcode issue.
------------------------------------------------------------------------
VPP and DPDK performance test data is not included in this report
version. This is due to the lower performance and behaviour
inconsistency of these systems following the upgrade of processor
microcode packages (skx ucode 0x2000064, clx ucode 0x500002c), done
as part of updating Ubuntu 18.04 LTS kernel version. Tested VPP and
DPDK applications (L3fwd) are affected. Skx and Clx test data will
be added in subsequent maintenance report version(s) once the issue
is resolved. See https://jira.fd.io/browse/CSIT-1675.
------------------------------------------------------------------------
CSIT-2001 Release Summary
------------------------------------------------------------------------
1. CSIT-2001 Report
- html link: https://docs.fd.io/csit/rls2001/report/
- pdf link:
https://docs.fd.io/csit/rls2001/report/_static/archive/csit_rls2001.pdf
2. New Tests
- NFV density tests with IPsec encryption between DUTs.
- Full test coverage for VPP AVF driver for Fortville NICs.
- VPP Hoststack TCP/IP tests with wrk, iperf3 with LDPreload tests
without and with packet loss via VPP NSIM plugin), and QUIC/UDP/IP
transport tests.
- Mellanox ConnectX5-2p100GE NICs in 2n-clx testbeds using VPP native
rdma driver.
- Load Balancer tests.
3. Benchmarking
- Fully onboarded new Intel Xeon Cascadelake Testbeds with x710,
xxv710 and mcx556a-edat NIC cards.
- Added new High Dynamic Range Histogram latency measurements.
4. Infrastructure
- Full migration of CSIT from Python2.7 to Python3.6.
------------------------------------------------------------------------
Points of Note in the CSIT-2001 Report
------------------------------------------------------------------------
Indexed specific links listed at the bottom.
1. VPP release notes
a. Changes in CSIT-2001: [1]
b. Known issues: [2]
2. VPP performance - 64B/IMIX throughput graphs (selected NIC models):
a. Graphs explained: [3]
b. L2 Ethernet Switching: [4]
c. IPv4 Routing: [5]
d. IPv6 Routing: [6]
e. SRv6 Routing: [7]
f. IPv4 Tunnels: [8]
g. KVM VMs vhost-user: [9]
h. LXC/DRC Container Memif: [10]
e. IPsec IPv4 Routing: [11]
f. Virtual Topology System: [12]
3. VPP performance - multi-core and latency graphs:
a. Speedup Multi-Core: [13]
b. Latency: [14]
4. VPP performance comparisons
a. VPP-20.01 vs. VPP-19.08: [15]
5. VPP performance test details - all NICs:
a. Detailed results 64B IMIX 1518B 9kB: [16]
b. Configuration: [17]
DPDK Testpmd and L3fwd performance sections follow similar structure.
6. DPDK applications:
a. Release notes: [18]
b. DPDK performance - 64B throughput graphs: [19]
c. DPDK performance - latency graphs: [20]
d. DPDK performance - DPDK-19.08 vs. DPDK-19.05: [21]
Functional tests, including VPP_Device (functional device tests),
VPP_VIRL and HoneyComb are all included in the report.
Specific links within the report:
[1]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/csit_release_notes.html#changes-in-csit-release
[2]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/csit_release_notes.html#known-issues
[3]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/index.html
[4]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/l2.html
[5]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/ip4.html
[6]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/ip6.html
[7]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/srv6.html
[8]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/ip4_tunnels.html
[9]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/vm_vhost.html
[10]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/container_memif.html
[11]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/ipsec.html
[12]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/vts.html
[13]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/throughput_speedup_multi_core/index.html
[14]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_latency/index.html
[15]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/comparisons/current_vs_previous_release.html
[16]
https://docs.fd.io/csit/rls2001/report/detailed_test_results/vpp_performance_results/index.html
[17]
https://docs.fd.io/csit/rls2001/report/test_configuration/vpp_performance_configuration/index.html
[18]
https://docs.fd.io/csit/rls2001/report/dpdk_performance_tests/csit_release_notes.html
[19]
https://docs.fd.io/csit/rls2001/report/dpdk_performance_tests/packet_throughput_graphs/index.html
[20]
https://docs.fd.io/csit/rls2001/report/dpdk_performance_tests/packet_latency/index.html
[21]
https://docs.fd.io/csit/rls2001/report/dpdk_performance_tests/comparisons/current_vs_previous_release.html
------------------------------------------------------------------------
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#15401): https://lists.fd.io/g/vpp-dev/message/15401
Mute This Topic: https://lists.fd.io/mt/71271235/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
