There was a joint workgroup to compare 3 different benchmarking tool on the system under test used by VSPERF that is running an OVS-DPDK vswitch. The 3 tools were: VSPERF, NFVbench, External tool by Redhat The goal was to:
* See how different tools differ in their results when measuring the exact same system under test * Verify that NFVbench and other external tool can run on a new system with just a vswitch and no openstack The conclusion is that * all 3 tools could run and measure the performance of the same system and produce similar results when test conditions are aligned properly. * Significant differences can be measured if test conditions differ even slightly (e.g. number of flows) * NFVbench and the external tool can measure a non-openstack bafe bone vswitch The new section looks good otherwise. Thanks, Alec From: <[email protected]> on behalf of David McBride <[email protected]> Date: Wednesday, August 29, 2018 at 12:04 PM To: "[email protected]" <[email protected]>, Mingjiang Li <[email protected]>, "MORTON, ALFRED C (AL)" <[email protected]>, Georg Kunz <[email protected]>, "Foley, Emma L" <[email protected]> Cc: TECH-DISCUSS OPNFV <[email protected]>, Amar Kapadia <[email protected]>, "[email protected]" <[email protected]>, Heather Kirksey <[email protected]>, Lincoln Lavoie <[email protected]> Subject: Re: [opnfv-tech-discuss] [plugfest][fraser] review of OPNFV plugfest report (part of joint ETSI/OPNFV report) Team, We need your input on this document once again. A new section titled "Joint Testing Activities" has now been integrated. If you would, please take a few moments to review and provide feedback on just that section. To repeat, we only need feedback on the section titled "Joint Testing Activities". Please complete your review by Sept 7, 5 p.m. (PT). Let me know if you have any questions. Thank you. David On Fri, Jul 6, 2018 at 5:19 PM David McBride <[email protected]<mailto:[email protected]>> wrote: Team, Thanks for agreeing to review the OPNFV plugfest portion<https://docs.google.com/document/d/17xSPe7BTOq2LMa-qHLiBfnOSo6JXhvqxjriMZUKhcrI/edit?usp=sharing> of the joint ETSI/OPNFV report. Your feedback is invaluable in ensuring that the document is accurate, comprehensive, and useful for our community. We will be accepting comments from now until July 20. Note that this material that you will be reviewing is part of a larger, joint report between OPNFV and ETSI. This joint report will also include a section, currently in development, on OPNFV and ETSI collaboration during the plugtest/plugfest in June. I will alert you when that section becomes available, so that you may review it, as well. Finally, I'd like to thank Amar for his hard work documenting plugfest activities, and developing and editing the document. Please let me know if you have any questions. David -- David McBride Release Manager, OPNFV Mobile: +1.805.276.8018 Email/Google Talk: [email protected]<mailto:[email protected]> Skype: davidjmcbride1 IRC: dmcbride -- David McBride Release Manager, OPNFV Mobile: +1.805.276.8018 Email/Google Talk: [email protected]<mailto:[email protected]> Skype: davidjmcbride1 IRC: dmcbride -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21889): https://lists.opnfv.org/g/opnfv-tech-discuss/message/21889 Mute This Topic: https://lists.opnfv.org/mt/23179182/21656 Group Owner: [email protected] Unsubscribe: https://lists.opnfv.org/g/opnfv-tech-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
