Hi Pierre, Thanks for your question:
* You indicate testing of parallel VMs or pods. Where is that required? I haven’t seen that implied anywhere… Since the exposed metrics are composed as “per VNF-C” and others, there may be a linear range of throughput per XXX, where for example Throughput(two VM) = 2 x Throughput(one VM) up to some threshold of parallel VMs, and above that limit some other relationship exists. So you’re right that no one said (yet) that we have to test in this way, but I’m thinking ahead to reporting the results with a range of applicability. Obviously, configuration influences the relationships, too. This dialog is about clarifying the specifications, and we can see from your questions that some clarification is needed whether the exposed performance metrics cite a standard like TST009, or not (applies to all your remaining questions, on max flows and other aspects). regards, Al From: Pierre Lynch [mailto:pierre.ly...@keysight.com] Sent: Thursday, September 12, 2019 1:09 PM To: MORTON, ALFRED C (AL) <a...@research.att.com> Cc: sridhar....@spirent.com; opnfv-tech-discuss@lists.opnfv.org Subject: Re: [opnfv-tech-discuss] [vsperf] VSPERF weekly meeting - 11 Sep 2019 (ww111) Hi Al, I’ve taken a quick look at the wiki page, and have a few questions: * You indicate testing of parallel VMs or pods. Where is that required? I haven’t seen that implied anywhere… * Same question for bi-directional testing… As for the table 4-4 in the CNTT document (I guess these questions are more for the authors, just thought I would bring them up here) * For the max simultaneous flows metric, would the max be determined by the “next” one dropping, or by misbehavior of the existing flows (ie. Higher latency) * For the max new flow rate, I have always thought that was more of a control plane test (ie. TCP in this case). Is that part of NFVI? * Network latency is defined as “round trip”. I am guessing they mean the packet is sent to the NFVI by the test device, NFVI switches it back out and then it’s received by the test device? I’ve always looked at that as a unidirectional test (end to end) because it’s sent by one end and received by one other end. Thanks, Pierre From: <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>> on behalf of "Sridhar K. N. Rao via Lists.Opnfv.Org" <sridhar.rao=spirent....@lists.opnfv.org<mailto:sridhar.rao=spirent....@lists.opnfv.org>> Reply-To: "sridhar....@spirent.com<mailto:sridhar....@spirent.com>" <sridhar....@spirent.com<mailto:sridhar....@spirent.com>> Date: Wednesday, September 11, 2019 at 10:34 PM To: "a...@research.att.com<mailto:a...@research.att.com>" <a...@research.att.com<mailto:a...@research.att.com>>, "opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>" <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>> Cc: "opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>" <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>> Subject: Re: [opnfv-tech-discuss] [vsperf] VSPERF weekly meeting - 11 Sep 2019 (ww111) [EXTERNAL] Thanks, Al. Will work on implementation plan. Once we have better clarity, we can start discussion with CNTT-RI Regards Sridhar From: opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org> <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>> On Behalf Of Al Morton via Lists.Opnfv.Org Sent: 12 September 2019 04:28 To: Rao, Sridhar <sridhar....@spirent.com<mailto:sridhar....@spirent.com>>; opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org> Cc: opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org> Subject: Re: [opnfv-tech-discuss] [vsperf] VSPERF weekly meeting - 11 Sep 2019 (ww111) On Item 5. I took an action to create a new page describing the CNTT-VSPERF tests that require some more development. So, here’s the first draft: https://wiki.opnfv.org/display/vsperf/CNTT+and+VSPERF<https://urldefense.proofpoint.com/v2/url?u=https-3A__nam05.safelinks.protection.outlook.com_-3Furl-3Dhttps-253A-252F-252Fwiki.opnfv.org-252Fdisplay-252Fvsperf-252FCNTT-252Band-252BVSPERF-26data-3D02-257C01-257C-257C27a6c563cb314f70ff1508d73729bcd0-257C63545f2732324d74a44dcdd457063402-257C1-257C0-257C637038524718597571-26sdata-3DgkNJ8hWoMW2ctC11v24SNMiqKraia1vSlWanS824V0g-253D-26reserved-3D0&d=DwMGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=_6cen3Hn-e_hOm0BhY7aIpA58dd19Z9qGQsr8-6zYMI&m=Effbb8VSDsMjTi4j9xPFnoF45N47s3E1XAa1j0HfFQs&s=grj0zfDu4L-w2OiTfTR1-lF1yRwsWN8EeWQ47UIt9xk&e=> Al From: opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org> [mailto:opnfv-tech-discuss@lists.opnfv.org] On Behalf Of Sridhar K. N. Rao Sent: Wednesday, September 11, 2019 4:58 AM To: opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org> Cc: MORTON, ALFRED C (AL) <a...@research.att.com<mailto:a...@research.att.com>>; 'Trevor Cooper' <trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>>; 'Mars Toktonaliev (Nokia - US/Irving)' <mars.toktonal...@nokia.com<mailto:mars.toktonal...@nokia.com>>; Christian Trautman (ctrau...@redhat.com<mailto:ctrau...@redhat.com>) <ctrau...@redhat.com<mailto:ctrau...@redhat.com>>; Alec Hothan (ahothan) <ahot...@cisco.com<mailto:ahot...@cisco.com>>; martin.klo...@tieto.com<mailto:martin.klo...@tieto.com>; richard.el...@tieto.com<mailto:richard.el...@tieto.com>; Bob Fubel <bfu...@redhat.com<mailto:bfu...@redhat.com>>; Govindharajan, Hariprasad <hariprasad.govindhara...@intel.com<mailto:hariprasad.govindhara...@intel.com>>; shailesh chauhan <chauhansvc...@gmail.com<mailto:chauhansvc...@gmail.com>>; 'vipin68_...@jnu.ac.in' <vipin68_...@jnu.ac.in<mailto:vipin68_...@jnu.ac.in>>; Ancuta Enache <ancuta.ena...@keysight.com<mailto:ancuta.ena...@keysight.com>> Subject: [opnfv-tech-discuss] [vsperf] VSPERF weekly meeting - 11 Sep 2019 (ww111) Agenda: 1. Development Update. 2. VSPERF Software Upgrade - Update 3. Loss pattern Analysis Data Sharing. 4. New Internship Update - Container Networking Benchmarking 5. Discussion: VSPERF-CNTT New Testcase Proposals (Top 3 – Relevant and Stable) -------------------------------------------------------- Time: Wednesday PT 8h00 IRC: freenode https://freenode.net/<https://urldefense.proofpoint.com/v2/url?u=https-3A__nam05.safelinks.protection.outlook.com_-3Furl-3Dhttps-253A-252F-252Ffreenode.net-252F-26data-3D02-257C01-257C-257C27a6c563cb314f70ff1508d73729bcd0-257C63545f2732324d74a44dcdd457063402-257C1-257C0-257C637038524718607566-26sdata-3DL-252FJl-252FEnJEKcMYqQUZ40amJHk4ag1TXYU7e9hASQQUuI-253D-26reserved-3D0&d=DwMGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=_6cen3Hn-e_hOm0BhY7aIpA58dd19Z9qGQsr8-6zYMI&m=Effbb8VSDsMjTi4j9xPFnoF45N47s3E1XAa1j0HfFQs&s=Tmfa1n8qQznw0wPkJTcpAxKoJQvSMPTtOYt1SeSbPVc&e=> channel: #opnfv-vswitchperf; http://webchat.freenode.net/?channels=opnfv-vswitchperf<https://urldefense.proofpoint.com/v2/url?u=https-3A__nam05.safelinks.protection.outlook.com_-3Furl-3Dhttp-253A-252F-252Fwebchat.freenode.net-252F-253Fchannels-253Dopnfv-2Dvswitchperf-26data-3D02-257C01-257C-257C27a6c563cb314f70ff1508d73729bcd0-257C63545f2732324d74a44dcdd457063402-257C1-257C0-257C637038524718607566-26sdata-3DMX8H6HVntAHT134C93zkj3xobbqzhaYTbt3KpBqzYUU-253D-26reserved-3D0&d=DwMGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=_6cen3Hn-e_hOm0BhY7aIpA58dd19Z9qGQsr8-6zYMI&m=Effbb8VSDsMjTi4j9xPFnoF45N47s3E1XAa1j0HfFQs&s=AMuDDGvJYpP5NFl588h2_AhiUJz6yGPSGhU_0q9SqYM&e=> Audio: https://zoom.us/j/2362828999<https://urldefense.proofpoint.com/v2/url?u=https-3A__nam05.safelinks.protection.outlook.com_-3Furl-3Dhttps-253A-252F-252Fzoom.us-252Fj-252F2362828999-26data-3D02-257C01-257C-257C27a6c563cb314f70ff1508d73729bcd0-257C63545f2732324d74a44dcdd457063402-257C1-257C0-257C637038524718617561-26sdata-3DwQqOC0vme-252Bcp01eRR7dzMJ7MRwjqzpceDq5XNOhWPtA-253D-26reserved-3D0&d=DwMGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=_6cen3Hn-e_hOm0BhY7aIpA58dd19Z9qGQsr8-6zYMI&m=Effbb8VSDsMjTi4j9xPFnoF45N47s3E1XAa1j0HfFQs&s=ao-7wEkexVYfpycmDcDBe6rFhNHW_nmhx7V1wl_Ah_4&e=> Or iPhone one-tap : US: +16699006833,,2362828999# or +16465588656,,2362828999# Or Telephone: Dial(for higher quality, dial a number based on your current location): US: +1 669 900 6833 or +1 646 558 8656 or +1 877 369 0926 (Toll Free) or +1 855 880 1246 (Toll Free) Meeting ID: 236 282 8999 International numbers available: https://zoom.us/zoomconference?m=Xn-Kas4jq2GuyfbCCKYpwvi6FpHEYX8n<https://urldefense.proofpoint.com/v2/url?u=https-3A__nam05.safelinks.protection.outlook.com_-3Furl-3Dhttps-253A-252F-252Fzoom.us-252Fzoomconference-253Fm-253DXn-2DKas4jq2GuyfbCCKYpwvi6FpHEYX8n-26data-3D02-257C01-257C-257C27a6c563cb314f70ff1508d73729bcd0-257C63545f2732324d74a44dcdd457063402-257C1-257C0-257C637038524718617561-26sdata-3DJMAeLIsRTVecEGYhvKuPRil-252BhZNzIBP434-252B9krXS-252FiM-253D-26reserved-3D0&d=DwMGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=_6cen3Hn-e_hOm0BhY7aIpA58dd19Z9qGQsr8-6zYMI&m=Effbb8VSDsMjTi4j9xPFnoF45N47s3E1XAa1j0HfFQs&s=7K1oTGqw2P5o7AKsr4bVgyGXM_CoKEdBAuJFMGxnCTQ&e=> Cheers, Sridhar
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#23544): https://lists.opnfv.org/g/opnfv-tech-discuss/message/23544 Mute This Topic: https://lists.opnfv.org/mt/34101360/21656 Group Owner: opnfv-tech-discuss+ow...@lists.opnfv.org Unsubscribe: https://lists.opnfv.org/g/opnfv-tech-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
