Hi Fuqiao and Al, I think it is a very good idea that we have an unconference time discussing the large scale test. Bottlenecks and Yardstick has provided some large scale/stress test exercises. Actually, one of the test cases is included in OVP, i.e., stress ping test, which will create VMs in parallel, does ping tests and remove all the VMs.
One thing I need to mention is that, from our experience, I am afraid none of the our installers could pass the 50 VMs parallel test. In OVP, we set the threshold as 10 VMs. So other than where to put the test case, we also need to take into consideration of setting test configuration and choosing NFVi. Best, Gabriel From: fuq...@chinamobile.com [mailto:fuq...@chinamobile.com] Sent: Wednesday, March 20, 2019 9:44 AM To: MORTON, ALFRED C (AL) <a...@research.att.com>; 1552778 <1552...@tongji.edu.cn>; georg.kunz <georg.k...@ericsson.com>; ian.jolliffe <ian.jolli...@windriver.com>; Yuyang (Gabriel) <gabriel.yuy...@huawei.com> Cc: opnfv-tech-discuss <opnfv-tech-discuss@lists.opnfv.org>; 14_ykl <14_...@tongji.edu.cn>; juan_qiu <juan_...@tongji.edu.cn>; Stefan Arntzen <stefan.arnt...@huawei.com>; trevor.cooper <trevor.coo...@intel.com> Subject: Re: RE: [opnfv-tech-discuss] [availability] large scale availability test in OPNFV Hi, Al. Thank you for sharing these. I would like to trigger this topic within our testing projects and see if it is possible to promote this. Probably we could have some time discuss about this during the ONS LFN unconference time. ________________________________ 中国移动研究院 网络与IT技术研究所 付乔 15901025951 From: MORTON, ALFRED C (AL)<mailto:a...@research.att.com> Date: 2019-03-19 20:28 To: fuqiao<mailto:fuq...@chinamobile.com>; 1552778<mailto:1552...@tongji.edu.cn>; georg.kunz<mailto:georg.k...@ericsson.com>; ian.jolliffe<mailto:ian.jolli...@windriver.com>; gabriel.yuyang<mailto:gabriel.yuy...@huawei.com> CC: opnfv-tech-discuss<mailto:opnfv-tech-discuss@lists.opnfv.org>; 14_ykl<mailto:14_...@tongji.edu.cn>; juan_qiu<mailto:juan_...@tongji.edu.cn>; stefan.arntzen<mailto:stefan.arnt...@huawei.com>; trevor.cooper<mailto:trevor.coo...@intel.com> Subject: RE: [opnfv-tech-discuss] [availability] large scale availability test in OPNFV Hi fuqiao, Regarding this test: 1.1 Create a certain number of VM (e.g. about 50) in parallel, and trigger continuous creation of this group of VM once the previous VMs are finished. Calculate the number of VM we can eventually create when reach a certain deadline of T. See if all the VM can be connected through subnet after creation. Gabriel presented some Life-cycle exercise tests in during the Fraser Plgufest/Hackfest/Joint ETSI Plugtest™ . It seems that the results are not captured in the report: https://www.opnfv.org/wp-content/uploads/sites/12/2018/09/OPNFV_ETSI_Report_FINAL.pdf or in the slides from the Plugfest: https://wiki.opnfv.org/display/EVNT/Fraser+Plugfest+Schedule?preview=/20745096/24576179/Monitoring%20OPNFV%20Long%20Duration%20Test.pdf IIRC, the creation groups of VM used were small, and the duration of the test was not very long before a failure occurred that resulted in test termination. It would be good to review these results again, and this seems like a very reasonable topic for testing. Likely projects are Yardstick or Bottlenecks. Al From: opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org> [mailto:opnfv-tech-discuss@lists.opnfv.org] On Behalf Of fuqiao Sent: Monday, March 18, 2019 11:42 PM To: fuqiao <fuq...@chinamobile.com<mailto:fuq...@chinamobile.com>>; 1552778 <1552...@tongji.edu.cn<mailto:1552...@tongji.edu.cn>>; georg.kunz <georg.k...@ericsson.com<mailto:georg.k...@ericsson.com>>; ian.jolliffe <ian.jolli...@windriver.com<mailto:ian.jolli...@windriver.com>>; gabriel.yuyang <gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>> Cc: opnfv-tech-discuss <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>>; 14_ykl <14_...@tongji.edu.cn<mailto:14_...@tongji.edu.cn>>; juan_qiu <juan_...@tongji.edu.cn<mailto:juan_...@tongji.edu.cn>>; stefan.arntzen <stefan.arnt...@huawei.com<mailto:stefan.arnt...@huawei.com>>; trevor.cooper <trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>> Subject: [opnfv-tech-discuss] [availability] large scale availability test in OPNFV Hi, all. I would like to trigger some discussion about large scale availability testing in OPNFV. With the large deployment of NFVi in Operators network, we gradually realized it is one thing to test small scale NFVi in lab, and it is definitely another thing to deploy large scale NFVi in real network environment. Therefore, availability and performance testing for large scale NFVi deployment is very important. I try to create a wiki page to list some of the test requirements I can think of. And I would hope the test WG to see if these cases can be realized by the current test framework for OPNFV? Or if we need further work on these? https://wiki.opnfv.org/display/availability/Large+scale+NFVI+high+availability+testing<https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.opnfv.org_display_availability_Large-2Bscale-2BNFVI-2Bhigh-2Bavailability-2Btesting&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=OfsSu8kTIltVyD1oL72cBw&m=9Ln0DiHmx2f0TtM4h_stSeEqUZicGwN4coTZP0VAyWk&s=ni-5ajGvC9RmFWN0hNmd1qfl_UfyuZf6ezx1ISCbHjs&e=> ________________________________ 中国移动研究院 网络与IT技术研究所 付乔 15901025951
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#22945): https://lists.opnfv.org/g/opnfv-tech-discuss/message/22945 Mute This Topic: https://lists.opnfv.org/mt/30503890/21656 Group Owner: opnfv-tech-discuss+ow...@lists.opnfv.org Unsubscribe: https://lists.opnfv.org/g/opnfv-tech-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-