Hi Dovetail team,
I have been checking the meeting logs for the two weeks I was away and am happy to see we are looking at a few use cases to focus on in the shorter term. This is god to see and hopefully will help us establish a better understanding on what it means to validate a use case in OPNFV. I have started to look into what the requirements of a validation test case might look like. The best reference readily available at this time for structuring and general platform evaluation I have located is: http://www.etsi.org/deliver/etsi_gs/NFV-TST/001_099/001/01.01.01_60/gs_NFV-TST001v010101p.pdf Where I would see our dovetail project focus on SUT tests validating a SUT scope associated with Chapter 4.9 - NFV Infrastructure + VIM Under Test. While we may also look at interesting use cases like SFC, I would suggest we have clear plan on pre-deployment validation to ensure that any platform we are evaluating is first evaluated to be in a steady state of readiness. Aside from the very basic requirements we would have on a test case to be used in dovetail: · Test cases should implement a published standard interface for validation o Where no standard is available provide API support references o If a standard exists is not followed an exemption method needs to be established · Test cases be documented o Use case specification o Test preconditions o Basic test flow execution descriptor o Post conditions and pass fail criteria o Parameter border test cases descriptions o Fault/Error test case descriptions (this feels optional at this time) · Test documentation/implementation file and directory structure (per supported framework) · Test result storage, structure and test result information management (these should be able to be run publically or privately) Now these requirements need to be implemented in the source projects so it would seem to me that a dialog with YardStick and Functest and others on fulfilling these requirements for select test cases needs to be established as part of our use case selection and planning criteria. Can we bring this topic up on Fridays meeting? I would like to discuss the expectations we have on test cases that we would use in dovetail, their level of documentation, completeness of test, quality and relevance metrics we might use or aim at. This activity can of course be done in parallel with use case selection. / Chris
_______________________________________________ opnfv-tech-discuss mailing list [email protected] https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
