...
Working with the ETSI NFV TST 001 reference: http://www.etsi.org/deliver/etsi_gs/NFV-TST/001_099/001/01.01.01_60/gs_NFV-TST001v010101p.pdf
The Dovetail project will focus on tests validating a scope for a System Under Test (SUT) associated with Chapter 4.9 - NFV Infrastructure + VIM Under Test, as adapted for OPNFV (see figure below). The test suite will also contain pre-deployment validation tests to ensure that any platform under evaluation is first in a steady state of readiness. (It is open to debate whether we should have tests validating a steady state, or whether we should simply specify preconditions for the steady state we expect to find)
Test case requirements
The following requirements should be fulfilled for all tests added to the Dovetail test suite:
- Test cases should favour implementation of a published standard interface for validation
- Where no standard is available provide API support references
- If a standard exists and is not followed, an exemption method needs to be established
- Test cases be documented
- Use case specification
- Test preconditions
- Basic test flow execution descriptor
- Post conditions and pass fail criteria
- Parameter border test cases descriptions
- Fault/Error test case descriptions (this feels optional at this time)
- Test cases must pass on OPNFV reference deployments
- Tests must pass with deployments with at least two installers
- Tests must pass with at least two deployment scenarios involving different SDN controllers
- Tests must not depend on code which has not been accepted into the relevant upstream projects
- (hongbo: this needs to be discussed further. there are several SDN controllers. some test cases from dedicated SDN controller can not be used for other controller.)
- Test documentation/implementation file and directory structure (per supported framework)
- Test result storage, structure and test result information management (these should be able to be run publically publicly or privately)
Dovetail Test Suite Structure
...