...
- Test cases should favour implementation of a published standard interface for validation
- Where no standard is available provide API support references
- If a standard exists and is not followed, an exemption method needs to be established
- Test cases be documented
- Use case specification
- Test preconditions
- Basic test flow execution descriptor
- Post conditions and pass fail criteria
- Parameter border test cases descriptions
- Fault/Error test case descriptions (this feels optional at this time)
- Test cases must pass on OPNFV reference deployments
- Tests must pass with deployments with at least two installers
- Tests must pass with at least two deployment scenarios involving different SDN controllers
- Tests must not depend on code which has not been accepted into the relevant upstream projects
- (hongbo: this needs to be discussed further. there are several SDN controllers. some test cases from dedicated SDN controller can not be used for other controller.)
- Test documentation/implementation file and directory structure (per supported framework)
- not require a specific NFVi platform composition or installation tool
- Tests must not require unmerged patches to the relevant upstream projects in order to pass when run against OPNFV reference deployments
- The certification test suite must not require access to OPNFV infrastructure or resources in order to passTest result storage, structure and test result information management (these should be able to be run publicly or privately)
Dovetail Test Suite Structure
...