...
- Test cases should implement a published standard interface for validation
- Where no standard is available provide API support references
- If a standard exists is not followed an exemption method needs to be established
- Test cases be documented
- Use case specification
- Test preconditions
- Basic test flow execution descriptor
- Post conditions and pass fail criteria
- Parameter border test cases descriptions
- Fault/Error test case descriptions (this feels optional at this time)
- Test documentation/implementation file and directory structure (per supported framework)
- Test result storage, structure and test result information management (these should be able to be run publically or privately)
Test suite structure
A dovetail test suite should have the following overall components and structure: (stolen, if simplified a little, from IEEE)
- Test Plan
- The test plan should describe how the test will proceed, who will do the testing and what will be tested.
- Test Design Specification
- The design spec outlines what needs to be tested including such information as applicable standards, requirements, and tooling.
- Test Case Specification
- The Test Case spec describes the purpose of a test, required inputs and expected results, including step-by-step procedures pass/fail criteria.
- Test Procedure Specification
- Describes how to run the test, preconditions and procedural steps to be followed.
- Test Log
- A log of the tests run, by whom, when, and the results of the tests.
- Test Report
- The test report describes the tests that were run, any failures and associated bugs, detailing deviations from expectation.
- Test Summary Report
- Summary of all results including a test result assessment (to be defined).
Phasing the dovetail development effort
...
In phase 2 it may also be possible that dovetail provides such services as application test suites to validate the behavior of applications in preparation for deployment on an OPNFV VNFi. This may result in the definition of new SUT scopes for dovetail as described in of the ETSI NFV TST 001 specification.
Dovetail phase 3
...