...
- Mandatory Test Areas - all mandatory test areas are present
- Test-Case Count within Test Area - total number of test-cases are present in each test area
- Test-Case Pass Percentage - all tests have passed (100% pass rate)
- Log File Verification - inspect the log file for each test area (osinterop, ha, vping)
- SUT Information Verification - TBA when Dovetail cvp.0.9.0 is available
1. Mandatory Test Areas
Validate that all mandatory test areas are included in the overall test suite. The required mandatory test areas are:
...
The 'Test ID' hyperlink toggles the view to a top-level listing of the results displayed above. Validate that osinterop, vping and ha test areas are all present within the view.
2. Test-Case Count within Test Area
Validate the test-case count within each test area. For the Danube release, this must break down as follows:
...
An example of a listing that should flag a negative review is shown above. This overall output contains only 214 test-cases, which is missing one of the ha test-cases.
3. Test-Case Pass Percentage
All mandatory test-cases must pass. This can be validated in multiple ways. The below diagram of the 'Test Run Results' is one method and shows that 100% of the mandatory test-cases have passed. This value must not be lower than 100%.
...
Another method to check that all mandatory test-cases have passed is shown in the diagram below. The pass/total is given as a fraction and highlighted here in yellow. For the osinterop test area, the result must display [205/205] and [1/1] for each of the test-cases under the vping and ha test areas.
4. Log File Verification
Three log files must be verified for content within each mandatory test area. The log files for each of the test areas is noted in the table below.
...