Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Minor change

...

Working with the ETSI NFV TST 001 reference: http://www.etsi.org/deliver/etsi_gs/NFV-TST/001_099/001/01.01.01_60/gs_NFV-TST001v010101p.pdf
The Dovetail project will focus on tests validating a scope for a System Under Test (SUT) associated with Chapter 4.9 - NFV Infrastructure + VIM Under Test, as adapted for OPNFV (see figure below).  The test suite will also contain pre-deployment validation tests to ensure that any platform under evaluation is first in a steady state of readiness.

Aside

Test case requirements


The following requirements should be fulfilled for all tests added to the Dovetail test suite from the very basic requirements we would have on a test case to be used in dovetail:

  • Test cases should implement favour implementation of a published standard interface for validation
    • Where no standard is available provide API support references
    • If a standard exists and is not followed, an exemption method needs to be established
  • Test cases be documented
    • Use case specification
    • Test preconditions
    • Basic test flow execution descriptor
    • Post conditions and pass fail criteria
    • Parameter border test cases descriptions
    • Fault/Error test case descriptions  (this feels optional at this time)
  • Test cases must pass on OPNFV reference deployments
    • Tests must pass with deployments with at least two installers
    • Tests must pass with at least two deployment scenarios involving different SDN controllers
    • Tests must not depend on code which has not been accepted into the relevant upstream projects
    • (hongbo: this needs to be discussed further. there are several SDN controllers. some test cases from dedicated SDN controller can not be used for other controller.)
  • Test documentation/implementation file and directory structure (per supported framework)
  • Test result storage, structure and test result information management (these should be able to be run publically or privately)

...