Dovetail Beta

Beta testing:

• Dovetail, together with C&C committee, plans to conduct CVP Beta testing to get direct feedback from
  • Vendors who have applicable products and intend to apply for CVP certification for these products
  • Third party labs who intend to apply to become OPNFV Preferred Verification Labs
  • Operators/end users members who are interested in utilizing CVP for qualification
• Benefits of participating in Beta
  • TBD - e.g. listed as the first group of certified products, or labs
  • Get direct access to dovetail test suite developers and c&c reviewers
• Beta process
  • Entering Beta
    • Dovetail test tool and test cases freeze (e.g. 0.9.0), no new development to the test tool or to test cases
    • A group of companies (vendors, labs or end users) volunteered to be beta trial testers, submitting feedback / bugs. # of companies should be >= 5 (tbd), including vendors, labs and end users.
  • Test result review
    • Beta participants submit Beta test results for review the same way one would in an actual application
    • C&C committee organizes a CVP review group for Beta test result review. The review result will be shared with the participant who submitted the test result.
  • Bug fixes
    • During the Beta trial, testers are expected to be the primary source of bug reports. All reported bugs will be logged, reviewed and prioritized.
    • During the Beta trial no new tests or features will be merged into the Dovetail master branch.
  • Exit Beta
    • All critical bugs are fixed, all non-critical bugs are documented
    • TBD, e.g. X% of Beta participants have achieved "PASS" criteria for CVP
    • If , for example, 0.9.x is the version when the above exit criteria is met, then we will re-label it 1.0.0, and it becomes the first release.
  • Duration
    • We expect the duration of Beta be 4-6 weeks.
• The first release is ready for launch after Beta.

Beta schedule

The beginning date of beta testing is still tdb. Here is a rough schedule to reach that date (last updated 8/11).

dovetail status 8-11.pptx

Beta participants