This page provides some material about the “Test case run results history info gathering and display”.
This will help the community to do the compliance/certification test case selection when pass/fail evidence needed.
dovetail and community development progress map
CI and POD resource for dovetail
working together with infra group, ongoing
question description in details: https://wiki.opnfv.org/display/dovetail/Dovetail+Home?preview=/2926467/8690170/dovetail%20requirements%20from%20infra_v1.pptx
CI resource: https://build.opnfv.org/ci/view/dovetail/
| SUT | status |
|---|---|
| fuel | ongoing |
| compass | ongoing |
| apex | ongoing |
| joid |
community regular CI test case run history(for each release)
functest | http://testresults.opnfv.org/test/api/v1/results?case=tempest_smoke_serial&last=1&version=colorado |
http://testresults.opnfv.org/test/swagger/spec.html#!/spec/List_all_Test_Results (recommended) (only IE explorer, account/password opnfv/api@opnfv) | |
yardstick | http://testresults.opnfv.org/test/api/v1/results?project=yardstick&last=1&version=colorado |
http://testresults.opnfv.org/grafana/dashboard/db/os-nosdn-nofeature-ha-sample (recommended) (accout: opnfv password: opnfv) |
For functest:
http://testresults.opnfv.org/test/swagger/spec.html#!/spec/List_all_Test_Results
version=colorado
case=?, such as tempest_smoke_serial
For yardstick
http://testresults.opnfv.org/grafana/dashboard/db/os-nosdn-nofeature-ha-sample
version=colorado
Time filter: 2016/09/22-2017/1/10 (Colorado.1.0- Colorado.3.0)
Remaing questions
For functest:
1. tempest_full_parallel not runs in CI in Colorado, however, some testcase proposed for compliance includes in tempest_full_parallel
Suggestion: put tempest_full_parallel into weekly CI in Danube
2. In Colorado, the failed testcase can be seen, however, in master/D, it doesn’t exists. Besides, the skipped testcase is also needed
Suggestion: keep failed testcase shown in master/D
patch: https://gerrit.opnfv.org/gerrit/#/c/28025/
For yardstick
1. If a testcase don’t have test result, didn’t run or failed? can’t make a judgement