...
1.3 cvp.0.3.0 (2017/7/21)
1.3.1 Docker images used:
opnfv/dovetail:cvp.0.3.0 (commit ID 7ed1cf189676693d84c9d48bb964c178b16bae76)
opnfv/yardstick:danube.3.1
opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)
opnfv/testapi:cvp.0.3.0 (commit ID 4e0b74b0141e3ae5d250006f3d75fcc880738cc9)
1.3.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.3.0 |
| ||
opnfv/yardstick:danube.3.1 | None | None | None |
opnfv/functest:cvp.0.2.0 | None | None | None |
opnfv/testapi:cvp.0.3.0 |
| None | None |
1.4 cvp.0.4.0 (2017/8/4)
1.4.1 Docker images used:
opnfv/dovetail:cvp.0.4.0 (commit ID a8d7665ca783684bc10d7c3dbbc606e30f083bc7)
opnfv/yardstick:danube.3.1
opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)
opnfv/testapi:cvp.0.4.0
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
1.4.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.4.0 |
| ||
opnfv/yardstick:danube.3.1 | Bugfix: cannot run task if without yardstick.conf in danube | YARDSTICK-776 | https://gerrit.opnfv.org/gerrit/#/c/38955/ |
opnfv/functest:cvp.0.2.0 |
| ||
opnfv/testapi:cvp.0.4.0 |
| ||
opnfv/bottlenecks:cvp.0.4.0 |
1.5 cvp.0.5.0 (2017/8/18)
1.5.1 Docker images used:
opnfv/dovetail:cvp.0.5.0 (commit ID 474795c11c556dcd325559853fe7ed436a69418c)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:nginx.cvp.0.5.0
1.5.2 Updates and problems found and fixed in this version
1.6 cvp.0.6.0 (2017/9/8)
1.6.1 Docker images used:
opnfv/dovetail:cvp.0.6.0 (commit ID 0aacdceeeac62333651ec5440fb32af965c7689e)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:web.cvp.0.6.0
opnfv/dovetail:api.cvp.0.6.0
1.6.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.6.0 |
|
| |
opnfv/yardstick:danube.3.2 | None | None | None |
opnfv/functest:cvp.0.5.0 | None | None | None |
opnfv/testapi:cvp.0.5.0 |
| ||
opnfv/dovetail:web.cvp.0.6.0 | |||
opnfv/dovetail:api.cvp.0.6.0 |
1.7 cvp.0.7.0 (2017/9/29)
1.7.1 Docker images used:
opnfv/dovetail:cvp.0.7.0 (commit ID 043ef2dad58c3aef0ea91cf3063dc9deb6f40bd9)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:web.cvp.0.7.0
opnfv/dovetail:api.cvp.0.7.0
1.7.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.7.0 |
|
| |
opnfv/yardstick:danube.3.2 | None | None | None |
opnfv/functest:cvp.0.5.0 | None | None | None |
opnfv/testapi:cvp.0.5.0 | None | None | None |
opnfv/dovetail:web.cvp.0.7.0 |
|
| |
opnfv/dovetail:api.cvp.0.7.0 |
1.8 cvp.0.8.0 (2017/10/25)
1.8.1 Docker images used:
opnfv/dovetail:cvp.0.8.0 (commit ID 73f332fc513f184513be483db6a108bd3c7b7d9b)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:web.cvp.0.8.0 (commit ID 3617b6958c4c44678d64c05e669b50e427fc45f8)
opnfv/dovetail:api.cvp.0.8.0 (commit ID 3617b6958c4c44678d64c05e669b50e427fc45f8)
1.8.2 Updates and problems found and fixed in this version
in order to make the dovetail tool more stable, the dovetail has been integreated in the CI for daily running.
...
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.8.0 |
|
| |
opnfv/yardstick:danube.3.2 | None | None | None |
opnfv/functest:cvp.0.5.0 | None | None | None |
opnfv/testapi:cvp.0.5.0 | None | None | None |
opnfv/dovetail:web.cvp.0.8.0 |
| ||
opnfv/dovetail:api.cvp.0.8.0 |
1.9 cvp.0.9.0 (2017/11/8)
1.9.1 Docker images used:
opnfv/dovetail:cvp.0.9.0 (commit ID 84d413ec0d980d4d0b80bf77bc35fffb063cf686)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:web.cvp.0.8.0 (commit ID c70193d65811a8a2a3b50fdad5463bca3643e219)
opnfv/dovetail:api.cvp.0.8.0 (commit ID c70193d65811a8a2a3b50fdad5463bca3643e219)
in order to make the dovetail tool more stable, the dovetail has been integreated in the CI for daily running.
for more detil, please refer to link: https://build.opnfv.org/ci/view/dovetail/
3. Running against scenarios by owners
scenarios | installer | owners | cvp.0.1.0 | cvp.0.2.0 | cvp.0.3.0 | cvp.0.4.0 | cvp.0.5.0 | cvp.0.6.0 | cvp.0.7.0 | cvp.0.8.0 | cvp.0.9.0 |
---|---|---|---|---|---|---|---|---|---|---|---|
Apex Scenarios Currently Test Against | |||||||||||
os-nosdn-nofeature-ha | Apex | PASS/total defcore: 204/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 4/6 SDNVPN: 0/4 no SDN feature | PASS/total defcore: 205/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | PASS/total osinterop: 205/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | PASS/total osinterop: 205/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | PASS/total osinterop: 205/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | |||||
os-odl-bgpvpn-ha | Apex |
3. Running against scenarios by owners
PASS/total defcore: 205/205 HA: 7/8 vping: 2/2 ipv6: 17/25 tempest: 4/5 SDNVPN: 4/4 | |||||||||||||||||||||||||
Compass | |||||||||||||||||||||||||
scenarios | installer | owners | cvp.0.1.0 | cvp.0.2.0 | cvp.0.3.0 | cvp.0.4.0 | cvp.0.5.0 | cvp.0.6.0 | cvp.0.7.0 | ||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Scenarios Currently Test Against | |||||||||||||||||||||||||
os-nosdn-nofeature- | haha | Apex | Compass | PASS/total defcore: 204/205 HA: 7/8 tc007, SLA not passed ipv6: 25/25 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-apexcompass-huawei-pod4baremetal-proposed_tests-danube/4157/consoleconsoleFull PASS/total defcore: 204/205 HA: 78/8vping: 2/2 ipv6: 25/25tempest: 4/6 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-apexcompass-huawei-pod4baremetal-proposed_tests-danube/199196/consoleFull PASS/total defcore: 205204/205 HA: 78/8vping: 2/2 ipv6: 25/25tempest: 5/5 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-apexcompass-huaweivirtual-pod4-proposed_tests-danube/215335/consoleFull PASS/total defcore: 205204/205 HA: 78/8 vping: 2/2 ipv6: 25/25tempest: 5/5 SDNVPN: 0/4 no SDN feature | os-odl-bgpvpn-ha | Apex | resiliency: 1/1 | https://build.opnfv.org/ci/view/dovetail/job/dovetail-apex-huaweicompass-pod4baremetal-proposed_tests-danube/208/consoleFull288/consoleFull PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 3/6 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-apexcompass-baremetal-proposed_tests-danube/21331/consoleFull PASS/total defcore: 205/205 HA: 78/8 vping: 2/2 ipv6: 1725/25 tempest: 45/5 SDNVPN: 4/4 | |||||||||||||
Compass Scenarios Currently Test Against | |||||||||||||||||||||||||
0/4 no SDN feature | os-nosdn-nofeature-ha | Compass | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huawei-virtualpod7-proposed_tests-danube/17618/consoleFull PASS/total defcoreosinterop: 204205/205 HA: 7/8 tc007, SLA not passed: 8/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huawei-baremetalpod7-proposed_tests-danube/15738/consoleFull PASS/total defcoreosinterop: 204205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetalhuawei-pod7-proposed_tests-danube/19631/consoleFull PASS/total defcoreosinterop: 204205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | ||||||||||||||||||||
os-odl_l2-nofeature-ha | Compass | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtualbaremetal-proposed_tests-danube/335163/consoleFull PASS/total defcore: 204/205 HA: 8/8 vping: 2/2 ipv6: 25/25 SDNVPN: 0/4 no SDN feature resiliency: 1/1 | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/288191/consoleFull PASS/total defcore: 205204/205 HA: 8/ 8vping: 2/28 ipv6: 2517/25 tempest: 3/6 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetalvirtual-proposed_tests-danube/331309/consoleFull PASS/total defcore: 205204/205 HA: 87/8 vping: 2/2 ipv6: 25/25tempest: 5/5 SDNVPN: 0/4 no SDN feature resiliency: 1/1 | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huaweibaremetal-pod7-proposed_tests-danube/18304/consoleFull PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 2524/25 tempest: 52/56 SDNVPN: 0/4 no SDN feature | os-odl_l2-nofeature-ha | Compass | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/163335/consoleFull PASS/total defcore: 204205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 4/5 (Failed on testing port's admin state) SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huawei-baremetalpod7-proposed_tests-danube/19119/consoleFull PASS/total defcoreosinterop: 204205/205 HA: 8/8: 8/8 vping: 2/2 ipv6: 1725/25 tempest: 4/5 (Failed on testing port's admin state) SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huawei-virtualpod7-proposed_tests-danube/30940/consoleFull PASS/total defcoreosinterop: 204205/205 HA: 78/8 vping: 2/2 ipv6: 25/25 tempest: 4/5 (Failed on testing port's admin state) SDNVPN: 0/4 no SDN feature resiliency: 1/1 | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetalhuawei-pod7-proposed_tests-danube/30432/consoleFull PASS/total defcoreosinterop: 205/205 HA: 8/8 vping: 2/2 ipv6: 2425/25 tempest: 2/6SDNVPN: 0/4 no SDN feature: 4/5 (Failed on testing port's admin state) SDNVPN: 0/4 no SDN feature | ||||||||||||||
os-odl_l3-nofeature-ha | Compass | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetalvirtual-proposed_tests-danube/335178/consoleFull PASS/total defcore: 205204/205 HA: 87/8 vping: 2/2tc007, SLA not passed ipv6: 25/25tempest: 4/5 (Failed on testing port's admin state)17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huaweibaremetal-pod7-proposed_tests-danube/19159/consoleFull PASS/total defcore: 205204/205 HA: 8/8 vping: 2/2 ipv6: 25/25tempest: 4/5 (Failed on testing port's admin state)17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature | os-odl_l3-nofeature-ha | Compass | feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtualbaremetal-proposed_tests-danube/178198/consoleFull PASS/total defcore: 204/205 HA: 78/8 tc007, SLA not passed ipv6: 17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/159243/consoleFull PASS/total defcore: 204/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature resiliency: 0/1 | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/198311/consoleFull PASS/total defcore: 204205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 2/6 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/243326/consoleFull PASS/total defcore: 204205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 3/5 SDNVPN: 0/4 no SDN feature resiliency: 0/1 | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huawei-baremetalpod7-proposed_tests-danube/31121/consoleFullconsole PASS/total defcoreosinterop: 205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 23/65 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huawei-baremetalpod7-proposed_tests-danube/32634/consoleFull PASS/total defcoreosinterop: 205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 3/5 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huawei-pod7-proposed_tests-danube/2133/consoleconsoleFull PASS/total defcoreosinterop: 205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 3/5 SDNVPN: 0/4 no SDN feature | ||||||||||||
Fuel Scenarios Currently Test Against | |||||||||||||||||||||||||
os-nosdn-nofeature-ha | Fuel | PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 4/5 SDNVPN: 0/4 no SDN feature | |||||||||||||||||||||||
os-odl_l2-bgpvpn-ha | Fuel | PASS/total defcore: 205/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 3/4 sdnvpn.tc001 " | PASS/total defcore: 205/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 4/4 | PASS/total defcore: 205/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 4/4 | |||||||||||||||||||||
Other Scenarios | |||||||||||||||||||||||||
os-onos-nofeature-ha Don't test against this scenario since Compass will not release this scenario anymore. | Compass |
|
|
|
|
|
cvp.0.5.0 Tempest Test Cases Results on Compass Danube
...