...
1.3 cvp.0.3.0 (2017/7/21)
1.3.1 Docker images used:
opnfv/dovetail:cvp.0.3.0 (commit ID 7ed1cf189676693d84c9d48bb964c178b16bae76)
opnfv/yardstick:danube.3.1
opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)
opnfv/testapi:cvp.0.3.0 (commit ID 4e0b74b0141e3ae5d250006f3d75fcc880738cc9)
1.3.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.3.0 |
| ||
opnfv/yardstick:danube.3.1 | None | None | None |
opnfv/functest:cvp.0.2.0 | None | None | None |
opnfv/testapi:cvp.0.3.0 |
| None | None |
1.4 cvp.0.4.0 (2017/8/4)
1.4.1 Docker images used:
opnfv/dovetail:cvp.0.4.0 (commit ID a8d7665ca783684bc10d7c3dbbc606e30f083bc7)
opnfv/yardstick:danube.3.1
opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)
opnfv/testapi:cvp.0.4.0
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
1.4.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.4.0 |
| ||
opnfv/yardstick:danube.3.1 | Bugfix: cannot run task if without yardstick.conf in danube | YARDSTICK-776 | https://gerrit.opnfv.org/gerrit/#/c/38955/ |
opnfv/functest:cvp.0.2.0 |
| ||
opnfv/testapi:cvp.0.4.0 |
| ||
opnfv/bottlenecks:cvp.0.4.0 |
1.5 cvp.0.5.0 (2017/8/18)
1.5.1 Docker images used:
opnfv/dovetail:cvp.0.5.0 (commit ID 474795c11c556dcd325559853fe7ed436a69418c)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:nginx.cvp.0.5.0
1.5.2 Updates and problems found and fixed in this version
1.6 cvp.0.6.0 (2017/9/8)
1.6.1 Docker images used:
opnfv/dovetail:cvp.0.6.0 (commit ID 0aacdceeeac62333651ec5440fb32af965c7689e)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:web.cvp.0.6.0
opnfv/dovetail:api.cvp.0.6.0
1.6.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.6.0 |
|
| |
opnfv/yardstick:danube.3.2 | None | None | None |
opnfv/functest:cvp.0.5.0 | None | None | None |
opnfv/testapi:cvp.0.5.0 |
| ||
opnfv/dovetail:web.cvp.0.6.0 | |||
opnfv/dovetail:api.cvp.0.6.0 |
1.7 cvp.0.7.0 (2017/9/29)
1.7.1 Docker images used:
opnfv/dovetail:cvp.0.7.0 (commit ID 043ef2dad58c3aef0ea91cf3063dc9deb6f40bd9)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:web.cvp.0.7.0
opnfv/dovetail:api.cvp.0.7.0
1.7.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.7.0 |
|
| |
opnfv/yardstick:danube.3.2 | None | None | None |
opnfv/functest:cvp.0.5.0 | None | None | None |
opnfv/testapi:cvp.0.5.0 | None | None | None |
opnfv/dovetail:web.cvp.0.7.0 |
|
| |
opnfv/dovetail:api.cvp.0.7.0 |
1.8 cvp.0.8.0 (2017/10/25)
1.8.1 Docker images used:
opnfv/dovetail:cvp.0.8.0 (commit ID 73f332fc513f184513be483db6a108bd3c7b7d9b)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:web.cvp.0.8.0 (commit ID 3617b6958c4c44678d64c05e669b50e427fc45f8)
opnfv/dovetail:api.cvp.0.8.0 (commit ID 3617b6958c4c44678d64c05e669b50e427fc45f8)
in order to make the dovetail tool more stable, the dovetail has been integreated in the CI for daily running.
for more detil, please refer to link: https://build.opnfv.org/ci/view/dovetail/
3. Running against scenarios by owners
1.8.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.8.0 |
|
| |
opnfv/yardstick:danube.3.2 | None | None | None |
opnfv/functest:cvp.0.5.0 | None | None | None |
opnfv/testapi:cvp.0.5.0 | None | None | None |
opnfv/dovetail:web.cvp.0.8.0 |
| ||
opnfv/dovetail:api.cvp.0.8.0 |
1.9 cvp.0.9.0 (2017/11/8)
1.9.1 Docker images used:
opnfv/dovetail:cvp.0.9.0 (commit ID 84d413ec0d980d4d0b80bf77bc35fffb063cf686)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:web.cvp.0.8.0 (commit ID c70193d65811a8a2a3b50fdad5463bca3643e219)
opnfv/dovetail:api.cvp.0.8.0 (commit ID c70193d65811a8a2a3b50fdad5463bca3643e219)
in order to make the dovetail tool more stable, the dovetail has been integreated in the CI for daily running.
for more detil, please refer to link: https://build.opnfv.org/ci/view/dovetail/
3. Running against scenarios by owners
scenarios | installer | owners | cvp.0.1.0 | cvp.0.2.0 | cvp.0.3.0 | cvp.0.4.0 | cvp.0.5.0 | cvp.0.6.0 | cvp.0.7.0 | cvp.0.8.0 | cvp.0.9.0 | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Apex Scenarios Currently Test Against | |||||||||||||||||||
os-nosdn-nofeature-ha | Apex | PASS/total defcore: 204/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 4/6 SDNVPN: 0/4 no SDN feature | PASS/total defcore: 205/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | PASS/total osinterop: 205/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | PASS/total osinterop: 205/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | PASS/total osinterop: 205/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | |||||||||||||
os-odl-bgpvpn-ha | Apex | PASS/total defcore: 205/205 HA: 7/8 vping: 2/2 ipv6: 17/25 tempest: 4/5 SDNVPN: 4/4 | |||||||||||||||||
Compass Scenarios Currently Test Against | |||||||||||||||||||
os-nosdn-nofeature-ha | Compass | PASS/total defcore: 204/205 HA: 7/8 tc007, SLA not passed ipv6: 25/25 SDNVPN: 0/4 no SDN feature | PASS/total defcore: 204/205 HA: 8/8 ipv6: 25/25 SDNVPN: 0/4 no SDN feature | PASS/total defcore: 204/205 HA: 8/8 ipv6: 25/25 SDNVPN: 0/4 no SDN feature | |||||||||||||||
scenarios | installer | owners | cvp.0.1.0 | cvp.0.2.0 | cvp.0.3.0 | cvp.0.4.0 | cvp.0.5.0 | cvp.0.6.0 | cvp.0.7.0 | ||||||||||
Apex Scenarios Currently Test Against | |||||||||||||||||||
os-nosdn-nofeature-ha | Apex | https://build.opnfv.org/ci/view/dovetail/job/dovetail-apexcompass-huawei-pod4virtual-proposed_tests-danube/4335/consoleconsoleFull PASS/total defcore: 204/205 HA: 78/8 vping: 2/2 ipv6: 25/25tempest: 4/6 SDNVPN: 0/4 no SDN feature resiliency: 1/1 | https://build.opnfv.org/ci/view/dovetail/job/dovetail-apexcompass-huaweibaremetal-pod4-proposed_tests-danube/199288/consoleFull PASS/total defcore: 205/205 HA: 78/8 vping: 2/2 ipv6: 25/25 tempest: 53/56 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-apex-huaweicompass-pod4baremetal-proposed_tests-danube/215331/consoleFull PASS/total defcore: 205/205 HA: 78/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | os-odl-bgpvpn-ha | Apex | https://build.opnfv.org/ci/view/dovetail/job/dovetail-apexcompass-huawei-pod4pod7-proposed_tests-danube/208/consoleFullhttps://build.opnfv.org/ci/view/dovetail/job/dovetail-apex-baremetal-proposed_tests-danube/21/18/consoleFull PASS/total defcoreosinterop: 205/205 HA: 78/8 vping: 2/2 ipv6: 1725/25 tempest: 4/5 SDNVPN: 4/4 | ||||||||||||
Compass Scenarios Currently Test Against | |||||||||||||||||||
5/5 SDNVPN: 0/4 no SDN feature | os-nosdn-nofeature-ha | Compass | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtualhuawei-pod7-proposed_tests-danube/17638/consoleFull PASS/total defcoreosinterop: 204205/205 HA: 78/8 tc007, SLA not passed vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huawei-baremetalpod7-proposed_tests-danube/15731/consoleFull PASS/total defcoreosinterop: 204205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | |||||||||||||||
os-odl_l2-nofeature-ha | Compass | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/196163/consoleFull PASS/total defcore: 204/205 HA: 8/8 ipv6: 25/25 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtualbaremetal-proposed_tests-danube/335191/consoleFull PASS/total defcore: 204/205 HA: 8/8 vping: 2/2 ipv6: 2517/25 SDNVPN: 0/4 no SDN featureresiliency: 1/1 | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetalvirtual-proposed_tests-danube/288309/consoleFull PASS/total defcore: 205204/205 HA: 87/8 vping: 2/2 ipv6: 25/25 tempest: 3/6 SDNVPN: 0/4 no SDN feature resiliency: 1/1 | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/331304/consoleFull PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 2524/25 tempest: 52/56 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huaweibaremetal-pod7-proposed_tests-danube/18335/consoleFull PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 54/5 (Failed on testing port's admin state) SDNVPN: 0/4 no SDN feature os-odl_l2-nofeature-ha | Compass | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetalhuawei-pod7-proposed_tests-danube/16319/consoleFull PASS/total defcoreosinterop: 204205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 4/5 (Failed on testing port's admin state) SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huawei-baremetalpod7-proposed_tests-danube/19140/consoleFull PASS/total defcoreosinterop: 204205/205 HA: 8/8 vping: 2/2 ipv6: 1725/25 tempest: 4/5 (Failed on testing port's admin state) SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtualhuawei-pod7-proposed_tests-danube/30932/consoleFull PASS/total defcoreosinterop: 204205/205 HA: 78/8 vping: 2/2 ipv6: 25/25 tempest: 4/5 (Failed on testing port's admin state) SDNVPN: 0/4 no SDN featureresiliency: 1/1 | |||||||||
os-odl_l3-nofeature-ha | Compass | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetalvirtual-proposed_tests-danube/304178/consoleFull PASS/total defcore: 205204/205 HA: 87/8 vping: 2/2 tc007, SLA not passed ipv6: 2417/25 tempest: 2/6tc018-tc025 fails SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/335159/consoleFull PASS/total defcore: 205204/205 HA: 8/8 vping: 2/2 ipv6: 25/25tempest: 4/5 (Failed on testing port's admin state)17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huawei-pod7baremetal-proposed_tests-danube/19198/consoleFull PASS/total defcore: 205204/205 HA: 8/8vping: 2/2 ipv6: 2517/25 tempest: 4/5 (Failed on testing port's admin state) tc018-tc025 fails SDNVPN: 0/4 no SDN feature | os-odl_l3-nofeature-ha | Compass | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtualbaremetal-proposed_tests-danube/178243/consoleFull PASS/total defcore: 204/205 HA: 78/8 tc007, SLA not passed vping: 2/2 ipv6: 17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature resiliency: 0/1 | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/159311/consoleFull PASS/total defcore: 204205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 2/6 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/198326/consoleFull PASS/total defcore: 204205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 3/5 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huawei-baremetalpod7-proposed_tests-danube/24321/consoleFullconsole PASS/total defcoreosinterop: 204205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 3/5 SDNVPN: 0/4 no SDN feature resiliency: 0/1 | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-huawei-baremetalpod7-proposed_tests-danube/31134/consoleFull PASS/total defcoreosinterop: 205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 23/65 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetalhuawei-pod7-proposed_tests-danube/32633/consoleFull PASS/total defcoreosinterop: 205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 3/5 SDNVPN: 0/4 no SDN feature | |||||||
Fuel Scenarios Currently Test Against | |||||||||||||||||||
os-nosdn-nofeature-ha | Fuel | PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 4/5 SDNVPN: 0/4 no SDN feature | |||||||||||||||||
os-odl_l2-bgpvpn-ha | Fuel | PASS/total defcore: 205/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 3/4 sdnvpn.tc001 " | PASS/total defcore: 205/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 4/4 | PASS/total defcore: 205/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 4/4 | |||||||||||||||
Other Scenarios | |||||||||||||||||||
os-onos-nofeature-ha Don't test against this scenario since Compass will not release this scenario anymore. | Compass |
|
|
|
|
|
cvp.0.5.0 Tempest Test Cases Results on Compass Danube
...