Page History

...

1.3 cvp.0.3.0 (2017/7/21)

1.3.1 Docker images used:

opnfv/dovetail:cvp.0.3.0 (commit ID 7ed1cf189676693d84c9d48bb964c178b16bae76)

opnfv/yardstick:danube.3.1

opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)

opnfv/testapi:cvp.0.3.0 (commit ID 4e0b74b0141e3ae5d250006f3d75fcc880738cc9)

1.3.2 Updates and problems found and fixed in this version

Image	Updates and problems found and fixed	JIRA	Gerrit
opnfv/dovetail:cvp.0.3.0	Add docs about vping test cases (test scope and test specification) Add 2 vping test cases (vping.tc001->vping_userdata, vping.tc002->vping_ssh) into proposed_tests Bugfix: Build docker image failed because of lacking of packages Add resiliency.tc001 into proposed_tests	None DOVETAIL-446 DOVETAIL-475 DOVETAIL-474	https://gerrit.opnfv.org/gerrit/#/c/36253/ https://gerrit.opnfv.org/gerrit/#/c/37853/ https://gerrit.opnfv.org/gerrit/#/c/38573/ https://gerrit.opnfv.org/gerrit/#/c/38713/
opnfv/yardstick:danube.3.1	None	None	None
opnfv/functest:cvp.0.2.0	None	None	None
opnfv/testapi:cvp.0.3.0	Add Linux Foundation ID as account provider Upload multi results in one time Submit results to CVP to review Results are grouped by test id Add details for each test	None	None

1.4 cvp.0.4.0 (2017/8/4)

1.4.1 Docker images used:

opnfv/dovetail:cvp.0.4.0 (commit ID a8d7665ca783684bc10d7c3dbbc606e30f083bc7)

opnfv/yardstick:danube.3.1

opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)

opnfv/testapi:cvp.0.4.0

opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)

1.4.2 Updates and problems found and fixed in this version

Image	Updates and problems found and fixed	JIRA	Gerrit
opnfv/dovetail:cvp.0.4.0	Bugfix: wrong command in function 'check_https_enabled' Use opnfv/functest:cvp.0.5.0 and do some adaptions in dovetail tool Create a tar file for all logs Add tempest test cases into proposed_tests Fix testapi base_url for public_url Add user guide for results operations on web Add nginx to host static files	DOVETAIL-482 DOVETAIL-480 DOVETAIL-479 DOVETAIL-478 None DOVETAIL-471 DOVETAIL-485	https://gerrit.opnfv.org/gerrit/#/c/39393/ https://gerrit.opnfv.org/gerrit/#/c/39221/ https://gerrit.opnfv.org/gerrit/#/c/38891/ https://gerrit.opnfv.org/gerrit/#/c/38835/ https://gerrit.opnfv.org/gerrit/#/c/38823/ https://gerrit.opnfv.org/gerrit/#/c/38065/ https://gerrit.opnfv.org/gerrit/#/c/39489/
opnfv/yardstick:danube.3.1	Bugfix: cannot run task if without yardstick.conf in danube	YARDSTICK-776	https://gerrit.opnfv.org/gerrit/#/c/38955/
opnfv/functest:cvp.0.2.0	Remove functest repo and only python module have been installed Functest Docker image will not host any OS images Add a dedicated file to configure extra params in tempest.conf	FUNCTEST-836 None FUNCTEST-860	https://gerrit.opnfv.org/gerrit/#/c/35813/ https://gerrit.opnfv.org/gerrit/#/c/36163/ https://gerrit.opnfv.org/gerrit/#/c/37373/ https://gerrit.opnfv.org/gerrit/#/c/39019/
opnfv/testapi:cvp.0.4.0	log browsing in directory style
opnfv/bottlenecks:cvp.0.4.0

1.5 cvp.0.5.0 (2017/8/18)

1.5.1 Docker images used:

opnfv/dovetail:cvp.0.5.0 (commit ID 474795c11c556dcd325559853fe7ed436a69418c)

opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)

opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)

opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)

opnfv/testapi:cvp.0.5.0

opnfv/dovetail:nginx.cvp.0.5.0

1.5.2 Updates and problems found and fixed in this version

Image	Updates and problems found and fixed	JIRA	Gerrit
opnfv/dovetail:cvp.0.5.0	Merge addendum doc and workflow doc Update user guide docs Remake aarch64 patch for Dovetail container Remove some tempest test cases that are not too common Add additional Tempest API test cases into test case tempest.tc005 persist db file in host for mongo container add nginx to host static files add a sample tempest_conf.yaml file into userconfig Add a patch to set ha SLA to be 30 seconds Modify logs Bugfix: the config files in useeconfig will cover user's config Bugfix: functest only keeps the last test case's log Bugfix: pre_condition cmds is just executed once Bugfix: No cirros-0.3.5-x86_64-disk.img Merge all test specification docs about test area tempest and defcore	None DOVETAIL-493 ARMBAND-286 None DOVETAIL-495 DOVETAIL-488 DOVETAIL-485 DOVETAIL-484 DOVETAIL-496 DOVETAIL-498 DOVETAIL-492 DOVETAIL-490 DOVETAIL-489 DOVETAIL-487 DOVETAIL-431 DOVETAIL-473	https://gerrit.opnfv.org/gerrit/#/c/35161/ https://gerrit.opnfv.org/gerrit/#/c/34643/ https://gerrit.opnfv.org/gerrit/#/c/40369/ https://gerrit.opnfv.org/gerrit/#/c/39073/ https://gerrit.opnfv.org/gerrit/#/c/40963/ https://gerrit.opnfv.org/gerrit/#/c/40745/ https://gerrit.opnfv.org/gerrit/#/c/39851/ https://gerrit.opnfv.org/gerrit/#/c/39489/ https://gerrit.opnfv.org/gerrit/#/c/39463/ https://gerrit.opnfv.org/gerrit/#/c/41251/ https://gerrit.opnfv.org/gerrit/#/c/41285/ https://gerrit.opnfv.org/gerrit/#/c/40733/ https://gerrit.opnfv.org/gerrit/#/c/40051/ https://gerrit.opnfv.org/gerrit/#/c/39925/ https://gerrit.opnfv.org/gerrit/#/c/39719/ https://gerrit.opnfv.org/gerrit/#/c/34649/ https://gerrit.opnfv.org/gerrit/#/c/39389/ https://gerrit.opnfv.org/gerrit/#/c/37989/ https://gerrit.opnfv.org/gerrit/#/c/39459/ https://gerrit.opnfv.org/gerrit/#/c/39585/ https://gerrit.opnfv.org/gerrit/#/c/39223/ https://gerrit.opnfv.org/gerrit/#/c/39229/ https://gerrit.opnfv.org/gerrit/#/c/39227/ https://gerrit.opnfv.org/gerrit/#/c/38379/ https://gerrit.opnfv.org/gerrit/#/c/39225/
opnfv/yardstick:danube.3.2	None	None	None
opnfv/functest:cvp.0.5.0	None	None	None
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:nginx.cvp.0.5.0

1.6 cvp.0.6.0 (2017/9/8)

1.6.1 Docker images used:

opnfv/dovetail:cvp.0.6.0 (commit ID 0aacdceeeac62333651ec5440fb32af965c7689e)

opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)

opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)

opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)

opnfv/testapi:cvp.0.5.0

opnfv/dovetail:web.cvp.0.6.0

opnfv/dovetail:api.cvp.0.6.0

1.6.2 Updates and problems found and fixed in this version

Image	Updates and problems found and fixed	JIRA	Gerrit
opnfv/dovetail:cvp.0.6.0	Tag dovetail with cvp.0.7.0 Disable get DB schema in Dockerfile Bugfix: sdnvpn test cases failed due to wrong module Support to run mandatory or optional test cases separately add api&web services for cvp Don't generate tar file when run without pushing results to DB Make Yardstick log level can be set by CLI Update the script for building local DB and testapi Bugfix: tar results dir cannot be parsed by web portal Replacing references to "DefCore" Updating the test specification document with iterative inprovements Dovetail tool replaces defcore with osinterop Clearer structuring current and future test scope of CVP addendum Adding a stub document for a CVP reviewer guide Clarify criteria for testcase inclusion as running in Functest/CI And additional clarifications add more information for the Identity testcases in the refstack Doc: update user guide due to add new test cases and features	DOVETAIL-516 None DOVETAIL-510 DOVETAIL-505 DOVETAIL-512 DOVETAIL-511 DOVETAIL-506 DOVETAIL-507 DOVETAIL-508 DOVETAIL-499 DOVETAIL-352 DOVETAIL-499 None DOVETAIL-408 DOVETAIL-477 DOVETAIL-431 DOVETAIL-493	https://gerrit.opnfv.org/gerrit/#/c/43575/ https://gerrit.opnfv.org/gerrit/#/c/43565/ https://gerrit.opnfv.org/gerrit/#/c/43393/ https://gerrit.opnfv.org/gerrit/#/c/43109/ https://gerrit.opnfv.org/gerrit/#/c/43411/ https://gerrit.opnfv.org/gerrit/#/c/43407/ https://gerrit.opnfv.org/gerrit/#/c/42981/ https://gerrit.opnfv.org/gerrit/#/c/43231/ https://gerrit.opnfv.org/gerrit/#/c/43131/ https://gerrit.opnfv.org/gerrit/#/c/41601/ https://gerrit.opnfv.org/gerrit/#/c/32499/ https://gerrit.opnfv.org/gerrit/#/c/42205/ https://gerrit.opnfv.org/gerrit/#/c/41241/ https://gerrit.opnfv.org/gerrit/#/c/33851/ https://gerrit.opnfv.org/gerrit/#/c/38763/ https://gerrit.opnfv.org/gerrit/#/c/34649/ https://gerrit.opnfv.org/gerrit/#/c/40369/
opnfv/yardstick:danube.3.2	None	None	None
opnfv/functest:cvp.0.5.0	None	None	None
opnfv/testapi:cvp.0.5.0	[cvp-web]correct dockerfile [cvp-web]remove useless docker-compose yaml [cvp-web]remove workflow on homepage	DOVETAIL-515 DOVETAIL-514 DOVETAIL-513	Disable get DB schema in Dockerfile	DOVETAIL-516 DOVETAIL-515	https://gerrit.opnfv.org/gerrit/#/c/4357543555/ https://gerrit.opnfv.org/gerrit/#/c/4355543529/
opnfv/yardstick:danube.3.2	None	None	None
opnfv/functest:cvp.0.5.0	None	None	None
https://gerrit.opnfv.org/gerrit/#/c/43527/
opnfv/dovetail:web.opnfv/testapi:cvp.0.56.0
opnfv/dovetail:nginxapi.cvp.0.6.0

1.7 cvp.0.7.0 (2017/9/29)

1.7.1 Docker images used:

opnfv/dovetail:cvp.0.7.0 (commit ID 043ef2dad58c3aef0ea91cf3063dc9deb6f40bd9)

opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)

opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)

opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)

opnfv/testapi:cvp.0.5.0

opnfv/dovetail:web.cvp.0.7.0

opnfv/dovetail:api.cvp.0.7.0

...

scenarios	installer	cvp.0.1.0	cvp.0.2.0	cvp.0.3.0	cvp.0.4.0	cvp.0.5.0	cvp.0.6.0
Apex Scenarios Currently Test Against
os-nosdn-nofeature-ha	Apex					https://build.opnfv.org/ci/view/dovetail/job/dovetail-apex-huawei-pod4-proposed_tests-danube/4/console PASS/total defcore: 204/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 4/6 SDNVPN: 0/4 no SDN feature	https://build.opnfv.org/ci/view/dovetail/job/dovetail-apex-huawei-pod4-proposed_tests-danube/199/consoleFull PASS/total defcore: 205/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature
Compass Scenarios Currently Test Against
os-nosdn-nofeature-ha	Compass	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-proposed_tests-danube/176/consoleFull PASS/total defcore: 204/205 HA: 7/8 tc007, SLA not passed ipv6: 25/25 SDNVPN: 0/4 no SDN feature	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/157/consoleFull PASS/total defcore: 204/205 HA: 8/8 ipv6: 25/25 SDNVPN: 0/4 no SDN feature	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/196/consoleFull PASS/total defcore: 204/205 HA: 8/8 ipv6: 25/25 SDNVPN: 0/4 no SDN feature	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-proposed_tests-danube/335/consoleFull PASS/total defcore: 204/205 HA: 8/8 vping: 2/2 ipv6: 25/25 SDNVPN: 0/4 no SDN feature resiliency: 1/1	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/288/consoleFull PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 3/6 SDNVPN: 0/4 no SDN feature	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/331/consoleFull PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature
os-odl_l2-nofeature-ha	Compass		https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/163/consoleFull PASS/total defcore: 204/205 HA: 8/8 ipv6: 25/25 SDNVPN: 0/4 no SDN feature	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/191/consoleFull PASS/total defcore: 204/205 HA: 8/8 ipv6: 17/25 SDNVPN: 0/4 no SDN feature	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-proposed_tests-danube/309/consoleFull PASS/total defcore: 204/205 HA: 7/8 vping: 2/2 ipv6: 25/25 SDNVPN: 0/4 no SDN feature resiliency: 1/1	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/304/consoleFull PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 24/25 tempest: 2/6 SDNVPN: 0/4 no SDN feature	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/335/consoleFull PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 4/5 (Failed on testing port's admin state) SDNVPN: 0/4 no SDN feature
os-odl_l3-nofeature-ha	Compass	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-proposed_tests-danube/178/consoleFull PASS/total defcore: 204/205 HA: 7/8 tc007, SLA not passed ipv6: 17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/159/consoleFull PASS/total defcore: 204/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/198/consoleFull PASS/total defcore: 204/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/243/consoleFull PASS/total defcore: 204/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature resiliency: 0/1	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/311/consoleFull PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 2/6 SDNVPN: 0/4 no SDN feature	https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/326/consoleFull PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 3/5 SDNVPN: 0/4 no SDN feature
Fuel Scenarios Currently Test Against
os-nosdn-nofeature-ha	Fuel (zte-pod1)						https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-zte-pod1-proposed_tests-danube/2/consoleFull PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 4/5 SDNVPN: 0/4 no SDN feature
os-odl_l2-bgpvpn-ha	Fuel	https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-danube/45/consoleFull PASS/total defcore: 205/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 3/4 sdnvpn.tc001 "	https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-danube/52/console PASS/total defcore: 205/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 4/4	https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-danube/71/consoleFull PASS/total defcore: 205/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 4/4
Other Scenarios
os-nosdn-kvm-ha	Apex
os-odl_l3-fdio-ha	Apex
os-onos-nofeature-ha Don't test against this scenario since Compass will not release this scenario anymore.	Compass	~~https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-proposed_tests-danube/177/consoleFull~~ ~~PASS/total~~ ~~defcore: 150/171~~ ~~HA: 7/8 tc007, SLA not passed~~ ~~ipv6: 17/25 tc018-tc025 fails~~ ~~SDNVPN: 0/4 no SDN feature~~	~~https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/160/consoleFull~~ ~~PASS/total~~ ~~defcore: 198/205~~ ~~HA: 8/8~~ ~~ipv6: 17/25 tc018-tc025 fails~~ ~~SDNVPN: 0/4 no SDN feature~~	~~https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/195/consoleFull~~ ~~PASS/total~~ ~~defcore: 198/205~~ ~~HA: 8/8~~ ~~ipv6: 17/25 tc018-tc025 fails~~ ~~SDNVPN: 0/4 no SDN feature~~	~~https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-proposed_tests-danube/307/consoleFull~~ ~~PASS/total~~ ~~defcore: 198/205~~ ~~HA: 7/8~~ ~~vping: 2/2~~ ~~ipv6: 17/25 tc018-tc025 fails~~ ~~SDNVPN: 0/4 no SDN feature~~ ~~resiliency: 0/1~~	~~https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/312/consoleFull~~ ~~PASS/total~~ ~~defcore: 198/205~~ ~~HA: 5/8~~ ~~vping: 2/2~~ ~~ipv6: 17/25 tc018-tc025 fails~~ ~~tempest: 1/6~~ ~~SDNVPN: 0/4 no SDN feature~~
os-odl_l2-nofeature-ha	Fuel(ZTE-POD1)
os-nosdn-ovs-ha	Fuel
os-odl_l3-nofeature-ha	Fuel
os-nosdn-kvm_ovs_dpdk-ha	Fuel

...

Space shortcuts

Page tree

Versions Compared

Old Version 68

New Version 69

Key

1.3 cvp.0.3.0 (2017/7/21)

1.3.1 Docker images used:

1.3.2 Updates and problems found and fixed in this version

1.4 cvp.0.4.0 (2017/8/4)

1.4.1 Docker images used:

1.4.2 Updates and problems found and fixed in this version

1.5 cvp.0.5.0 (2017/8/18)

1.5.1 Docker images used:

1.5.2 Updates and problems found and fixed in this version

1.6 cvp.0.6.0 (2017/9/8)

1.6.1 Docker images used:

1.6.2 Updates and problems found and fixed in this version

1.7 cvp.0.7.0 (2017/9/29)

1.7.1 Docker images used: