Versions Compared

Old Version 51

changes.mady.by.user Dan Xu

Saved on

compared with

New Version 52

changes.mady.by.user Dan Xu

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

1.3 cvp.0.3.0 (2017/7/21)

1.3.1 Docker images used:

opnfv/dovetail:cvp.0.3.0 (commit ID 7ed1cf189676693d84c9d48bb964c178b16bae76)

opnfv/yardstick:danube.3.1

opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)

opnfv/testapi:cvp.0.3.0 (commit ID 4e0b74b0141e3ae5d250006f3d75fcc880738cc9)

1.3.2 Updates and problems found and fixed in this version

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.3.0
  1. Add docs about vping test cases (test scope and test specification)
  2. Add 2 vping test cases (vping.tc001->vping_userdata, vping.tc002->vping_ssh) into proposed_tests
  3. Bugfix: Build docker image failed because of lacking of packages
  4. Add resiliency.tc001 into proposed_tests
  1. None
  2. DOVETAIL-446
  3. DOVETAIL-475
  4. DOVETAIL-474
  1. https://gerrit.opnfv.org/gerrit/#/c/36253/
  2. https://gerrit.opnfv.org/gerrit/#/c/37853/
  3. https://gerrit.opnfv.org/gerrit/#/c/38573/
  4. https://gerrit.opnfv.org/gerrit/#/c/38713/
opnfv/yardstick:danube.3.1NoneNoneNone
opnfv/functest:cvp.0.2.0NoneNoneNone
opnfv/testapi:cvp.0.3.0
  1. Add Linux Foundation ID as account provider
  2. Upload multi results in one time
  3. Submit results to CVP to review
  4. Results are grouped by test id
  5. Add details for each test
NoneNone

 

1.4 cvp.0.4.0 (2017/8/4)

1.4.1 Docker images used:

opnfv/dovetail:cvp.0.4.0 0 (commit ID a8d7665ca783684bc10d7c3dbbc606e30f083bc7)

opnfv/yardstick:danube.3.1

opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)

opnfv/testapi:cvp.0.4.0 0

opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)

1.4.2 Updates and problems found and fixed in this version

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.4.0   
opnfv/yardstick:danube.3.1   
  1. Bugfix: wrong command in function 'check_https_enabled'
  2. Use opnfv/functest:cvp.0.
2
  1. 5.0
   
opnfv/testapi:cvp.0.4.0   
opnfv/bottlenecks:cvp.0.4.0   

 

2. Running by CI

in order to make the dovetail tool  more stable, the dovetail has been integreated in the CI for daily running.

for more detil, please refer to link: https://build.opnfv.org/ci/view/dovetail/

 

 

3. Running against scenarios by owners

  1. and do some adaptions in dovetail tool
  2. Create a tar file for all logs
  3. Add tempest test cases into proposed_tests
  4. Fix testapi base_url for public_url
  5. Add user guide for results operations on web
  6. Add nginx to host static files
  1. DOVETAIL-482
  2. DOVETAIL-480
  3. DOVETAIL-479
  4. DOVETAIL-478
  5. None
  6. DOVETAIL-471
  7. DOVETAIL-485
  1. https://gerrit.opnfv.org/gerrit/#/c/39393/
  2. https://gerrit.opnfv.org/gerrit/#/c/39221/
  3. https://gerrit.opnfv.org/gerrit/#/c/38891/
  4. https://gerrit.opnfv.org/gerrit/#/c/38835/
  5. https://gerrit.opnfv.org/gerrit/#/c/38823/
  6. https://gerrit.opnfv.org/gerrit/#/c/38065/
  7. https://gerrit.opnfv.org/gerrit/#/c/39489/
opnfv/yardstick:danube.3.1Bugfix: cannot run task if without yardstick.conf in danubeYARDSTICK-776https://gerrit.opnfv.org/gerrit/#/c/38955/
opnfv/functest:cvp.0.2.0
  1. Remove functest repo and only python module have been installed
  2. Functest Docker image will not host any OS images
  3. Add a dedicated file to configure extra params in tempest.conf

  1. FUNCTEST-836

  2. None

  3. FUNCTEST-860

  1. https://gerrit.opnfv.org/gerrit/#/c/35813/
    https://gerrit.opnfv.org/gerrit/#/c/36163/
  2. https://gerrit.opnfv.org/gerrit/#/c/37373/
  3. https://gerrit.opnfv.org/gerrit/#/c/39019/
opnfv/testapi:cvp.0.4.0   
opnfv/bottlenecks:cvp.0.4.0   

 

1.5 cvp.0.5.0 (2017/8/18)

1.4.1 Docker images used:

opnfv/dovetail:cvp.0.5.0 (commit ID 474795c11c556dcd325559853fe7ed436a69418c)

opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)

opnfv/functest:cvp.0.5.0  (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)

opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)

opnfv/testapi:cvp.0.5.0 

opnfv/dovetail:nginx.cvp.0.5.0


2. Running by CI

in order to make the dovetail tool  more stable, the dovetail has been integreated in the CI for daily running.

for more detil, please refer to link: https://build.opnfv.org/ci/view/dovetail/

 

 

3. Running against scenarios by owners

scenariosinstallerownerscvp.0.1.0cvp.0.2.0cvp.0.3.0cvp.0.4.0
scenariosinstallerownerscvp.0.1.0cvp.0.2.0cvp.0.3.0cvp.0.4.0
os-nosdn-nofeature-ha   Apex     
os-nosdn-kvm-ha    Apex     
 os-odl_l3-fdio-ha  Apex     -ha  Apex     
os-odl_l2-nofeature-ha Compass  

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/163/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 8/8

ipv6: 25/25

SDNVPN: 0/4 no SDN feature

os-odl_l2-nofeature-ha Compass  

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/163191/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 8/8

ipv6: 2517/25

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetalvirtual-proposed_tests-danube/191309/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 7/8

vping: 2/82

ipv6: 1725/25

SDNVPN: 0/4 no SDN featureSDN feature

resiliency: 1/1

os-nosdn-nofeature-ha Compass 

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-proposed_tests-danube/309176/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 7/8 vping: 2/2tc007, SLA not passed

ipv6: 25/25

SDNVPN: 0/4 no SDN feature

resiliency: 1/1

os-nosdn-nofeature-ha Compass 

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtualbaremetal-proposed_tests-danube/176157/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 78/8 tc007, SLA not passed

ipv6: 25/25

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/157196/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 8/8

ipv6: 25/25

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetalvirtual-proposed_tests-danube/196335/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 8/8

vping: 2/2

ipv6: 25/25

SDNVPN: 0/4 no SDN feature

 

resiliency: 1/1

os-onos-nofeature-ha Compass 

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-proposed_tests-danube/177/consoleFull

PASS/total

defcore: 150/171

HA: 7/8 tc007, SLA not passed

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/160/consoleFull

PASS/total

defcore: 198/205

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/195/consoleFull

PASS/total

defcore: 198/205

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

 https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-proposed_tests-danube/307/consoleFull

PASS/total

defcore: 198/205

HA: 7/8

vping: 2/2

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

resiliency: 0/1

os-odl_l3-nofeature-ha Compass 

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-proposed_tests-danube/178/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 7/8 tc007, SLA not passed

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/159/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/198/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/243/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 8/8

vping: 2/2

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

resiliency: 0/1

os-nosdn-ovs-ha Fuel     
os-odl_l2-bgpvpn-ha Fuel 

https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-danube/45/consoleFull

PASS/total

defcore: 205/205

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 3/4 sdnvpn.tc001 "

VPN provides connectivity between Neutron subnets" fails

https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-danube/52/console

PASS/total

defcore: 205/205

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 4/4

https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-danube/71/consoleFull

PASS/total

defcore: 205/205

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 4/4

 
os-odl_l2-nofeature-haFuel(ZTE-POD1)     
os-odl_l3-nofeature-ha Fuel     
os-nosdn-nofeature-haFuel     
os-nosdn-kvm_ovs_dpdk-haFuel     

...