Anuket Project

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 47 Next »

 

this wiki page is used to record the running histroy for the dovetil tool.this may cover the runnning in the plugfest, CI and vendors lab.

1. Version change logs

For each dovetail release version, the docker images used are introduced first, then problems found and fixed are listed as well as the updates.

1.1 cvp.0.1.0  (2017/06/23)

1.1.1 Docker images used:

opnfv/dovetail:cvp.0.1.0 (commit ID 041a51d6d3ba5f2d9eabcf3501abb9af30ebc394)

opnfv/yardstick:danube.2.0

opnfv/functest:danube.2.0

opnfv/testapi:cvp.0.1.0 (Commit ID 056b7ccefe38b13e4b4eb11ff7e259e254e35c32)

1.1.2 Updates and problems found and fixed in this version

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.1.0
  1. https enabled checking
  2. sdnvpn path fix
  3. log improvement
  4. docker image tag with cvp.0.2.0
  1. DOVETAIL-456
  2. DOVETAIL-458
  3. DOVETAIL-450
  4. DOVETAIL-447
  1. https://gerrit.opnfv.org/gerrit/#/c/36541/
  2. https://gerrit.opnfv.org/gerrit/#/c/36785/
  3. https://gerrit.opnfv.org/gerrit/#/c/36615/
  4. https://gerrit.opnfv.org/gerrit/#/c/36775/
opnfv/yardstick:danube.2.0
  1. Bugfix: Monitor command in tc019 may not show the real nova-api service status
  2. Bugfix: "monitor_multi" type monitor in HA test case cannot get "max_recover_time"
  3. Improvement: Terminate openstack service's process using "kill" command
  4. Improvement: "monitor_process" type monitor pass criteria
  5. Bugfix: test.dbf file not deleted after execution of Disk I/O Block High Availability test
  1. YARDSTICK-655
  2. YARDSTICK-657
  3. YARDSTICK-659
  4. YARDSTICK-660
  5. YARDSTICK-696
  1. https://gerrit.opnfv.org/gerrit/#/c/34817/
  2. https://gerrit.opnfv.org/gerrit/#/c/35251/
  3. https://gerrit.opnfv.org/gerrit/#/c/36215/
  4. https://gerrit.opnfv.org/gerrit/#/c/35329/
  5. https://gerrit.opnfv.org/gerrit/#/c/36759/
opnfv/functest:danube.2.0SDNVPN test cases are not enable in FunctestNone

https://gerrit.opnfv.org/gerrit/#/c/35051/2

https://gerrit.opnfv.org/gerrit/#/c/36777/3

opnfv/testapi:cvp.0.1.0user management and some bugfixNoneNone


1.2 cvp.0.2.0 (2017/07/07)

1.2.1 Docker images used:

opnfv/dovetail:cvp.0.2.0 (commit ID 5ddf932dc28bcc47169c3091267d57ba5a99f9b2)

opnfv/yardstick:danube.3.0

opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)

opnfv/testapi:cvp.0.2.0 (commit ID a7f82c093fab2ad19c7ffb0a81ec5756e91e73ae)

1.2.2 Updates and problems found and fixed in this version

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.2.0
  1. Update IPv6 tc018-tc025: give more details and modify some misunderstanding about these test cases
  2. Delete the ERROR log when it is not https
  3. Adapt Yardstick to copy yardstick.conf to /etc/yardstick
  4. Fix the docker version to be 17.03.0-ce rather than the latest one
  1. DOVETAIL-461
  2. DOVETAIL-462
  3. DOVETAIL-466
  4. DOVETAIL-467
  1. https://gerrit.opnfv.org/gerrit/#/c/37229/
  2. https://gerrit.opnfv.org/gerrit/#/c/37449/
  3. https://gerrit.opnfv.org/gerrit/#/c/37737/
  4. https://gerrit.opnfv.org/gerrit/#/c/37813/
opnfv/yardstick:danube.3.0
  1. Support ignoring server certificate
  2. Add debug log for recovering service failure
  3. Improve method to kill keystone process
None
  1. https://gerrit.opnfv.org/gerrit/#/c/36377/
opnfv/functest:cvp.0.2.0NoneNoneNone
opnfv/testapi:cvp.0.2.0
  1. role based access control and result upload
  2. testapi tox bugfix
  3. some bugfix
  1. None
  2. None
  3. RELENG-281 
    RELENG-212 
    FUNCTEST-694 
    RELENG-213  
  1. https://gerrit.opnfv.org/gerrit/#/c/37053/
    https://gerrit.opnfv.org/gerrit/#/c/37839/
  2. https://gerrit.opnfv.org/gerrit/#/c/37459/
  3. https://gerrit.opnfv.org/gerrit/#/c/37765/
    https://gerrit.opnfv.org/gerrit/#/c/37723/
    https://gerrit.opnfv.org/gerrit/#/c/37711/

1.3 cvp.0.3.0 (2017/7/21)

1.3.1 Docker images used:

opnfv/dovetail:cvp.0.3.0 (commit ID 7ed1cf189676693d84c9d48bb964c178b16bae76)

opnfv/yardstick:danube.3.1

opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)

opnfv/testapi:cvp.0.3.0 (commit ID 4e0b74b0141e3ae5d250006f3d75fcc880738cc9)

1.3.2 Updates and problems found and fixed in this version

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.3.0
  1. Add docs about vping test cases (test scope and test specification)
  2. Add 2 vping test cases (vping.tc001->vping_userdata, vping_tc002->vping_ssh) into proposed_tests
  3. Bugfix: Build docker image failed because of lacking of packages
  4. Add resiliency.tc001 into proposed_tests
  1. None
  2. DOVETAIL-446
  3. DOVETAIL-475
  4. DOVETAIL-474
  1. https://gerrit.opnfv.org/gerrit/#/c/36253/
  2. https://gerrit.opnfv.org/gerrit/#/c/37853/
  3. https://gerrit.opnfv.org/gerrit/#/c/38573/
  4. https://gerrit.opnfv.org/gerrit/#/c/38713/
opnfv/yardstick:danube.3.1NoneNoneNone
opnfv/functest:cvp.0.2.0NoneNoneNone
opnfv/testapi:cvp.0.3.0  

 

1.4 cvp.0.4.0 (2017/8/4)

1.4.1 Docker images used:

opnfv/dovetail:cvp.0.4.0 (commit ID )

opnfv/yardstick:danube.3.1

opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)

opnfv/testapi:cvp.0.4.0 (commit ID )

opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)

1.4.2 Updates and problems found and fixed in this version

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.4.0   
opnfv/yardstick:danube.3.1   
opnfv/functest:cvp.0.2.0   
opnfv/testapi:cvp.0.4.0   
opnfv/bottlenecks:cvp.0.4.0   

 


2. Running by CI

in order to make the dovetail tool  more stable, the dovetail has been integreated in the CI for daily running.

for more detil, please refer to link: https://build.opnfv.org/ci/view/dovetail/

 

 

3. Running against scenarios by owners

scenariosinstallerownerscvp.0.1.0cvp.0.2.0cvp.0.3.0
os-nosdn-nofeature-ha   Apex    
os-nosdn-kvm-ha    Apex    
 os-odl_l3-fdio-ha  Apex    
os-odl_l2-nofeature-ha Compass  

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/163/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 8/8

ipv6: 25/25

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/191/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 8/8

ipv6: 17/25

SDNVPN: 0/4 no SDN feature

os-nosdn-nofeature-ha Compass 

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-proposed_tests-danube/176/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 7/8 tc007, SLA not passed

ipv6: 25/25

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/157/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 8/8

ipv6: 25/25

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/196/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 8/8

ipv6: 25/25

SDNVPN: 0/4 no SDN feature

os-onos-nofeature-ha Compass 

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-proposed_tests-danube/177/consoleFull

PASS/total

defcore: 150/171

HA: 7/8 tc007, SLA not passed

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/160/consoleFull

PASS/total

defcore: 198/205

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/195/consoleFull

PASS/total

defcore: 198/205

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

os-odl_l3-nofeature-ha Compass 

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-proposed_tests-danube/178/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 7/8 tc007, SLA not passed

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/159/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-proposed_tests-danube/198/consoleFull

PASS/total

defcore: 204/205

tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume  FAIL

This can be solved by manually set "volume_device_name" in refstack configuration file

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 0/4 no SDN feature

os-nosdn-ovs-ha Fuel    
os-odl_l2-bgpvpn-ha Fuel 

https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-danube/45/consoleFull

PASS/total

defcore: 205/205

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 3/4 sdnvpn.tc001 "

VPN provides connectivity between Neutron subnets" fails

https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-danube/52/console

PASS/total

defcore: 205/205

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 4/4

https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-danube/71/consoleFull

PASS/total

defcore: 205/205

HA: 8/8

ipv6: 17/25 tc018-tc025 fails

SDNVPN: 4/4

os-odl_l2-nofeature-haFuel(ZTE-POD1)    
os-odl_l3-nofeature-ha Fuel    
os-nosdn-nofeature-haFuel    
os-nosdn-kvm_ovs_dpdk-haFuel    

 

 

4. try by vendors

After the plugfest, there are new updates for the dovetail tool. in order to test the dovetail tool soffhietly, more vendors are encouraged to try. if you are interested in the dovetail try, please add your company here.

companycloudOSfeedbacks
ZTEZTE TECS 
Wind River   
HuaweiFS 
Redhat  

 

 

 

5. Running in the OPNFV plugfest(orange)

 

hardware
installer
scenarios
dovetail test cases
results
owner
Nokia hardwareapexos-nosdn-nofeature-hadefcore and IPV6
only one faill: (failing test):
         tempest.api.compute.volumes.test_attach_volume.Attach
VolumeTestJSON.test_attach_detach_volume                  FAIL
 
Note: This can be solved by manually set "volume_device_name" in refstack configuration file tempest.conf according
to the platform, it's a hard-coded configuration in functest, actually.
volume_device_name = vdb or vdc or others
Rautakumpu, Mika
Huawei hardwarecompassos-nosdn-nofeature-hadefcore and IPV6all passhongbo tian
lenovoJoidos-nosdn-nofeature-hadefcore and IPV6all passNarinder Gupta
lenovo Wind River Titanium 3 based on Mitaka with AVSdefcore and IPV6all passRaineri, Eddy

 

 

 

 

  • No labels