Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: update the sequence

this wiki page is used to record the running histroy for the dovetil tool.this may cover the runnning in the plugfest, CI and vendors lab.

Table of Contents

1.

...

 

...

hardware

...

installer

...

scenarios

...

dovetail test cases

...

results

...

owner

...

only one faill: (failing test):
         tempest.api.compute.volumes.test_attach_volume.Attach
VolumeTestJSON.test_attach_detach_volume                  FAIL
Note: This can be solved by manually set "volume_device_name"
in refstack configuration file tempest.conf according
to the platform, it's a hard-coded configuration in functest, actually.
volume_device_name = vdb or vdc or others

Version change logs

for each dovetail release version, the docker images used are introduced first, then problems found and fixes

are listed.

1.1 cvp.0.1.0  (2017/06/23)

1.1.1 docker images used:

opnfv/dovetail:cvp.0.1.0 (commit ID 041a51d6d3ba5f2d9eabcf3501abb9af30ebc394)

opnfv/yardstick:danube.2.0

opnfv/functest:danube.2.0

opnfv/testapi:cvp.0.1.0 (Commit ID 056b7ccefe38b13e4b4eb11ff7e259e254e35c32)

1.1.2 problems found and fixes in this version

problems found and fixes in opnfv/dovetail:cvp.0.1.0

1)https checking support for commercial SUT

JIRA:DOVETAIL-456

2)sdnvpn path fix

JIRA:DOVETAIL-458

 

problems found and fixes in opnfv/yardstick:danube.2.0 for HA test cases in yardstick consumed by dovetail

1). Bugfix: Monitor command in tc019 may not show the real nova-api service status

   JIRA:YARDSTICK-655

2). Bugfix: "monitor_multi" type monitor in HA test case cannot get "max_recover_time"

   JIRA:YARDSTICK-657

3). Improvement: Terminate openstack service's process using "kill" command

   JIRA:YARDSTICK-659

4). Improvement: "monitor_process" type monitor pass criteria

   JIRA:YARDSTICK-660

5). Bugfix: test.dbf file not deleted after execution of Disk I/O Block High Availability test

   JIRA:YARDSTICK-696

 

problems found and fixes in  opnfv/functest:danube.2.0 

for SDNVPN test cases in functest consumed by dovetail 

https://gerrit.opnfv.org/gerrit/#/c/36777/

 

problems found and fixes in  opnfv/testapi:cvp.0.1.0

user management and some bugfix

1.2 cvp.0.2.0 (in plan)

1.2.1 docker images used:

opnfv/dovetail:cvp.0.2.0 (commit ID 5ddf932dc28bcc47169c3091267d57ba5a99f9b2)

opnfv/yardstick:danube.3.0

opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)

opnfv/testapi:cvp.0.2.0 (commit ID a7f82c093fab2ad19c7ffb0a81ec5756e91e73ae)

...

 

2. Running by CI

in order to make the dovetail tool  more stable, the dovetail has been integreated in the CI for dayly running.

...

companycloudOSfeedbacks
ZTEZTE TECS 
Wind River   
HuaweiFS 
Redhat  

 

5. Version change logs

for each dovetail release version, the docker images used are introduced first, then problems found and fixes

are listed.

5.1 cvp.0.1.0  (2017/06/23)

5.1.1 docker images used:

opnfv/dovetail:cvp.0.1.0 (commit ID 041a51d6d3ba5f2d9eabcf3501abb9af30ebc394)

opnfv/yardstick:danube.2.0

opnfv/functest:danube.2.0

opnfv/testapi:cvp.0.1.0 (Commit ID 056b7ccefe38b13e4b4eb11ff7e259e254e35c32)

5.1.2 problems found and fixes in this version

problems found and fixes in opnfv/dovetail:cvp.0.1.0

1)https checking support for commercial SUT

JIRA:DOVETAIL-456

2)sdnvpn path fix

JIRA:DOVETAIL-458

 

problems found and fixes in opnfv/yardstick:danube.2.0 for HA test cases in yardstick consumed by dovetail

1). Bugfix: Monitor command in tc019 may not show the real nova-api service status

   JIRA:YARDSTICK-655

2). Bugfix: "monitor_multi" type monitor in HA test case cannot get "max_recover_time"

   JIRA:YARDSTICK-657

3). Improvement: Terminate openstack service's process using "kill" command

   JIRA:YARDSTICK-659

4). Improvement: "monitor_process" type monitor pass criteria

   JIRA:YARDSTICK-660

5). Bugfix: test.dbf file not deleted after execution of Disk I/O Block High Availability test

   JIRA:YARDSTICK-696

 

problems found and fixes in  opnfv/functest:danube.2.0 

for SDNVPN test cases in functest consumed by dovetail 

https://gerrit.opnfv.org/gerrit/#/c/36777/

 

problems found and fixes in  opnfv/testapi:cvp.0.1.0

user management and some bugfix

5.2 cvp.0.2.0 (in plan)

5.2.1 docker images used:

opnfv/dovetail:cvp.0.2.0 (commit ID 5ddf932dc28bcc47169c3091267d57ba5a99f9b2)

opnfv/yardstick:danube.3.0

opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)

 

 

5. Running in the OPNFV plugfest(orange)

 

hardware
installer
scenarios
dovetail test cases
results
owner
Nokia hardwareapexos-nosdn-nofeature-hadefcore and IPV6
only one faill: (failing test):
         tempest.api.compute.volumes.test_attach_volume.Attach
VolumeTestJSON.test_attach_detach_volume                  FAIL
 
Note: This can be solved by manually set "volume_device_name" in refstack configuration file tempest.conf according
to the platform, it's a hard-coded configuration in functest, actually.
volume_device_name = vdb or vdc or others
Rautakumpu, Mika
Huawei hardwarecompassos-nosdn-nofeature-hadefcore and IPV6all passhongbo tian
lenovoJoidos-nosdn-nofeature-hadefcore and IPV6all passNarinder Gupta
lenovo Wind River Titanium 3 based on Mitaka with AVSdefcore and IPV6all passRaineri, Eddy

 opnfv/testapi:cvp.0.2.0 (commit ID a7f82c093fab2ad19c7ffb0a81ec5756e91e73ae)