Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: add the dovetail summary

The slide deck Wenjing used on day-1 Plugfest: https://docs.google.com/presentation/d/1IAL6DzMF5EMhzLfikH_tTDQvC0gccfJRQ5ipzwQx4QE/edit?usp=sharing

Please use this etherpad for real-time feedbacks, bug reports, improvement suggestions, and the daily scrubs during the PlugFest week:

https://etherpad.opnfv.org/p/plugfest_dovetailtesting

And this etherpad for meeting discussion notes: https://etherpad.opnfv.org/p/cvp_tooling_sketch

testing proposal for the dovetail:

 

user guide link : Dovetail Testing Guide

https://gerrit.opnfv.org/gerrit/#/c/33367/1 from trevor

https://gerrit.opnfv.org/gerrit/#/c/32499  from Chris

https://jira.opnfv.org/browse/DOVETAIL-352
worksheet: Dovetail Test Area / Test Case Worksheet and latest in https://gerrit.opnfv.org/gerrit/#/c/33319/1

HA: High availability testing (cooperate with the Yardstick team)

https://wiki.opnfv.org/display/sdnvpn/SDNVPN+Testing#SDNVPNTesting-TestcompliancetemplateforDovetail

----------

Dovetail PlugFest activities and desired outcome:

1. Test toolchain and work flow validation

Pre-requisite:

  • a dovetail client software (alpha version) available prior to the start of the PlugFest
  • a LF-hosted web server / DB available for testing purpose
  • A draft of test strategy document: at least the tester guide sections

Desired outcome of the validation

  • confirmation of the work flow's validity, or JIRA tickets to fix issues
  • confirmation of dovetail client software feature completeness, or JIRA tickets to enhance or fix issues
  • any feedback to web server / DB and feature enhancements

2. Validating draft test suite and test toolchain on a varieties of hardware and software stack combinations (scenarios)

Pre-requiste:

  • Same as above

Desired outcome

  • Testing dovetail on one or more hardware (inc. network) configurations
  • Testing dovetail on more than one scenarios/installers (details in the table below)
  • If vendor software available, test dovetail on vendor distributions. (this can also happen in private lab environment remotely)

3. Review of the documentation to be released with cvp

The test user guide: How to prepare a system, run the test suite, and validate the results

4. Review of test areas

Possible areas include sdn controllers, ha, ipv6, sdnvpn, ...

-------------

results:

hardwareinstallerscenariosdovetail test casesresultsowner
Nokia hardwareapexos-nosdn-nofeature-hadefcore and IPV6
only one faill: (failing test):
         tempest.api.compute.volumes.test_attach_volume.Attach
VolumeTestJSON.test_attach_detach_volume                  FAIL
Rautakumpu, Mika
Huawei hardwarecompassos-nosdn-nofeature-hadefcore and IPV6all passhongbo tian
lenovoJoidos-nosdn-nofeature-hadefcore and IPV6all pass Narinder Gupta
lenovo Wind River Titanium 3 based on Mitaka with AVSdefcore and IPV6all passRaineri, Eddy

 

 

PlugFest testing proposal for Dovetail:

<=Please edit the table below to plan for Dovetail testing during the PlugFest at Orange=>

the table below shows the dovetail  test planning. on each Pod, the CloudOS can be deployed such as Danube and Wind River Titanium 3.

it wil take 2 hours to install the dovetail tool and 1 hour to run that. once the dovetail tool is deployed, it can run several times.

for the end of each day, there will be short summary meeting for the test results revew and feedbacks.


Huawei POD(onsite)(installer: joid) on Tuesday (one scenario)

time slotesdovetail( owner: hongbo)scenarioes deployment(owner: Narinder Gupta)
8:00-10:00Dovetail deployment (about 2 hours)(os-nosdn-nofeature-ha) deployment (about 2 hours)
10:00-11:00Dovetail running( refstack about 1 hour) 
   
   
17:00-18:00summary and feedback on Work Area C


Huawei POD(onsite)(installer: Compass) on Wensday( two scenarioes)

time slotesdovetail(owner: hongbo)scenarioes deployment(owner:hongbo)
8:00-10:00Dovetail deployment (2 hours)(os-nosdn-nofeature-ha) deployment (2 hours)
10:00-11:00Dovetail running(refstack test cases,about 1 hour) 
 11:00-14:00  Danube 1.0 os-odl_l2-nofeature-ha (2 hours)
14:00-15:00dovetail running(refstack test cases, about 1 hour) 
   

 

Huawei POD(onsite) on Thursday (Comarcial CloudOS)

time slotesdovetail(owner:Raineri, Eddy )scenarioes deployment(owner:Raineri, Eddy)
8:00-10:00Dovetail deployment (2 hours) 
   
 13:00-16:00 Wind River Titanium 3 based on Mitaka with AVS deployment (2 hours)
16:00-17:00dovetail running( refstack, about 1 hour ) 
   

Intel POD(onsite) on( one scenario) ( share the pod with yardstick testing )

time slotesdovetail(owner: hongbo)scenarioes deployment(owner: Brattain, Ross B)
8:00-10:00Dovetail deployment (2 hours)(os-nosdn-nofeature-ha) deployment (2 hours)
10:00-11:00Dovetail running(refstack, about 1 hour) 
 11:00-14:00  
14:00-15:00  
 15:00-17:00  

 

lenovo GP POD (remote)(installer: Apex) on Tuesday

time slotesdovetail(owner: Tim Rozet)scenarioes deployment(owner: Tim Rozet)
8:00-10:00Dovetail deployment ( 2 hours)os-nosdn-nofeature-ha deployment (2 hours)
10:00-11:00Dovetail running( refstack, about 1 hour) 
 11:00-14:00  
14:00-15:00  
 15:00-17:00  

 

Nokia POD(onsite)(installer: apex(Triple-O Danube)) on Monday (one scenarioes)

time slotesdovetail(owner: Rautakumpu, Mika)scenarioes deployment(owner: Rautakumpu, Mika)
8:00-10:00Dovetail deployment (2 hours)os-nosdn-nofeature-ha deployment ( 2 hours)
10:00-11:00Dovetail running ( refstack, 1 hour) 
 11:00-14:00  
14:00-15:00  
 15:00-17:00  

 

Advantech POD(onsite)(installer: Fuel) on Thursday

 Full based Danube primary region with a Titanium Cloud release 3 secondary region in 

Taibei is ongoing (4/18)

time slotesdovetail(owner: Eric.vanVliet)scenarioes deployment(owner: Eric.vanVliet)
8:00-10:00Dovetail deployment ( 2 hours)os-nosdn-nofeature-ha deployment ( 2 hours)
10:00-11:00Dovetail running ( refstack, about 1 hour) 
 11:00-14:00 SFC related scenarioes
14:00-15:00Dovetail running ( refstack and SFC, about 1 hour) 
 15:00-17:00  
HardwareVIM+NFVI Software :: ScenarioInstallerLocationDovetail test plan 
Huawei POD

compass:

Danube 1.0 os-nosdn-nofeature-ha

Danube 1.0 os-odl_l2-nofeature-ha,

Colorado 3.0 ?

Joid:

os-nosdn-nofeature-ha,nosdn-lxd-ha

compass and joidOnsite4/25,4/26 
Intel POD
hardwarecloudOSinstaller dovetail
HuaweiDanube/windriver?compass?apex? yes
IntelDanube/windriver?compass?apex?joid?remote  
Nokia POD

Danube

/windriver?
compass?apex?  
Lenovo Danube/windriver?compass?apex?  

os-nosdn-nofeature-ha

apex(Triple-O Danube)onsite4/24 
Lenovo GP PODDanube os-nosdn-nofeature-ha apex(Triple-O Danube)remote4/25 
Lenovo OCP POD1

Danube os-nosdn-nofeature-ha

joid(Danube)remotetime(TBD) 
Lenovo OCP POD2Wind River Titanium 3 based on Mitaka with AVSWR TiSremotetime(TBD) 

Wind River lab ( Intel Sandybridge - Intel Xeon-D

processors with Niantic and Fortville nics)

Wind River Titanium 3 based on Mitaka with AVS

 remote  

Wind River lab ( Intel Sandybridge - Intel Xeon-

D processors with Niantic and Fortville nics)

Danube 1.0    
Advantech (Advantech Danube-Plugfest)

Wind River Titanium 3 based on Mitaka with AVS

Fuelonsite4/27(VPN and SFC related scenarioes) 
Advantech (Advantech Danube-Plugfest)Danube 1.0  AdvantechDanube/windriver?compass?apex?  
OrangeDanube/windriver?compass?apex?joid?remote  
NECDanube/windriver?compass?apex?joid? remote  

session: 

hardware?windriver

...

 

Compliance Testing - performance

1 hour

Trevor Cooper

Image Removed

Image Removed

Image Removed

Unknown User (hongbotian)

CVP for E release will include "performance" compliance tests ... lets focus on what this means and discuss requirements/methods/tools/etc.

 

 

dovetail testing on

Thursday(pre-test will be done

before the dovetail testing.

(provide own hardware)

 

 

feedback: https://etherpad.opnfv.org/p/plugfest_dovetailtesting

HackFest dovetail meeting sessions: 

Danube Plugfest/Hackfest planning page