Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

WARNING: This page is not currently maintained. Test areas will be defined in the test strategy document (being developed in this Gerrit proposal and tracked in this JIRA ticket - see current draft document), and specific test cases will be discussed and included in the Dovetail JIRA and Gerrit repository

This is the list of candidate test areas which have been proposed by community members for addition to the Dovetail test suite. These test areas will be evaluated under the Dovetail test case requirements, proposed for inclusion as patches in Gerrit against Dovetail, and reviewed by the Dovetail maintainers. Once approved, they will become part of the Dovetail test suite.tochave been proposed by community members for addition to the Dovetail test suite. These test areas will be evaluated under the Dovetail test case requirements, proposed for inclusion as patches in Gerrit against Dovetail, and reviewed by the Dovetail maintainers. Once approved, they will become part of the Dovetail test suite.

Table of Contents

Brainstorming

This section is intended to help us get to quick consensus on the test priorities for Danube. The rest of the content of this page will be updated to be aligned with this section.

This is intended to help us discuss and collaboratively edit a set of priorities for the dovetail program in OPNFV.
  • This is itself a strawman proposal for how we can discuss this important topic. Alternatives are welcome, although the basic goal is that we can come to collaborative consensus as quickly as possible, with minimal barriers to participation in the discussion.
Also see:
High
  • Component verification: leverage all available tests to validate functional/API/etc capabilities of component distros
  • NFVI+VIM: start with well-established aspects of NFVI+VIM
  • Reference VNF portability: demonstrate portability and consistent operation for an ever-expanding suite of reference VNFs, which have been verified for most/all OPNFV distros
  • vIMS
  
  • Cross-controller dependent OPNFV features: verify operation of features that depend upon coordinated use of multiple components
  • SFC
  • Broadly supported OPNFV features: focus on features that are support in many/most distros and hardware platforms
        
Medium
  • Reliability: operation/performance under stress e.g. load and chaos
  • Performance: benchmarking
  • Security: static scans (vulnerabilities, licenses) and response to threats in operation
  • Infra lifecycle: deployment and day-2 operations
  • MANO: MANO-stack interop
Low
  • Narrowly-supported features: any features that are distro or hardware platform specific
  • Application (e.g. VNF) compliance with standards: while we may leverage reference VNFs as typical use cases their use should focus entirely upon verifying that the NFVI etc implementations result in a consistent user experience. The "user" in this case is the service provider, and consistency does not extend to whether the VNF itself or how it is operated adheres to any standards-based expectation on functionality.

Details on Test Areas

VIM Operations on Compute

...

The Gerrit reference for this test area: https://gerrit.opnfv.org/gerrit/#/c/27509

Link to the introduction of IPv6 test cases status: Ipv6 Test Cases Status

IDTypeTest CaseDescriptionPre-condition & requirementsStatusGerrit References
1IPv6Test Case 1: Create and Delete an IPv6 Network, Port and SubnetTo test if Create and Delete an IPv6 Network, Port and Subnet is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
2IPv6Test Case 2: Create, Update and Delete an IPv6 Network and SubnetTo test if Create, Update and Delete an IPv6 Network and Subnet is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
3IPv6Test Case 3: Check External Network VisibilityTo test if Check External Network Visibility is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
4IPv6Test Case 4: List IPv6 Networks and Subnets of a TenantTo test if List IPv6 Networks and Subnets of a Tenant is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
5IPv6Test Case 5: Show Information of an IPv6 Network and SubnetTo test if Show Information of an IPv6 Network and Subnet is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
6IPv6Test Case 6: Create an IPv6 Port in Allowed Allocation PoolsTo test if Create an IPv6 Port in Allowed Allocation Pools is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
7IPv6Test Case 7: Create an IPv6 Port without Security GroupsTo test if Create an IPv6 Port without Security Groups is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
8IPv6Test Case 8: Create, Update and Delete an IPv6 PortTo test if Create, Update and Delete an IPv6 Port is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
9IPv6Test Case 9: List IPv6 Ports of a TenantTo test if List IPv6 Ports of a Tenant is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
10IPv6Test Case 10: Show Information of an IPv6 PortTo test if Show Information of an IPv6 Port is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
11IPv6Test Case 11: Add Multiple Interfaces for an IPv6 RouterTo test if Add Multiple Interfaces for an IPv6 Router is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
12IPv6Test Case 12: Add and Remove an IPv6 Router Interface with port_idTo test if Add and Remove an IPv6 Router Interface with port_id is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
13IPv6Test Case 13: Add and Remove an IPv6 Router Interface with subnet_idTo test if Add and Remove an IPv6 Router Interface with subnet_id is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
14IPv6Test Case 14: Create, Update, Delete, List and Show an IPv6 RouterTo test if Create, Update, Delete, List and Show an IPv6 Router is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
15IPv6Test Case 15: Create, Update, Delete, List and Show an IPv6 Security GroupTo test if Create, Update, Delete, List and Show an IPv6 Security Group is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
16IPv6Test Case 16: Create, Delete and Show Security Group RulesTo test if Create, Delete and Show Security Group Rules is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
17IPv6Test Case 17: List All Security GroupsTo test if List All Security Groups is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
18IPv6Test Case 18: IPv6 Address Assignment - DHCPv6 StatelessTo test if IPv6 Address Assignment - DHCPv6 Stateless is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
19IPv6Test Case 19: IPv6 Address Assignment - Dual Stack, DHCPv6 StatelessTo test if IPv6 Address Assignment - Dual Stack, DHCPv6 Stateless is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
20IPv6Test Case 20: IPv6 Address Assignment - Multiple Prefixes, DHCPv6 StatelessTo test if IPv6 Address Assignment - Multiple Prefixes, DHCPv6 Stateless is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
21IPv6Test Case 21: IPv6 Address Assignment - Dual Stack, Multiple Prefixes, DHCPv6 StatelessTo test if IPv6 Address Assignment - Dual Stack, Multiple Prefixes, DHCPv6 Stateless is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
22IPv6Test Case 22: IPv6 Address Assignment - SLAACTo test if IPv6 Address Assignment - SLAAC is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
23IPv6Test Case 23: IPv6 Address Assignment - Dual Stack, SLAACTo test if IPv6 Address Assignment - Dual Stack, SLAAC is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
24IPv6Test Case 24: IPv6 Address Assignment - Multiple Prefixes, SLAACTo test if IPv6 Address Assignment - Multiple Prefixes, SLAAC is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
25IPv6Test Case 25: IPv6 Address Assignment - Dual Stack, Multiple Prefixes, SLAACTo test if IPv6 Address Assignment - Dual Stack, Multiple Prefixes, SLAAC is OK.VIM: Openstack Components: Keystone, Nova, Neutron, Glance Special Requirements: ipv6 network configuration  
26IPv6Test Case 26: Service VM as an IPv6 vRouterOPNFV_YARDSTICK_TC027
To do a basic verification that IPv6 connectivity is within acceptable boundaries when ipv6 packets travel between hosts located on same or different compute blades.
Colorado Scenario: nosdn, nofeature
VIM: Openstack
Components: Keystone, Nova, Neutron, Glance
SDN: not support SDN
  

...