Candidate Dovetail test use cases

This is the list of candidate test cases which have been proposed by community members for addition to the Dovetail test suite. These test cases will be evaluated under the Dovetail test case requirements, proposed for inclusion as patches in Gerrit against Dovetail, and reviewed by the Dovetail maintainers. Once approved, they will become part of the Dovetail test suite.

Basic VIM operations

id	test case	Suite	Description	status	comments
1	Add/Delete image	VIM operations	OpenStack Glance test using Tempest	draft	etherpad
2	Query/list images	VIM operations	do(for openstack, there are 2 kinds of images related, 1st the nova, compute-images-create/delete/get/list, 2nd Glance, images-v2-remove/update/share/list/delete/get, MatthewLi )
3	Create/Delete network	VIM operations	OpenStack Network(Neutron) test using Tempest
4	Create/Delete subnet	VIM operations	do
5	Create/Delete port	VIM operations	do
6	Start an instance	VIM operations	Start a VM/container, verify that it comes up / OpenStack Nova Tempest test
7	Stop an instance	VIM operations	Stop a VM/container, verify that it goes down/ / OpenStack Nova Tempest test
8	Show server details	VIM operations
9	List servers	VIM operations
	Update server	VIM operations
	Create server	VIM operations
	Delete server	VIM operations
	Update metadata items	VIM operations
	Stop and start server	VIM operations
	Reboot server	VIM operations
	Confirm resized server	VIM operations
	Resize server	VIM operations
	Live-migrate server	VIM operations
	List hosts	VIM operations
	Create flavor	VIM operations
	List flavors with details	VIM operations
	Show flavor details	VIM operations
	Create extra specs for a flavor	VIM operations
	Show an extra spec for a flavor	VIM operations
	Attach and detach a volume by Nova	VIM operations
	Attach and detach a volume by Cinder	VIM operations
			...fill out CRUD operations for instances, network (+ storage?)

Networking

Use Case	Suite	Description
vPing	smoke(functest)	two vms setup in the same subnet and can ping each other (ssh, userdata, IPv4, IPv6(afraid not support now MatthewLi))
vRouter		Two VMs in two different subnets, connected by a Neutron virtual router, can ping each other
Security rules		Verify that a security rule prevents a type of traffic, remove rule, verify that traffic passes, add it back, test that traffic is stopped
External routing		Verify that a VM can access hosts external to the VIM
		...fill out CRUD operations for "network/subnet/router/port" operations

compute - test cases

Use Case	Suite	Description	comments
yardstick_tc010 measure memory read latency using lmbench	nfvi/compute	measure memory read latency, No SLA, some adapted work is needed ---> CAN Measure measure memory read latency	There was an agreement not to include any performance related tests to the conformance test suite.
yardstick_tc012 Measure memory read and write bandwidth using lmbench	nfvi/compute	No SLA	There was an agreement not to include any performance related tests to the conformance test suite.
yardstick_tc014 Measure Processing speed using unixbench	nfvi/compute	No SLA	There was an agreement not to include any performance related tests to the conformance test suite.
yardstick_tc055 number of cores, number of threads, available memory size and cache size	nfvi/compute	No SLA	This is not relevant to compliance and conformance

storage - test cases

Use Case	Suite	Description	comments
yardstick_tc005 Measure Storage IOPS, throughput and latency using fio	nfvi/storage	No SLA	There was an agreement not to include any performance related tests to the conformance test suite.

HA - test cases

id	Use Case	Suite	Description	status	comments
	opnfv_yardstick_tc052 OpenStack Controller Node Disk I/O Block High Availability	HA
	opnfv_yardstick_tc053 Openstack Controller Load Balance Service High Availability	HA
	opnfv_yardstick_tc054 OpenStack VIP Master Node abnormally shutdown High Availability	HA

IPv6 - test cases

Use Case	Suite	Description
IPv6 IPAM for an instance	IPv6	Verify DHCPv6 (stateful & stateless), SLAAC
Security rules	IPv6	IPv6 security rules for Neutron
IPv6 routing	IPv6	using switch/router, IPv6 service VM etc.

VPN - test cases

Use Case	Suite	Description
VPN operations	VPN CRUD	Create VPN instance and check command return code Check if VPN instance is present Create IETF VM interface and check return code Verify IETF VM interface Create VPN interface for IETF interface Verify VPN interface Verify FIB entry after create Delete VM VPN interface Verify after deleting VM VPN interface Delete VPN instance Verify after deleting VPN instance Delete VM IETF interface Verify after deleting VM IETF interface Verify FIB entry after delete
VPN operations	BGP VPN CRUD	Create BGPVPN Create BGPVPN with malformatted route target (e.g. ASN:NN) should fail. Create BGPVPN with invalid route target (e.g. 65536:0) should fail. Getting the VPN list works without producing an error. Updating an existing BGPVPN works. Displaying parameters of an existing BGPVPN works. Deleting a BGPVPN works. Associating an existing BGPVPN with a Neutron network works Getting the associated Neutron network works. Deleting the network association works. Associating an existing BGPVPN with a Neutron Router works Getting the associated Neutron router works. Deleting the router association works
Subnet connectivity	VPN DC	VPN provides connectivity between subnets. different Neutron subnets cannot reach each other unless they are connected to the same Router.
Tenant separation	VPN DC	VPNs enable using the same IP address ranges in different VPNs, which is an important feature for tenant separation in the DC. This test verifies if the correct VM is reached under a given IP address when IP addresses are used multiple times in the same DC.
Data Center Gateway integration	VPN Multisite	Data Center Gateway integration, check if routes are correctly exchanged between SDN controller and datacenter gateway
Inter-DC communication	VPN Multisite	Inter-DC communication, Check if communication between two data centers connected through an MPLS backbone works.

Fault Management - test cases

Use Case	Suite	Description
Relaunch instance ?	Fault management	When an instance fails, can the platform restart the instance automatically?
Scale-up ?	Fault management	Can a new instance of a given type be launched when a certain load is hit?
Subscribe to a fault event	Fault management	Listen for an instance fault , and verify that when the instance is killed we hear about it

Space shortcuts

Page tree