...
| ID | Type | Test Case | Description | Pre-condition & requirements | Status | Gerrit References |
|---|---|---|---|---|---|---|
| 1 | VIM operations on Identity | List extensions | List all the extensions | VIM: Openstack Components: Keystone | ||
| 2 | VIM operations on Identity | API discovery features | Show API version; show API media types; show API status | VIM: Openstack Components: Keystone | ||
| 3 | VIM operations on Identity | Projects CRUD ops | List, create, delete and update projects; associate a user to a project | VIM: Openstack Components: Keystone | ||
| 4 | VIM operations on Identity | Token CRUD ops | Create, show, delete, rescope token; Note: An unscoped token can be requested, that token can be used to request a scoped token. The scoped token can be revoked, and the original token used to get a token in a different project. | VIM: Openstack Components: Keystone | ||
| 5 | VIM operations on Identity | Update password | User update own password | VIM: Openstack Components: Keystone | ||
| 6 | VIM operations on Identity | User ec2 credentials CRD ops | Create, show, list and delete user ec2 credentials | VIM: Openstack Components: Keystone | ||
| 7 | VIM operations on Identity | Credentials CRUD ops | Create, show, update, delete and list credentials | VIM: Openstack Components: Keystone | ||
| 8 | VIM operations on Identity | Default project id | 1. create a domain 2. create a project in the domain 3. create a user in the domain, with the previous project as his default project 4. get roles and find the admin role 5. grant the admin role to the user on his project 6. create a new client with user's credentials 7. verify the user's token and see that it is scoped to the project | VIM: Openstack Components: Keystone | ||
| 9 | VIM operations on Identity | Domains CRUD ops | Create, update, delete and list domains | VIM: Openstack Components: Keystone | ||
| 10 | VIM operations on Identity | Endpoint CRUD ops | Create, update, delete, show and list endpoints | VIM: Openstack Components: Keystone | ||
| 11 | VIM operations on Identity | Groups CRUD ops | Create, update, delete, show and list groups; add, list and delete users in groups; | VIM: Openstack Components: Keystone | ||
| 12 | VIM operations on Identity | Inherits CRUD ops | Create, assign, list, check, revoke roles on domains user/domains group/projects user/projects group/domains/ project trees | VIM: Openstack Components: Keystone | ||
| 13 | VIM operations on Identity | Policy CRUD ops | List, create, update and delete policies | VIM: Openstack Components: Keystone | ||
| 14 | VIM operations on Identity | Regions CRUD ops | Create, show, update, delete and list regions | VIM: Openstack Components: Keystone | ||
| 15 | VIM operations on Identity | Roles CRUD ops | Create, show, update, delete and list roles; grant ,list and revoke role to user/group on project/domain/ | VIM: Openstack Components: Keystone | ||
| 16 | VIM operations on Identity | Services CRUD ops | Create, show, update, delete and list services | VIM: Openstack Components: Keystone | ||
| 17 | VIM operations on Identity | Trusts CRU ops | Create, show, delete and list trusts; updates are not supported for trusts | VIM: Openstack Components: Keystone | ||
| 18 | VIM operations on Identity | Users CRUD ops | Create, update, show, delete and list users; Request for token authentication with/without a valid token in header | VIM: Openstack Components: Keystone |
NFVI
| ID | Type | Test Case | Description | Pre-condition & requirements | Status | Gerrit References |
|---|---|---|---|---|---|---|
| ? | Network | vPing | two vms setup in the same subnet and can ping each other (ssh, userdata, IPv4, IPv6(afraid not support now MatthewLi)) | VIM: Openstack Components: Keystone, Nova, Neutron, Glance | ||
| 2 | Network | vRouter | Two VMs in two different subnets, connected by a Neutron virtual router, can ping each other | VIM: Openstack Components: Keystone, Nova, Neutron, Glance | ||
| 3 | Network | Security rules | Verify that a security rule prevents a type of traffic, remove rule, verify that traffic passes, add it back, test that traffic is stopped | VIM: Openstack Components: Keystone, Nova, Neutron, Glance | ||
| 4 | Network | External routing | Verify that a VM can access hosts external to the VIM | VIM: Openstack Components: Keystone, Nova, Neutron, Glance | ||
| 5 | Network | ...fill out CRUD operations for "network/subnet/router/port" operations | VIM: Openstack Components: Keystone, Nova, Neutron, Glance | |||
| 6 | Network | Network advanced server ops | Check VM connectivity after some advanced instance operations executed: * Stop/Start an instance * Reboot an instance * Rebuild an instance * Pause/Unpause an instance * Suspend/Resume an instance * Resize an instance | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder | ||
| 7 | Network | Network basic operations | This smoke test suite assumes that Nova has been configured to boot VM's with Neutron-managed networking, and attempts to verify network connectivity as follows: There are presumed to be two types of networks: tenant and public. A tenant network may or may not be reachable from the Tempest host. A public network is assumed to be reachable from the Tempest host, and it should be possible to associate a public ('floating') IP address with a tenant ('fixed') IP address to facilitate external connectivity to a potentially unroutable tenant IP address. | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder | ||
| 8 | Network | Network v6 | 1. Create network with subnets: 1.1. one IPv4 and 1.2. one or more IPv6 in a given address mode 2. Boot 2 VMs on this network 3. Allocate and assign 2 FIP4 4. Check that vNICs of all VMs gets all addresses actually assigned 5. Each VM will ping the other's v4 private address 6. If ping6 available in VM, each VM will ping all of the other's v6 addresses as well as the router's | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder | ||
| 9 | Network | Security groups basic ops | This test case assumes that Nova has been configured to boot VM's with Neutron-managed networking, and attempts to verify cross tenant connectivity as follows ssh: in order to overcome "ip namespace", each tenant has an "access point" VM with floating-ip open to incoming ssh connection allowing network commands (ping/ssh) to be executed from within the tenant-network-namespace Tempest host performs key-based authentication to the ssh server via floating IP address connectivity test is done by pinging destination server via source server ssh connection. success - ping returns failure - ping_timeout reached multi-node: Multi-Node mode is enabled when CONF.compute.min_compute_nodes > 1. Tests connectivity between servers on different compute nodes. When enabled, test will boot each new server to different compute nodes. | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder | ||
| 10 | NFVI | Basic minimum scenario test | 1. Create image 2. Create keypair 3. Boot instance with keypair and get list of instances 4. Create volume and show list of volumes 5. Attach volume to instance and getlist of volumes 6. Add IP to instance 7. Create and add security group to instance 8. Check SSH connection to instance 9. Reboot instance 10. Check SSH connection to instance after reboot | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder | ||
| 11 | Compute | OPNFV_YARDSTICK_TC010 | Measure the memory read latency for varying memory sizes and strides. Whole memory hierarchy is measured including all levels of cache. | Colorado Scenario:due to floating IP,not support odl_l2, bgnvpn VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder, Heat | ||
| 12 | Compute | OPNFV_YARDSTICK_TC012 | Measure the rate at which data can be read from and written to the memory (this includes all levels of memory). | Colorado Scenario: due to floating IP,not support odl_l2, bgnvpn VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder, Heat | ||
| 13 | Compute | OPNFV_YARDSTICK_TC014 | To evaluate the IaaS processing speed with regards to score of single cpu running and parallel running The purpose is also to be able to spot trends. Test results, graphs and similar shall be stored for comparison reasons and product evolution understanding between different OPNFV versions and/or configurations. | Colorado Scenario: due to floating IP,not support odl_l2, bgnvpn VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder, Heat | ||
| 14 | Compute | OPNFV_YARDSTICK_TC055 | To evaluate the IaaS compute capacity with regards to hardware specification, including number of cpus, number of cores, number of threads, available memory size and total cache size. Test results, graphs and similar shall be stored for comparison reasons and product evolution understanding between different OPNFV versions and/or configurations. | Colorado Scenario:due to floating IP,not support odl_l2, bgnvpn VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder, Heat | ||
| 15 | Compute | Aggregates basic ops | Creates an aggregate within an availability zone 1. Adds a host to the aggregate 2. Checks aggregate details 3. Updates aggregate's name 4. Removes host from aggregate 5. Deletes aggregate | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder | ||
| 16 | Compute | Server advanced operations | This test case stresses some advanced server instance operations: * Resizing a volume-backed instance * Sequence suspend resume | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder | ||
| 17 | Compute | Server basic operations | This smoke test case follows this basic set of operations: * Create a keypair for use in launching an instance * Create a security group to control network access in instance * Add simple permissive rules to the security group * Launch an instance * Perform ssh to instance * Verify metadata service * Verify metadata on config_drive * Terminate the instance | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder | ||
| 18 | Compute | Server multinode | This is a set of tests specific to multinode testing | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder | ||
| 19 | Compute | Shelve instance | The following is the scenario outline: * boot an instance and create a timestamp file in it * shelve the instance * unshelve the instance * check the existence of the timestamp file in the unshelved instance | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder | ||
| 20 | Compute | Snapshot pattern | The following is the outline: * boot an instance and create a timestamp file in it * snapshot the instance * boot a second instance from the snapshot * check the existence of the timestamp file in the second instance | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder | ||
| 21 | Compute | Stamp pattern | This test is for snapshotting an instance/volume and attaching the volume created from snapshot to the instance booted from snapshot. The following is the scenario outline: 1. Boot an instance "instance1" 2. Create a volume "volume1" 3. Attach volume1 to instance1 4. Create a filesystem on volume1 5. Mount volume1 6. Create a file which timestamp is written in volume1 7. Unmount volume1 8. Detach volume1 from instance1 9. Get a snapshot "snapshot_from_volume" of volume1 10. Get a snapshot "snapshot_from_instance" of instance1 11. Boot an instance "instance2" from snapshot_from_instance 12. Create a volume "volume2" from snapshot_from_volume 13. Attach volume2 to instance2 14. Check the existence of a file which created at 6. in volume2 | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder | ||
| 22 | Compute | Volume boot pattern | This test case attempts to reproduce the following steps: * Create some bootable volume importing a image * Boot an instance from the bootable volume * Write content to the volume * Delete an instance and Boot a new instance from the volume * Check written content in the instance * Create a volume snapshot while the instance is running * Boot an additional instance from the new snapshot based volume * Check written content in the instance booted from snapshot | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder | ||
| 23 | Storage | yardstick_tc005 | Fio test is invoked in a host VM on a compute blade, a job file as well as parameters are passed to fio and fio will start doing what the job file tells it to do. | Colorado Scenario: due to floating IP,not support odl_l2, bgnvpn VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder, Heat | ||
| 24 | Storage | Encrypted volumes | This test is for verifying the functionality of encrypted volumes. For both LUKS and cryptsetup encryption types, this test performs the following: * Creates an image * Boots an instance from the image * Creates an encryption type (as admin) * Creates a volume of that encryption type (as a regular user) * Attaches and detaches the encrypted volume to the instance | VIM: Openstack Components: Keystone, Nova, Neutron, Glance, Cinder |
...