2018-06-25
Mandatory Tests
Installer | Scenario | vnf.vIMS | vnf.vEPC | vping_userdata | vping_sshsnaps.smoke | stress.ping | tempest.computeosinterop | tempest.identity_v2compute | tempest.identity_v3 | tempest.image | tempest.network_api | tempest.volume | tempest.trunk_ports | tempest.bgpvpnipv6_api | security.patrole | ha.nova_api | ha.controllerneutron_restartserver | ha.rabbitmqkeystone | ha.glance_api | ha.cinder_apineutron_l3_agent | ha.databasecpu_load | ha.disk_load | ha.haproxy | ha.rabbitmq | ha.database | |||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Apex | Apexstable/fraser | PASS | PASS | PASS | FAIL | PASS | ||||||||||||||||||||||||||||||||||
Jira | ||||||||||||||||||||||||||||||||||||||||
server | OPNFV JIRA | serverId | FAIL |
|
| 656
| PASS | PASS | PASS | PASS | PASS | not supportedPASS | PASS | FAILPASS | IPMI info missingPASS | PASS | PASS | PASS | odlPASS | stable/fraserPASS | FAILPASS | FAIL | FAIL | FAIL | FAIL | FAIL - only v3 used skip mechanism needed or just part of reviewer instructions (does not need to be automated) | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL IPMI info missing | PASS | not supported: l3 agent not installed | PASS | master | FAIL VM in error state: "no valid host found" passes on Apex daily CI loop | PASS | FAIL | PASS | not supportedHA proxy processes don't recover | PASS | PASS |
Compass | fraser | PASS | FAIL cannot connect to 192.168.11.xxx | PASS | PASS total: 200 | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | not supportedPASS | FAIL | IPMI info missing
| PASS
| PASS | PASS | Compass
| PASS | ||||||||||||
Fuel | stable/frasermaster | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | create stack rate 0/20PASS | SKIPPASS | PASS | PASS | FAILfail SLA failure: 4
| UNSTABLE most of the time the test detects 11 keystone processes of which only 9 recover Is the keystone process query correct? | PASS | PASS | FAIL SLA failure: pass: 15 test_hotplug_nic ... fail test_network_basic_ops ... fail test_subnet_details ... fail test_update_instance_port_admin_state ... fail | PASS | PASS | not supported | PASS | PASS | FAIL SLA failure: 9.023325 > 5.000000 | PASS | ||||||||||||||
stable/fraser | PASS | PASS | FAIL fail: 2 pass: 117 | FAIL failed to create stacks | PASS | SKIP | PASS | PASS | FAIL fail: 3 pass: 17 | PASS | PASS skip: 9 pass: 43 | not supported | PASS skip: 5 pass: 130 | PASS | PASS | not supported: l3 agent not installed | PASS | |||||||||||||||||||||||
FAIL SLA failure: rabbitmq-server not found | FAIL SLA failure: 13.879296 > 5.000000 |
2018-06-25
Installer | Scenario | stress.ping | tempest.compute | tempest.identity_v2 | tempest.identity_v3 | tempest.image | tempest.network_api | tempest.volume | tempest.trunk_ports | security.patrole | ha.controller_restart | ha.rabbitmq | ha.database | ha.neutron_l3_agent | tempest.network_scenario | vnf.vEPC | vnf.vIMS | tempest.bgpvpn | snaps.smoke | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Apex | stable/fraser | FAIL | PASS | FAIL - only v3 used skip mechanism needed or just part of reviewer instructions (does not need to be automated)
| PASS | PASS | PASS | PASS | PASS | PASS | FAIL IPMI info missing | PASS | PASS | PASS | PASS | FAIL passes on Apex daily loop | PASS | not supported | FAIL test_volume_type_with_encryption test_volume_type_with_qos_and_encryption passes on Apex daily CI loop | ||||||||
stable/fraser | Fuel (x86) | master | FAIL deployment clearwater-opnfv timed out | FAIL passes on FUEL daily CI loop | PASSFAIL | FAIL | FAIL - only v3 used skip mechanism needed or just part of reviewer instructions (does not need to be automated) | FAIL | jiraFAIL | serverFAIL | OPNFV JIRAFAIL | FAIL IPMI info missing | PASS | PASS | not supported: l3 agent not installed | FAIL | FAIL | FAIL | FAIL | FAIL | |||||||
master | FAIL | PASS | not supported | PASS | PASS | PASS | PASS | ||||||||||||||||||||
serverId | 96acfcf2-db1a-3859-891e-03a53e9315b0 | key | DOVETAIL-656PASS | PASS | FAIL | IPMI info missing | PASS | PASS | PASS | PASS | PASS | FAIL VM in error state: "no valid host found" passes on Apex daily CI loop | not supported | FAIL | |||||||||||||
Compass | stable/fraser | PASS create stack rate 5/5 | PASS | SKIP | PASS | PASS | PASS | PASS | PASS skip: 9 pass: 43 | PASS skip: 3 (dvr is not enabled) pass: 132 test_create | not supported | PASS skip: 3 (dvr is not enabled) pass: 132 test_create_distributed_router ... skip test_show_distributed_router ... skip test_update_distributed_router ... skip | PASS | FAIL rabbitmq located in msg0x VMs | FAIL l3-agent in gtw0x VMs | test_show_distributed_router ... skip test_update_distributed_router ... skip | PASS | PASS | PASS | FAIL SLA failure: 9.023325 > 5.000000 | FAIL fail: 5 No IPv4 addresses found | PASS | PASS | not supported | FAIL fail: 1 pass: 120 test_ssh_client_fip_after_reboot ... fail | ||
stable/fraser | PASS create stack rate 5/5 | PASS | SKIP | PASS | PASS | PASS | PASS | PASS skip: 9 pass: 43 | PASS skip: 5 (l3_agent_scheduler extension not enabled) pass: 130 test_create_router_on_l3_agent ... skip test_delete_router_from_l3_agent ... skip test_list_routers_on_l3_agent ... skip test_create_high_availability_router ... skip test_update_high_availability_router ... skip | PASS | PASS | PASS | not supported: l3 agent not installed | FAIL fail: 2 (False is not true : ip address 192.168.11.114 is reachable) test_update_instance_port_admin_state test_update_router_admin_state | PASS | PASS | not supported | FAIL fail: 2 pass: 119 test_create_network_router_admin_user_to_new_project ... fail test_create_network_router_new_user_to_admin_project ... fail | |||||||||
Fuel (x86) | master | PASS | PASS | FAIL - only v3 used skip mechanism needed or just part of reviewer instructions (does not need to be automated)
| PASS | PASS | PASS | PASS | PASS skip: 9 pass: 43 | PASS skip: 3 (dvr is not enabled) pass: 132 test_create_distributed_router ... skip test_show_distributed_router ... skip test_update_distributed_router ... skip | PASS | FAIL rabbitmq located in msg0x VMs | FAIL database located in dbs0x VMs | FAIL l3-agent in gtw0x VMs | FAIL - Success: 3
- Skipped: 0
- Expected failures: 0
- Unexpected success: 0
- Failures: 2 test_update_instance_port_admin_state ... fail test_update_router_admin_state ... fail | FAIL passes on FUEL daily CI loop | FAIL deployment clearwater-opnfv timed out | not supported | PASS |
Installer | Scenario | vping_ssh | vping_userdata | tempest.osinterop | tempest.ipv6 | tempest.multi_node_scheduling | tempest.security | tempest.vm_lifecycle | ha.nova_api | ha.neutron_server | ha.keystone | ha.glance_api | ha.cinder_api | ha.cpu_load | ha.disk_load | ha.haproxy | sdnvpn.subnet_connectivity | sdnvpn.tenant_separation | sdnvpn.router_assoc | sdnvpn.router_assoc_fip |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Apex | stable/fraser | PASS | FAIL passes on Apex daily loop | FAIL passes on Apex daily CI loop | FAIL | FAIL | FAIL | FAIL | PASS | FAIL | PASS | PASS | FAIL | PASS | FAIL IPMI info missing | PASS | not supported | not supported | not supported | not supported |
Fuel | nosdn-nofeature | PASS | PASS | FAIL | FAIL | FAIL | FAIL | FAIL | PASS | PASS | FAIL | PASS | FAIL | PASS | PASS | PASS | not supported | not supported | not supported | not supported |
Historical results below
2018-05-23 - limited results due to failed CI jobs
...