Page History

2018-06-25

Mandatory Tests

Apex

FAIL

passes on Apex daily loop

FAIL - only v3 used

skip mechanism needed or just part of reviewer instructions (does not need to be automated)

96acfcf2-656not supportedFAILIPMI info missingodlstable/fraserFAIL

FAIL

IPMI info missingPASSPASS

FAIL

failed to create stacks (Time out)

create stack rate 0/20SKIP

skip: 9

pass: 43

PASS

skip: 3 (dvr is not enabled)

pass: 132

test_create_distributed_router ... skip

test_show_distributed_router ... skip

test_update_distributed_router ... skip

Installer

Scenario

vnf.vIMS

vnf.vEPC

vping_userdata

vping_sshsnaps.smoke

stress.ping

tempest.computeosinterop

tempest.identity_v2compute

tempest.identity_v3

tempest.image

tempest.network_api

tempest.volume

tempest.trunk_ports

tempest.bgpvpnipv6_api

security.patrole

ha.nova_api

ha.controllerneutron_restartserver

ha.rabbitmqkeystone

ha.glance_api

ha.cinder_apineutron_l3_agent

ha.databasecpu_load

ha.disk_load

ha.haproxy

ha.rabbitmq

ha.database

Apex

nosdn-nofeature

stable/fraser

PASS

FAIL

test_volume_type_with_encryption

test_volume_type_with_qos_and_encryption

FAIL

PASS

Jira

server	OPNFV JIRA
serverId	96acfcf2-

Jira

server

OPNFV JIRA

serverId

db1a-3859-891e-03a53e9315b0
key	DOVETAIL-

662

PASS

FAIL

FAIL - only v3 used

skip mechanism needed or just part of reviewer instructions (does not need to be automated)

FAIL

IPMI info missing

PASS

not supported:

l3 agent not installed

PASS

nosdn-nofeature

master

FAIL

VM in error state: "no valid host found"

passes on Apex daily CI loop

PASS

FAIL

PASS

not supported

HA proxy processes don't recover

PASS

Compass

nosdn-nofeature

fraser

PASS

FAIL

cannot connect to 192.168.11.xxx

PASS

total: 200

PASS

not supported

PASS

FAIL

Jira

server

OPNFV JIRA

PASS

columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	96acfcf2-db1a-3859-891e-03a53e9315b0
key	DOVETAIL-738

PASS

Fuel

nosdn-nofeature

master

Compass

nosdn-nofeature

stable/fraser

PASS

FAILfail

SLA failure:

4


10.725534 > 5.000000

UNSTABLE

most of the time the test detects 11 keystone processes of which only 9 recover

Is the keystone process query correct?

PASS

FAIL

SLA failure:
12.149971 > 5.000000

pass: 15

test_hotplug_nic ... fail

test_network_basic_ops ... fail

test_subnet_details ... fail

test_update_instance_port_admin_state ... fail

PASS

not supported

PASS

FAIL

SLA failure: 9.023325 > 5.000000

PASS

odl

stable/fraser

PASS

FAIL

fail: 2

pass: 117

FAIL

failed to create stacks

PASS

SKIP

PASS

FAIL

fail: 3

pass: 17

PASS

skip: 9

pass: 43

not supported

PASS

skip: 5

pass: 130

PASS

not supported:

l3 agent not installed

PASS

FAIL

SLA failure:
12.336285 > 5.000000

rabbitmq-server not found
in the host environment

FAIL

SLA failure: 13.879296 > 5.000000

2018-06-25

PASSjiraserverOPNFV JIRADOVETAIL-656

 - Success: 18
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 1

test_hotplug_nic ... fail

skip: 9

pass: 43

FAIL

database located in dbs0x VMs

https://docs.opnfv.org/en/stable-fraser/submodules/fuel/docs/release/installation/installation.instruction.html#automatic-installation-of-a-baremetal-pod

Installer

Scenario

stress.ping

tempest.compute

tempest.identity_v2

tempest.identity_v3

tempest.image

tempest.network_api

tempest.volume

tempest.trunk_ports

security.patrole

ha.controller_restart

ha.rabbitmq

ha.database

ha.neutron_l3_agent

tempest.network_scenario

vnf.vEPC

vnf.vIMS

tempest.bgpvpn

snaps.smoke

Apex

nosdn-nofeature

stable/fraser

FAIL

PASS

FAIL - only v3 used

skip mechanism needed or just part of reviewer instructions (does not need to be automated)

Jira

server	OPNFV JIRA
serverId	96acfcf2-db1a-3859-891e-03a53e9315b0
key	DOVETAIL-656

PASS

FAIL

IPMI info missing

PASS

FAIL

passes on Apex daily loop

PASS

not supported

FAIL

test_volume_type_with_encryption

test_volume_type_with_qos_and_encryption

passes on Apex daily CI loop

odl

stable/fraser

Fuel (x86)

nosdn-nofeature

master

FAIL

deployment clearwater-opnfv timed out

FAIL

passes on FUEL daily CI loop

FAIL

FAIL - only v3 used

skip mechanism needed or just part of reviewer instructions (does not need to be automated)

FAIL

IPMI info missing

PASS

not supported:

l3 agent not installed

FAIL

nosdn-nofeature

master

FAIL

PASS

not supported

PASS

serverId

96acfcf2-db1a-3859-891e-03a53e9315b0

key

PASS

FAIL

IPMI info missing

PASS

FAIL

VM in error state: "no valid host found"

passes on Apex daily CI loop

not supported

FAIL

Compass

nosdn-nofeature

stable/fraser

PASS

create stack rate 5/5

PASS

SKIP

PASS

skip: 9

pass: 43

PASS

skip: 3 (dvr is not enabled)

pass: 132

test_create

not supported

PASS

skip: 3 (dvr is not enabled)

pass: 132

test_create_distributed_router ... skip

test_show_distributed_router ... skip

test_update_distributed_router ... skip

PASS

FAIL

rabbitmq located in msg0x VMs

https://docs.opnfv.org/en/stable-fraser/submodules/fuel/docs/release/installation/installation.instruction.html#automatic-installation-of-a-baremetal-pod

FAIL

l3-agent in gtw0x VMs

https://gerrit.opnfv.org/gerrit/#/c/58333/

test_show_distributed_router ... skip

test_update_distributed_router ... skip

PASS

FAIL

SLA failure: 9.023325 > 5.000000

FAIL

fail: 5

No IPv4 addresses found

PASS

not supported

FAIL

fail: 1

pass: 120

test_ssh_client_fip_after_reboot ... fail

odl

stable/fraser

PASS

create stack rate 5/5

PASS

SKIP

PASS

skip: 9

pass: 43

PASS

skip: 5 (l3_agent_scheduler extension not enabled)

pass: 130

test_create_router_on_l3_agent ... skip

test_delete_router_from_l3_agent ... skip

test_list_routers_on_l3_agent ... skip

test_create_high_availability_router ... skip

test_update_high_availability_router ... skip

PASS

not supported:

l3 agent not installed

FAIL

fail: 2

(False is not true : ip address 192.168.11.114 is reachable)

test_update_instance_port_admin_state

test_update_router_admin_state

PASS

not supported

FAIL

fail: 2

pass: 119

test_create_network_router_admin_user_to_new_project ... fail

test_create_network_router_new_user_to_admin_project ... fail

Fuel (x86)

nosdn-nofeature

master

PASS

FAIL - only v3 used

skip mechanism needed or just part of reviewer instructions (does not need to be automated)

Jira

server	OPNFV JIRA
serverId	96acfcf2-db1a-3859-891e-03a53e9315b0
key	DOVETAIL-656

PASS

skip: 9

pass: 43

PASS

skip: 3 (dvr is not enabled)

pass: 132

test_create_distributed_router ... skip

test_show_distributed_router ... skip

test_update_distributed_router ... skip

PASS

FAIL

rabbitmq located in msg0x VMs

https://docs.opnfv.org/en/stable-fraser/submodules/fuel/docs/release/installation/installation.instruction.html#automatic-installation-of-a-baremetal-pod

FAIL

database located in dbs0x VMs

https://docs.opnfv.org/en/stable-fraser/submodules/fuel/docs/release/installation/installation.instruction.html#automatic-installation-of-a-baremetal-pod

FAIL

l3-agent in gtw0x VMs

https://gerrit.opnfv.org/gerrit/#/c/58333/

FAIL

 - Success: 3
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 2

test_update_instance_port_admin_state ... fail

test_update_router_admin_state ... fail

FAIL

auth problem

passes on FUEL daily CI loop

FAIL

auth problem

deployment clearwater-opnfv timed out

not supported

PASS

Installer

Scenario

vping_ssh

vping_userdata

tempest.osinterop

tempest.ipv6

tempest.multi_node_scheduling

tempest.security

tempest.vm_lifecycle

ha.nova_api

ha.neutron_server

ha.keystone

ha.glance_api

ha.cinder_api

ha.cpu_load

ha.disk_load

ha.haproxy

sdnvpn.subnet_connectivity

sdnvpn.tenant_separation

sdnvpn.router_assoc

sdnvpn.router_assoc_fip

Apex

nosdn-nofeature

stable/fraser

PASS

FAIL

passes on Apex daily loop

FAIL

passes on Apex daily CI loop

FAIL

PASS

FAIL

PASS

FAIL

PASS

FAIL

IPMI info missing

PASS

not supported

Fuel

nosdn-nofeature

PASS

FAIL

PASS

FAIL

PASS

FAIL

PASS

not supported

Historical results below

2018-05-23 - limited results due to failed CI jobs

...

Space shortcuts

Page tree

Versions Compared

Old Version 28

New Version Current

Key

Historical results below