Status of proposed tests

2018-06-13

Installer	Scenario	vnf.vIMS	vnf.vEPC	snaps.smoke	stress.ping	tempest.compute	tempest.identity_v2	tempest.identity_v3	tempest.image	tempest.network	tempest.volume	tempest.trunk_ports	tempest.bgpvpn	security.patrole	ha.controller_restart	ha.rabbitmq	ha.neutron_l3_agent	ha.database
Apex	nosdn-nofeature stable/fraser	PASS	FAIL ERROR - abot-epc-basic workload differs from active passes on Apex daily CI loop	PASS	FAIL https://gerrit.opnfv.org/gerrit/#/c/58481/	PASS	FAIL - only v3 used skip mechanism needed or just part of reviewer instructions (does not need to be automated) Unable to render Jira issues macro, execution error.	PASS	PASS	FAIL - Success: 19 - Skipped: 0 - Expected failures: 0 - Unexpected success: 0 - Failures: 1 test_mtu_sized_frames ... fail => remove test	PASS	PASS	not supported	PASS	FAIL IPMI info missing	FAIL wrong process name https://gerrit.opnfv.org/gerrit/#/c/58317/	FAIL stack create failed https://gerrit.opnfv.org/gerrit/#/c/58333/ flavor m1.tiny does not exist on Apex deployments by default https://gerrit.opnfv.org/gerrit/#/c/58601/	PASS
	odl nstable/fraser												FAIL one test is broken due to a bug in ODL driver https://gerrit.opnfv.org/gerrit/#/c/58539/				not supported: l3 agent not installed	PASS
	nosdn-nofeature master	FAIL VM in error state: "no valid host found" passes on Apex daily CI loop	FAIL VM in error state: "no valid host found" passes on Apex daily CI loop	FAIL test_volume_type_with_encryption test_volume_type_with_qos_and_encryption	FAIL	PASS	not supported	PASS	PASS	PASS	PASS	PASS	not supported	PASS	FAIL IPMI info missing	PASS	PASS	PASS
Compass	nosdn-nofeature stable/fraser	PASS	PASS	PASS	FAIL failed to create stacks (Time out) create stack rate 0/20	PASS	SKIP	PASS	PASS	FAIL fail: 4 pass: 15 test_hotplug_nic ... fail test_network_basic_ops ... fail test_subnet_details ... fail test_update_instance_port_admin_state ... fail	PASS	PASS skip: 9 pass: 43	not supported	PASS skip: 3 (dvr is not enabled) pass: 132 test_create_distributed_router ... skip test_show_distributed_router ... skip test_update_distributed_router ... skip	PASS	PASS	FAIL SLA failure: 9.023325 > 5.000000	PASS
Compass	odl stable/fraser	FAIL Unable to create a number	PASS	FAIL fail: 2 pass: 117	FAIL failed to create stacks	PASS	SKIP	PASS	PASS	FAIL fail: 3 pass: 17	PASS	PASS skip: 9 pass: 43	not supported	PASS skip: 5 pass: 130	PASS	FAIL change attack process name failed https://gerrit.opnfv.org/gerrit/#/c/58693/	FAIL No neutron-l3-agent process	PASS
Fuel (x86)	nosdn-nofeature master	FAIL deployment clearwater-opnfv timed out	FAIL passes on FUEL daily CI loop	FAIL passed on normal Fuel CI job	PASS or FAIL create stack rate 20/20 and 16/20	PASS	FAIL - only v3 used skip mechanism needed or just part of reviewer instructions (does not need to be automated) Unable to render Jira issues macro, execution error.	PASS	PASS	FAIL - Success: 18 - Skipped: 0 - Expected failures: 0 - Unexpected success: 0 - Failures: 1 test_hotplug_nic ... fail	PASS	PASS skip: 9 pass: 43	not supported	PASS skip: 3 (dvr is not enabled) pass: 132 test_create_distributed_router ... skip test_show_distributed_router ... skip test_update_distributed_router ... skip	PASS	FAIL rabbitmq located in msg0x VMs https://docs.opnfv.org/en/stable-fraser/submodules/fuel/docs/release/installation/installation.instruction.html#automatic-installation-of-a-baremetal-pod	FAIL l3-agent in gtw0x VMs https://gerrit.opnfv.org/gerrit/#/c/58333/	FAIL database located in dbs0x VMs https://docs.opnfv.org/en/stable-fraser/submodules/fuel/docs/release/installation/installation.instruction.html#automatic-installation-of-a-baremetal-pod

2018-05-23 - limited results due to failed CI jobs

Installer	Scenario	vnf.vIMS	snaps.smoke	stress.ping	tempest.compute	tempest.identity_v2	tempest.identity_v3	tempest.image	tempest.network	tempest.volume	tempest.trunk_ports	tempest.bgpvpn	security.patrole	ha.controller_restart	ha.rabbitmq	ha.neutron_l3_agent	ha.database
Apex	nosdn-nofeature	FAIL Exception: Unable to create a number	PASS	FAIL	PASS	FAIL - only v3 used skip mechanism needed Unable to render Jira issues macro, execution error.	PASS	PASS	FAIL - Success: 19 - Skipped: 0 - Expected failures: 0 - Unexpected success: 0 - Failures: 1 test_mtu_sized_frames ... fail	PASS	PASS	not supported	PASS	FAIL	FAIL SLA failure: 31.512733 > 30.000000	FAIL stack create failed inner exception: file not exist	PASS
Apex	odl	FAIL	FAIL		PASS	FAIL	PASS	PASS	FAIL	PASS	PASS	FAIL	FAIL	FAIL	FAIL	l3 agent not installed	PASS
Compass	nosdn-nofeature
Compass	odl	FAIL	FAIL fail: 2 pass: 117	FAIL failed to create stacks	PASS	SKIP	PASS	PASS	FAIL fail: 3 pass: 17	PASS	PASS skip: 9 pass: 43	FAIL No .testr.conf file was found	PASS skip: 5 pass: 130	PASS	FAIL No rabbitmq-server process	FAIL No neutron-la-agent process	PASS
Fuel (x86)	nosdn-nofeature	FAIL deployment clearwater-opnfv timed out	PASS	PASS	PASS	SKIP	PASS	PASS	FAIL fail: 1 pass: 19 test_mtu_sized_frames ... fail	PASS	PASS skip: 9 pass: 43	FAIL No .testr.conf file was found	PASS	FAIL IPMI information missing	FAIL No rabbitmq-server process	FAIL failed to create stack with shade	FAIL No mysql process
Fuel (arm)

2018-05-16

Installer	Scenario	smoke.tc001	smoke.tc002	ha.tc009	ha.tc010	ha.tc011	vnf.tc001	stress.tc001	sdnvpn.tc000	security.patrole	tempest.neutron_trunk_ports
Apex	nosdn-nofeature	FAIL 0 failing tests 76 success 19 skipped: skip: Identity api v2 is not enabled skip: AccountQuotasTest skipped as swift is not available => implement mechanism for specifying skippable tests Unable to render Jira issues macro, execution error.	FAIL 1 failing test: PortConfigError: Cannot locate network with name - external in project - admin	FAIL ValueError: context not found for server 'node0.LF-8419b4c1' IPMI information missing?	FAIL missing ssh key in Yardstick FIX: https://gerrit.opnfv.org/gerrit/#/c/57401/	FAIL Unable to find network with name or id 'net04_ext' Env variables not passed correctly FIX: https://gerrit.opnfv.org/gerrit/#/c/57265/	FAIL failed to download file (temporary problem?)	FAIL TypeError: cannot concatenate 'str' and 'NoneType' objects => OS_TENANT_NAME not defined in OS credentials on Apex Unable to render Jira issues macro, execution error.	-- not supported by scenario --	PASS	-- not yet run --
Apex	odl	FAIL 0 failing tests 76 success 19 skipped: skip: Identity api v2 is not enabled skip: AccountQuotasTest skipped as swift is not available => implement mechanism for specifying skippable tests Unable to render Jira issues macro, execution error.	FAIL 1 failing test: PortConfigError: Cannot locate network with name - external in project - admin	FAIL ValueError: context not found for server 'node0.LF-8419b4c1' IPMI information missing?	FAIL missing ssh key in Yardstick FIX https://gerrit.opnfv.org/gerrit/#/c/57401/	FAIL Unable to find network with name or id 'net04_ext' Env variables not passed correctly FIX https://gerrit.opnfv.org/gerrit/#/c/57265/	FAIL out of floating IPs	FAIL TypeError: cannot concatenate 'str' and 'NoneType' objects => OS_TENANT_NAME not defined in OS credentials on Apex Unable to render Jira issues macro, execution error.	FAIL FIX: https://gerrit.opnfv.org/gerrit/#/c/57263/	PASS	-- not yet run --
Compass	nosdn-nofeature	FAIL 1 failing tests 75 success 19 skipped fail: No IPv4 address found	FAIL 2 failing tests fail: Guest does not have a console available. (HTTP 404) fail: network_id are not the same	PASS	PASS	FAIL SLA failure: 10.010200 > 5.000000	PASS (nosdn-nofeature) FAIL failed to download files	FAIL	---	PASS 0 failing tests 132 success 3 skipped skip: dvr is not enabled	PASS 0 failing tests 43 success 9 skipped skip: vlan, vxlan, gre skip: Advanced image is required to run this test
Compass	odl	FAIL 0 failing tests 76 success 19 skipped	FAIL 1 failing tests fail: <snaps.domain.network.Router instance at 0x7f4f262d6290> is not None	PASS	PASS	---	FAIL failed to download files	FAIL No valid host was found	---	FAIL
Fuel (x86)	nosdn-nofeature	FAIL 0 failing tests 76 success 19 skipped	PASS 119 success	FAIL IPMI information missing	FAIL Ssh is still unavailable: SSHError	FAIL failed to create stack with shade	FAIL failed to download files	PASS	---	PASS 135 success	PASS 0 failing tests 43 success 9 skipped skip: vlan, vxlan, gre skip: Advanced image is required to run this test
Fuel (arm)

2018-05-09

Installer	Scenario	smoke.tc001	smoke.tc002	ha.tc009	ha.tc010	ha.tc011	vnf.tc001	stress.tc001	sdnvpn.tc000	security.patrole	tempest.neutron_trunk_ports
Apex		FAIL 0 failing tests 76 success 19 skipped: skip: Identity api v2 is not enabled skip: AccountQuotasTest skipped as swift is not available	FAIL 1 failing test: PortConfigError: Cannot locate network with name - external in project - admin	FAIL ValueError: context not found for server 'node0.LF-8419b4c1' IPMI information missing	FAIL Ssh is still unavailable: SSHError	FAIL Unable to find network with name or id 'net04_ext' Env variables not passed correctly? Dovetail needs to pass the env file. We (Xudan) have seen this before.	PASS (nofeature) ? (odl)	FAIL TypeError: cannot concatenate 'str' and 'NoneType' objects	FAIL Unknown test case or tier 'bgpvpn', or not supported by the given scenario 'unknown'	PASS
Compass	nosdn-nofeature	FAIL 1 failing tests 75 success 19 skipped fail: No IPv4 address found	FAIL 2 failing tests fail: Guest does not have a console available. (HTTP 404) fail: network_id are not the same	PASS	PASS	FAIL SLA failure: 10.010200 > 5.000000	PASS (nosdn-nofeature) FAIL failed to download files	FAIL	---	PASS 0 failing tests 132 success 3 skipped skip: dvr is not enabled	PASS 0 failing tests 43 success 9 skipped skip: vlan, vxlan, gre skip: Advanced image is required to run this test
Compass	odl	FAIL 0 failing tests 76 success 19 skipped	FAIL 1 failing tests fail: <snaps.domain.network.Router instance at 0x7f4f262d6290> is not None	PASS	PASS	---	FAIL failed to download files	FAIL No valid host was found	---	FAIL
Fuel (x86)	nosdn-nofeature	FAIL 0 failing tests 76 success 19 skipped	PASS 119 success	FAIL IPMI information missing	FAIL Ssh is still unavailable: SSHError	FAIL failed to create stack with shade	FAIL failed to download files	PASS	---	PASS 135 success	PASS 0 failing tests 43 success 9 skipped skip: vlan, vxlan, gre skip: Advanced image is required to run this test
Fuel (arm)

Space shortcuts

Page tree