Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

VSwitchPerf Release Plan

This Page will maintain the release plans for VSPERF


Kali Release Plan

Feature DetailsJIRA IDContactStatus

VSPERF-Openstack

Intel Pod10/15/18

(a) Add More Testcases

(b) Add TRex Support.

(c) Multi-Dimensional TestVNF Support




Kubernetes CNB - Phase2

Intel Pod12

(a) Multiple Pods.

(b) Multiple Hosts

(c) Containerizing vswitch

(d) Containerized TGens

(e) DanM

(f) DPDK Version has any performance impact?

(g) Different eBPF/Cilium Plugin?

(h) Memif interface



Phase-1:

K8S Cluster Deployment.

Plugins: Multus - OVSDPDK, VPP and SRIOV.

Pod: DPDK+L2/L3 FWD.

VSPERF-Xtesting Integration

(a) More testcases

(b) Run in Pod12.

(c) K8S




Improve TRex Integration - Better Data analysis


VSPERF GUI






Jerma Release Plan

Jerma release will include CN-Benchmarking, Container Metrics and Enhanced analytics features as the main outcomes.


Feature DetailsJIRA IDContactStatus

Integration with X-Testing  

Outcome of VSPERF-594 and VSPERF-595

VSPERF-604


Container Networking Benchmarking - Setup AutomationVSPERF-607Emanuele Urselli, Parth Yadav
Container Networking Benchmarking - TestingVSPERF-608
Container Metrics - agent and visualization

Enhanced Analytics.

Live-Results from Ixia TGen
Ancuta Enache
Enhanced Results Container and VM

TST-009 Testcases

VSPERF-583


VSPERF With OpenstackVSPERF-619

Iruya Release Plan

Iruya release will include Containerization of VSPERF and Newer software versions as the main outcomes.


Feature DetailsJIRA IDContactStatus
VSPERF ContainerVSPERF-594

Status
colourGreen
titleCOMPLETED

Results Container

All 5 - Infrastructure, End-Of-Test-Results, Live-Results, Events from VSPERF/Sw-Tools, Environment details

VSPERF-595

Status
colourGreen
titleCompleted

Usability : Configuration wizard ( CLI)

VSPERF-543

Status
colourGreen
titleCompleted

VSPERF Upgrades - PythonVSPERF-605

Status
colourGreen
titleCompleted

VSPERF Upgrades - OVS, DPDK and VPPVSPERF-606

Status
colourGreen
titleCompleted

Hunter Release Plan


Feature DetailsJIRA IDContactStatus
Live Results: Spirent, T-RexVSPERF-524

Status
colourGreen
titleCompleted

Testcase: Imix (Spirent) SupportVSPERF-521

Status
colourGreen
titleCompleted

Test Case: OVS-Conntrack rules impact analysis.

VSPERF-545

Status
colourRed
titlePostponed

IMIX Support : Xena Traffic GeneratorVSPERF-596

Status
colourRed
titlePostponed

Advanced L3-Cache management - Intel RMD

VSPERF-584

VSPERF-585

Status
colourRed
titlePostponed

Testcase: Cross-Numa Performance BenchmarkingVSPERF-597

Status
colourGreen
titleCompleted

Logstash/Fluentd Writer

Related to Results Container (VSPERF-595)

VSPERF-586


Status
colourGreen
titleCompleted

Resolve CI Issues

Status
colourGreen
titleCompleted

Experience VSPERF on Virtualbox

Status
colourGreen
titleCompleted

Gambia Release Plan


Feature DetailsJIRA IDContactStatus

Comparative Studies: CSIT, NFVBench, Yardstick, Bottlenecks


VSPERF-540,

VSPERF-541

Initiated: Trevor Cooper

Responsibility:  Sridhar Rao 

Mars Toktonaliev

Status
colourGreen
titleCompleted

Results Improvement : Latency Histogram (Spirent)

VSPERF-522

Status
colourGreen
titleCompleted

VSPERF-Xena Enhancements

VSPERF-575

VSPERF-582

Status
colourGreen
titleCompleted

Status
colourGreen
titleCompleted

VSPERF-OVS Enhancements

VSPERF-580

VSPERF-577

VSPERF-578

VSPERF-581

VSPERF-570

Status
colourGreen
titleCompleted

Status
colourGreen
titleCompleted

Status
colourGreen
titleCompleted

Status
colourGreen
titleCompleted

Status
colourGreen
titleCompleted

VSPERF-VPP Enhancements


VSPERF-VSWITCH Architecture EnhancementVSPERF-579

Status
colourGreen
titleCompleted

TREX Enhancements: Burst traffic type, Scapy Frame Definition, Customized Scapy Version,

VSPERF-562 VSPERF-565, VSPERF-566,

Status
colourGreen
titleCompleted

Testcase: Continuous StreamVSPERF-568@Julien Meunier

Status
colourGreen
titleCompleted

Tools Enhancement: Pidstat

VSPERF-569@Julien Meunier

Status
colourGreen
titleCompleted

Testcase: Custom StatisticsVSPERF-572

Status
colourGreen
titleCompleted

Ixia Script enhancementsVSPERF-149

Status
colourGreen
titleCompleted

Tunneling protocol supportVSPERF-573

Status
colourGreen
titleCompleted

Testplans for Benchmarking vSwitch in Containerized Environments

Status
colourGreen
titleCompleted

Stability Improvements
Multiple

Status
colourGreen
titleCompleted

Xena - Benchmarking with Multi-flows
Bob Fubel

Status
colourGreen
titleCompleted

Fraser Plan.

Feature DetailsJIRA IDContactStatus
Tool Support: Integration of Collectd as Monitoring toolVSPERF-505
Status
colourGreen
titleCompleted
Tool Support: Integration of RDT Cache Management tool to improve vSwitch performance under NN-conditions.VSPERF-544

Initiated: Trevor Cooper

Responsibility:  Sridhar Rao 

Status
colourGreen
titleCompleted
Tool Support: VMs (Stress-NG and Spirent Cloudstress) as Load-generatorsVSPERF-504

Status
colourGreen
titleCompleted

Test Case: Noisy Neighbor TestVSPERF-523

Unassigned

 Sridhar Rao 

Status
colourGreen
titlecompleted
Test Case: regression tests cases DPDK, OVSVSPERF-539
Status
colourGreen
titlecompleted
Test Case: OVS-Conntrack rules impact analysis.VSPERF-545
Status
colourYellow
titleIn Progress
Standardization Support: Back-to-Back Frame Testing - IETF.VSPERF-549

Initiated: Al Morton 

Status
colourYellow
titleIn Progress
Standardization Support: ETSI NFV TST009VSPERF-552
Status
colourYellow
titleIn Progress
T-Rex Support Improvement

VSPERF-546

VSPERF-547

VSPERF-559

Status
colourGreen
titleCompleted

Additional improvementsVSPERF-548

Status
colourGreen
titleCompleted

Miscelleneous:

Expand requirements of Soak/Long Duration Tests

Updated build scripts for Centos and RHEL to python34

VSPERF-557

VSPERF-558

Status
colourGreen
titleCompleted

Testcases: T-Rex as VMVSPERF-560

Status
colourGreen
titleCompleted

Fraser Deadlines

Image Modified

Danube

Deliverables: VSPERF Release D JIRA Issues


Project plan per the milestones described at Danube.

Milestone

Status/Plan

Notes

(MS0) Open Intent to ParticipateDone
(MS1) Planning complete (scenarios or deliverables defined)10/25/16
(MS2) Detailed test case descriptions communicated to test project teams11/22/16
(MS3) Installer integration with OpenStack completed11/30/16
(MS4) Infrastructure updates completed12/6/16
(MS5) Scenario integration and Feature Freeze completed1/13/17
(MS6) Test cases implemented, preliminary documentation completed, and stable branch open1/26/17
(MS7) Stable branch window close3/10/17
(MS8) Formal test execution completed3/20/17
(MS9) JIRA issues assigned to release closed or deferred3/22/17
(MS10) Documentation completed3/24/17

(MS11) Release Danube 1.0

3/27/17

(MS12) Release Danube 2.0

5/4/17
(MS13) Release Danube 3.06/8/17



Rel C VSPERF Sprint and Backlog

ReleaseFeature Detail

Jira Number

Rel CIntegration with YardstickVSPERF -276
Rel CMoving to SW Traffic Generator (MoonGen)VSPERF - 277
Rel C

Installer Integration extension of capabilities (Fuel)

VSPERF- 278
Rel CIntegration with Functest results API onlyVSPERF - 279
Rel CInstaller Integration extension of capabilities (Apex)VSPERF -280


Project Dependencies 

  • Moongen for SW Traffic Generator (JIRA VSPERF-168)
  • Yardstick integration (JIRA Yardstick -109)
  • Fuel 9 plugin (needs to be updated) and any other requirements that are needed to run under yardstick
  • POD 3 ( two new servers that will be setup as sandbox and CI needs to migrated to existing servers) (JIRA Pharos- 129)

Project Timeline (these dates are tentative)

  • Feature Code Freeze Mid June 
  • Test Code Freeze July 
  • Integration Ready August

Upstream Dependencies  

Release B VSPERF Scrum Board and backlog

Brahmaputra Release

Goals

Our goals for the VSPERF test framework this release are:

...

  • Support IP routing on the switch, as well as simple port forwarding
  • RFC2544 Scalability tests (Implementation)
  • LTD.Throughput.RFC2544.Profile (Implementation)
  • LTD.Throughput.RFC2544.SystemRecoveryTime (Implementation)

Timeline

JIRA

https://jira.opnfv.org/browse/VSPERF-75

Make sure stories reference this Epic and have the VSPERF and R2 Label

Sprints

Active Sprint

Sprint Backlog

Interaction with other OPNFV projects

We would like to collaborate with Yardstick on their vswitch performance tests and the OPNFV dashboard for Release B.