Anuket Project

VSwitchPerf Release Plan

This Page will maintain the release plans for VSPERF


Jerma Release Plan

Jerma release will include CN-Benchmarking, Container Metrics and Enhanced analytics features as the main outcomes.


Feature DetailsJIRA IDContactStatus

Integration with X-Testing  

Outcome of VSPERF-594 and VSPERF-595

VSPERF-604

Sridhar Rao


Container Networking Benchmarking - Setup AutomationVSPERF-607Emanuele Urselli, Parth Yadav
Container Networking Benchmarking - TestingVSPERF-608

Sridhar Rao Parth Yadav


Container Metrics - agent and visualization

Parth Yadav


Enhanced Analytics.

Adarsh Yadav Aditya Srivastava


Live-Results from Ixia TGen
Ancuta Enache
Enhanced Results Container and VM

Adarsh Yadav Aditya Srivastava


TST-009 Testcases

VSPERF-583

Al Morton


VSPERF With OpenstackVSPERF-619

Sridhar Rao


Iruya Release Plan

Iruya release will include Containerization of VSPERF and Newer software versions as the main outcomes.


Feature DetailsJIRA IDContactStatus
VSPERF ContainerVSPERF-594

Sridhar Rao

shailesh chauhan

COMPLETED

Results Container

All 5 - Infrastructure, End-Of-Test-Results, Live-Results, Events from VSPERF/Sw-Tools, Environment details

VSPERF-595

Sridhar Rao

COMPLETED

Usability : Configuration wizard ( CLI)

VSPERF-543

Sridhar Rao

COMPLETED

VSPERF Upgrades - PythonVSPERF-605

Sridhar Rao

COMPLETED

VSPERF Upgrades - OVS, DPDK and VPPVSPERF-606

Sridhar Rao

COMPLETED

Hunter Release Plan


Feature DetailsJIRA IDContactStatus
Live Results: Spirent, T-RexVSPERF-524
Sridhar Rao

COMPLETED

Testcase: Imix (Spirent) SupportVSPERF-521

 Sridhar Rao 

COMPLETED

Test Case: OVS-Conntrack rules impact analysis.

VSPERF-545

Christian Trautman Bob Fubel

POSTPONED

IMIX Support : Xena Traffic GeneratorVSPERF-596

Bob Fubel Christian Trautman

POSTPONED

Advanced L3-Cache management - Intel RMD

VSPERF-584

VSPERF-585

Sridhar Rao

sunku ranganath

POSTPONED

Testcase: Cross-Numa Performance BenchmarkingVSPERF-597

COMPLETED

Logstash/Fluentd Writer

Related to Results Container (VSPERF-595)

VSPERF-586


COMPLETED

Resolve CI Issues
Mars Toktonaliev

COMPLETED

Experience VSPERF on Virtualbox
Sridhar Rao

COMPLETED

Gambia Release Plan


Feature DetailsJIRA IDContactStatus

Comparative Studies: CSIT, NFVBench, Yardstick, Bottlenecks


VSPERF-540,

VSPERF-541

Initiated: Trevor Cooper

Responsibility:  Sridhar Rao 

Mars Toktonaliev

COMPLETED

Results Improvement : Latency Histogram (Spirent)

VSPERF-522

 Sridhar Rao 

COMPLETED

VSPERF-Xena Enhancements

VSPERF-575

VSPERF-582

Christian Trautman Bob Fubel

COMPLETED

COMPLETED

VSPERF-OVS Enhancements

VSPERF-580

VSPERF-577

VSPERF-578

VSPERF-581

VSPERF-570

Martin Klozik

Martin Klozik

Martin Klozik

Bob Fubel Christian Trautman

@Julien Meunier

COMPLETED

COMPLETED

COMPLETED

COMPLETED

COMPLETED

VSPERF-VPP Enhancements


VSPERF-VSWITCH Architecture EnhancementVSPERF-579
Martin Klozik

COMPLETED

TREX Enhancements: Burst traffic type, Scapy Frame Definition, Customized Scapy Version,

VSPERF-562 VSPERF-565, VSPERF-566,
Martin Klozik

COMPLETED

Testcase: Continuous StreamVSPERF-568@Julien Meunier

COMPLETED

Tools Enhancement: Pidstat

VSPERF-569@Julien Meunier

COMPLETED

Testcase: Custom StatisticsVSPERF-572
Richard Elias

COMPLETED

Ixia Script enhancementsVSPERF-149

Martin Klozik

COMPLETED

Tunneling protocol supportVSPERF-573

Martin Klozik

COMPLETED

Testplans for Benchmarking vSwitch in Containerized Environments

COMPLETED

Stability Improvements
Multiple

COMPLETED

Xena - Benchmarking with Multi-flows
Bob Fubel

COMPLETED

Fraser Plan.

Feature DetailsJIRA IDContactStatus
Tool Support: Integration of Collectd as Monitoring toolVSPERF-505
 Sridhar Rao 
COMPLETED
Tool Support: Integration of RDT Cache Management tool to improve vSwitch performance under NN-conditions.VSPERF-544

Initiated: Trevor Cooper

Responsibility:  Sridhar Rao 

COMPLETED
Tool Support: VMs (Stress-NG and Spirent Cloudstress) as Load-generatorsVSPERF-504
Sridhar Rao

COMPLETED

Test Case: Noisy Neighbor TestVSPERF-523

Unassigned

 Sridhar Rao 

COMPLETED
Test Case: regression tests cases DPDK, OVSVSPERF-539
Martin Klozik
COMPLETED
Test Case: OVS-Conntrack rules impact analysis.VSPERF-545
Christian Trautman 
IN PROGRESS
Standardization Support: Back-to-Back Frame Testing - IETF.VSPERF-549

Initiated: Al Morton 

IN PROGRESS
Standardization Support: ETSI NFV TST009VSPERF-552

Al Morton

IN PROGRESS
T-Rex Support Improvement

VSPERF-546

VSPERF-547

VSPERF-559

Christian Trautman

COMPLETED

Additional improvementsVSPERF-548
Martin Klozik 

COMPLETED

Miscelleneous:

Expand requirements of Soak/Long Duration Tests

Updated build scripts for Centos and RHEL to python34

VSPERF-557

VSPERF-558

Christian Trautman

Al Morton

COMPLETED

Testcases: T-Rex as VMVSPERF-560
Martin Klozik

COMPLETED

Fraser Deadlines

Danube

Deliverables: VSPERF Release D JIRA Issues


Project plan per the milestones described at Danube.

Milestone

Status/Plan

Notes

(MS0) Open Intent to ParticipateDone
(MS1) Planning complete (scenarios or deliverables defined)10/25/16
(MS2) Detailed test case descriptions communicated to test project teams11/22/16
(MS3) Installer integration with OpenStack completed11/30/16
(MS4) Infrastructure updates completed12/6/16
(MS5) Scenario integration and Feature Freeze completed1/13/17
(MS6) Test cases implemented, preliminary documentation completed, and stable branch open1/26/17
(MS7) Stable branch window close3/10/17
(MS8) Formal test execution completed3/20/17
(MS9) JIRA issues assigned to release closed or deferred3/22/17
(MS10) Documentation completed3/24/17

(MS11) Release Danube 1.0

3/27/17

(MS12) Release Danube 2.0

5/4/17
(MS13) Release Danube 3.06/8/17



Rel C VSPERF Sprint and Backlog

ReleaseFeature Detail

Jira Number

Rel CIntegration with YardstickVSPERF -276
Rel CMoving to SW Traffic Generator (MoonGen)VSPERF - 277
Rel C

Installer Integration extension of capabilities (Fuel)

VSPERF- 278
Rel CIntegration with Functest results API onlyVSPERF - 279
Rel CInstaller Integration extension of capabilities (Apex)VSPERF -280


Project Dependencies 

  • Moongen for SW Traffic Generator (JIRA VSPERF-168)
  • Yardstick integration (JIRA Yardstick -109)
  • Fuel 9 plugin (needs to be updated) and any other requirements that are needed to run under yardstick
  • POD 3 ( two new servers that will be setup as sandbox and CI needs to migrated to existing servers) (JIRA Pharos- 129)

Project Timeline (these dates are tentative)

  • Feature Code Freeze Mid June 
  • Test Code Freeze July 
  • Integration Ready August

Upstream Dependencies  

Release B VSPERF Scrum Board and backlog

Release

Plan

Slides

Rel B

vsperf_rel_b_highlevel_plan.xlsx

opnfv_vsperf_brahmaputra_releaseplanning.pptx

Brahmaputra Release

Goals

Our goals for the VSPERF test framework this release are:

  • Support our 3 base deployment scenarios: P2P, PVP and PVVP
  • CI Support and integration for VSPERF
  • Support Vanilla OVS and OVS with DPDK.
  • Support all RFC2544 defined tests.
  • Support IMIX traffic testing with RFC 2544.
  • Support IXIA, Spirent, Moongen and Xena.
  • Participate in opnfv_test_dashboard

Stretch Goal:

  • Support IP routing on the switch, as well as simple port forwarding
  • RFC2544 Scalability tests (Implementation)
  • LTD.Throughput.RFC2544.Profile (Implementation)
  • LTD.Throughput.RFC2544.SystemRecoveryTime (Implementation)

Timeline

JIRA

https://jira.opnfv.org/browse/VSPERF-75

Make sure stories reference this Epic and have the VSPERF and R2 Label

Sprints

Active Sprint

Sprint Backlog

Interaction with other OPNFV projects

We would like to collaborate with Yardstick on their vswitch performance tests and the OPNFV dashboard for Release B.

  • No labels