October 02, 2018
Meeting minutes:
Notes from last meeting:
Demo from Barometer:
- Possibly create a demo and record it?
- Demo around containers/VM with metrics
- Float around few ideas, get comments over next calls
- Find a new way to use Barometer, would be good
- Demo ideas:
- Barometer for system tests/debugging.
- Look at network interfaces, OVS stats, etc., to track whats happening in an openstack deployment
- Need to know if there are any openstack deployments already available in opnfv pods
- Have a real time demo to show graphana dashboards in opnfv pods
Agenda:
- Status of Release
- What do we want in the release?
virt plugin enhancements Virt plugin should be enhanced to provide the following additional details:
Release G X X BAROMETER-99 - Virt plugin enhancement -- VM names OPEN
ovs-dpdk-stats The ovs-dpdk-stats plugin should include extended dpdk stats per interface Release G X X BAROMETER-96 - Enable OVS-DPDK PMD Statistics OPEN
ovs-dpdk-events link statusThe ovs-dpdk-events plugin should indicate link status change eventsRelease GXXBAROMETER-109 - ovs-events link status OPENDMA Functionality The DMA Local Agent will provide the following features:
- Local processing of metrics – Allows metrics to be sampled at a higher rate than storage rate for detection of short-lived conditions.
- Runtime configuration of collectd – Collectd configuration can be managed remotely with the Local Agent providing the writing of collectd configuration and collectd restart.
- Simple OpenStack metadata discovery – Provide runtime information related to the mapping between virtual and physical elements. The metadata can be attached to metric sent by collectd.
Release G X X BAROMETER-95 - The DMA project will provide additional functional for the Barometer project OPEN
DMA Container Add DMA container build Release G X X BAROMETER-94 - The DMA project will exist as a container separate from the collectd container OPEN
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface The ovs stats plugin collects the right set of data in case the dpdk interfaces are mapped directly under the ovs bridge. But for the use case where a bonding interface is needed underneath the ovs bridge, ovs stats cannot pull the dpdk interface statistics.
Release G X X BAROMETER-92 - Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface OPEN
- Original plan stalled by no release from Collectd.
- virt plugin enhancements – Complete waiting on release
- ovs-dpdk-stats –
- DMA Functionality - In progress
- DMA Container - In progress
- Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface – completed waiting on release
- Participation in https://openmetrics.io/
Updates from last week:
- Changed the Kolla container to include almost all Collectd plugins, taken from latest stable branch
- Plugins are still taken from RPM build, relying on release version of Collectd
- Not included plugins would gaming plugins, etc.
- This is a great progress
- No new updates about community release of Collectd
- Intel team will prioritize backporting once Ansible script work is done
- Collectd code reviews:
- Lot of PRs, will take some time
- The DPDK patch got merged, need to backport to 5.8
- Sunku will ask the patch author to backport
- Ansible scripts work:
- Testing/validation on Ubuntu 16.04, 18.04 & Centos 7.5
- Centos 7.3 had docker issues, related to docker missing packages
- Latest docker Images is based on 7.5.3
- Centos 7.5 images (qcow2) have different naming scheme, very similar to Ubuntu 18.04
- There shouldn’t be any regressions, upgrading from 7.3 to 7.5.
- We can look in to if we need to on 7.3
- Require your help to review as patches are upstreamed
- Milestone 8 – Oct 30th
- Its not being pushed back
- Review help:
- Have 4 to 5 reviews pending in Barometer gerrit
- Require reviews
- Prometheus and Barometer
- Should Barometer participate in the standardization effort under way in Prometheus. (Yes!)
- Driven by Prometheus for data format
- Mentioned at Fosdem & Prometheus conference
- Standard is named as open metrics, submitted to IEEE
- Gone quite far, need 3 implementations of metrics format for this standard
- Google is doing one implementation, 2nd one by Prometheus community
- Trying to standardize data exchange format
- While Prometheus only supports metrics, standards also supports logs.
- Value of all this info is the correlation part
- Matthias would send more info.
- Need to make sure it wont impact our implementations of metrics in hardware/infrastructure level
- The community is not generally attuned to lower layers.
- Bring Barometer’s experience in monitoring the infrastructure.
- End result could be too PaaSy ;)
- Should Barometer participate in the standardization effort under way in Prometheus. (Yes!)
09/25/2018
Meeting minutes:
...
Good discussion around what service providers really want to use related to telemetry
Node Exporter vs. Collectd vs. No additional agents
Not everything is or will be cloud native
Multi-VIM environments
Filed exception for MS5
In approval process
Milestones
MS69/07/18
Test case implementation completed.
Preliminary documentation completed.
Complete documentation compliance table for MS6.
First day that projects may request creation of the stable branch for their project.
MS79/21/18
Last day that projects may request creation of the stable branch for their project.
Any project not yet branched will be branched by LF.
Thanks for the heads up on Doc change Emma
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
Tracked with https://github.com/collectd/collectd/issues/2858
PR submitted --https://github.com/collectd/collectd/pull/2865
This option seems to be the most popular
Looking for reviewers
Add support for 'collectd-master' container
Need reviewers
Release Plan Items
Virt plugin enhancement -- VM names
Milestone 5.9
Work completed, needs to be merged into collectd
Enable OVS-DPDK PMD Statistics
Some related merges upstream in OVS
https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c
DMA functionality
DMA container
Fix functest
Waiting internal review
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
Tracked with https://github.com/collectd/collectd/issues/2858
PR submitted --https://github.com/collectd/collectd/pull/2865
This option seems to be the most popular
Looking for reviewers
Additional virt plugin functionality (VM Naming)
PR ready for reviews
Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)
08/28/2018
Filed exception for MS5
Milestones
MS58/24/18
Scenario integration completed
All scenarios have deploy jobs in OPNFV CI
Scenario status page is locked. No new scenarios may be added. However, scenario owners may request the removal of a scenario.
MS69/07/18
Test case implementation completed.
Preliminary documentation completed.
Complete documentation compliance table for MS6.
First day that projects may request creation of the stable branch for their project.
MS79/21/18
Last day that projects may request creation of the stable branch for their project.
Any project not yet branched will be branched by LF.
Dev Updates
Release Plan Items
Virt plugin enhancement -- VM names
Milestone 5.9
Work completed, needs to be merged into collectd
Enable OVS-DPDK PMD Statistics
Some related merges upstream in OVS
https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c
DMA functionality
DMA container
Fix functest
Waiting internal review
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
Tracked with https://github.com/collectd/collectd/issues/2858
PR submitted --https://github.com/collectd/collectd/pull/2865
This option seems to be the most popular
Looking for reviewers
Additional virt plugin functionality (VM Naming)
PR ready for reviews
Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)
Red Fish
Collectd module completed
...
Dev Updates
Waiting internal review
Week 33?
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
Tracked with https://github.com/collectd/collectd/issues/2858
PR submitted --https://github.com/collectd/collectd/pull/2865
This option seems to be the most popular
Looking for reviewers
PR ready for reviews
Week 33?
Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)
Enable OVS-DPDK PMD Statistics
Some related merges upstream in OVS
https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c
Virt plugin enhancement -- VM names
Milestone 5.9
Red Fish
Collectd module completed
OPNFV Testing Harmonization
Self-healing Sig Update
08/14/2018
Dev Updates
Waiting internal review
Week 33?
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
Tracked with https://github.com/collectd/collectd/issues/2858
PR submitted --https://github.com/collectd/collectd/pull/2865
This option seems to be the most popular
Looking for reviewers
PR ready for reviews
Week 33?
Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)
Enable OVS-DPDK PMD Statistics
Some related merges upstream in OVS
https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c
Virt plugin enhancement -- VM names
Milestone 5.9
Red Fish
Collectd module completed
Upcoming milestones (Update with outcome)
MS6 -- August 24
Test cases implemented, preliminary documentation completed, and stable branch open
Major feature should at least be proposed and partly reviewed at this time.
Functest support should be mostly done (tests upstreamed for collectd-plugins), bug fixes are okay after this date but no new tests.
MS7 -- September 14
Stable branch window close
Need to offer help to collectd to get the next release out (5.9)
Contact maintainers and ask “what can I do to help?”
Also, join #collectd on Freenode if possible
Won’t make Gambia, given that we would need to provide config, docs, validation in Barometer once it is closed; However, we should continue to help.
New RFEs (NEEDINFO)
OPNFV Testing Harmonization
Self-healing Sig Update
...
- Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)
07/30/2018
Dev Updates
Write redis plugin enable
Need +1
Upcoming milestones
MS6 -- August 24
Test cases implemented, preliminary documentation completed, and stable branch open
Need to have development “mostly” complete by then
MS7 -- September 14
Stable branch window close
Need feedback on the following list of collect plugins
Feedback will help prioritize work
Need to offer help to collectd to get the next release out (5.9)
Contact maintainers and ask “what can I do to help?”
Also, join #collectd on Freenode if possible
Openstack voting has begun
07/24/2018
Dev Update
Thanks for the update Radoslow
Do you think the fix will be a lot of work?
Tentative schedule
Write redis plugin enable
Late comment
Moving forward?
Upcoming milestones
MS6 -- August 24
Test cases implemented, preliminary documentation completed, and stable branch open
Need to have development “mostly” complete by then
MS7 -- September 14
Stable branch window close
Need feedback on the following list of collect plugins
Feedback will help prioritize work
Need to offer help to collectd to get the next release out (5.9)
Contact maintainers and ask “what can I do to help?”
Also, join #collectd on Freenode if possible
Openstack voting has begun
...