09/25/2018

Meeting minutes:

Demo from Barometer:

-       Possibly create a demo and record it?

-       Demo around containers/VM with metrics

-       Float around few ideas, get comments over next calls

-       Find a new way to use Barometer, would be good

-       Demo ideas:

• Barometer for system tests/debugging.
  • Look at network interfaces, OVS stats, etc., to track whats happening in an openstack deployment
• Need to know if there are any openstack deployments already available in opnfv pods
• Have a real time demo to show graphana dashboards in opnfv pods

Updates:

-       Changed the Kolla container to include almost all Collectd plugins, taken from latest stable branch

• Plugins are still taken from RPM build, relying on release version of Collectd
• Not included plugins would gaming plugins, etc.
• This is a great progress

-       No new updates about community release of Collectd

• Intel team will prioritize backporting once Ansible script work is done

-       Collectd code reviews:

• Lot of PRs, will take some time
• The DPDK patch got merged, need to backport to 5.8
• Sunku will ask the patch author to backport

-       Ansible scripts work:

• Testing/validation on Ubuntu 16.04, 18.04 & Centos 7.5
• Centos 7.3 had docker issues, related to docker missing packages
• Latest docker Images is based on 7.5.3
• Centos 7.5 images (qcow2) have different naming scheme, very similar to Ubuntu 18.04
• There shouldn’t be any regressions, upgrading from 7.3 to 7.5.
• We can look in to if we need to on 7.3
• Require your help to review as patches are upstreamed

-       Milestone 8 – Oct 30^th

• Its not being pushed back

-       Review help:

• Have 4 to 5 reviews pending in Barometer gerrit
• Require reviews

• Gambia release behind
  • Please have check-ins in good shape before submission
  • Milestones
    • MS7    9/21/18           
      • Last day that projects may request creation of the stable branch for their project.
      • Any project not yet branched will be branched by LF.
      • https://jira.opnfv.org/browse/BAROMETER-106
        • Available in Gerrit
        • https://jira.opnfv.org/browse/BAROMETER-92
          • Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
          • Tracked with https://github.com/collectd/collectd/issues/2858
          • PR submitted --https://github.com/collectd/collectd/pull/2865
            • This option seems to be the most popular
            • Going with Option 3
            • https://gerrit.opnfv.org/gerrit/#/c/61591/1
              • Add support for 'collectd-master' container
  Release Plan Items
• https://jira.opnfv.org/browse/BAROMETER-99
  • • Virt plugin enhancement -- VM names
    • https://github.com/collectd/collectd/pull/2807
    • Milestone 5.9
    • Work completed, needs to be merged into collectd
• https://jira.opnfv.org/browse/BAROMETER-96
  • Enable OVS-DPDK PMD Statistics
  • Some related merges upstream in OVS
  • https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c
• Ansible scripts update
  • https://gerrit.opnfv.org/gerrit/#/c/61575/5
  • Need to have the experimental Barometer container
    • Need a place to send interested parties so they can try out newest features
    • Early feedback is key
    • Showing the host naming in virt plugin in experimental container would be good.
    • If we have hardware, we can have virtualized RDO installed quickly in barometer opnfv pod
      • A simple 1 controller/1 compute node running barometer container each, also on the pod host itself would be good to show metrics collection across all layers.
      • Listing the steps in barometer wiki would be helpful
      • Possibly have a packstack installation on a single machine.
• Prometheus and Barometer
  • Should Barometer participate in the standardization effort under way in Prometheus.  (Yes!)
    • • • Driven by Prometheus for data format
        • Mentioned at Fosdem & Prometheus conference
        • Standard is named as open metrics, submitted to IEEE
        • Gone quite far, need 3 implementations of metrics format for this standard
        • Google is doing one implementation, 2^nd one by Prometheus community
        • Trying to standardize data exchange format
        • While Prometheus only supports metrics, standards also supports logs.
        • Value of all this info is the correlation part
        • Matthias would send more info.
        • Need to make sure it wont impact our implementations of metrics in hardware/infrastructure level
        • The community is not generally attuned to lower layers.
  • Bring Barometer’s experience in monitoring the infrastructure.
  • End result could be too PaaSy ;)

09/18/2018

• • Filed exception for MS5
    • Sept 18th meeting for approval
  • Gambia release behind
  • Milestones
    • MS6    9/07/18 (PAST)          
      • Test case implementation completed.
      • Preliminary documentation completed.
      • Complete documentation compliance table for MS6.
      • First day that projects may request creation of the stable branch for their project.
      • Exception request is approved
    • MS7    9/21/18           
      • Last day that projects may request creation of the stable branch for their project.
      • Any project not yet branched will be branched by LF.
      • Exception request is approved
      • We could cherrypick items and create a stable branch.
  • Agree on "definition of done" →
    • Have the Collectd PRs tracked through Barometer showcased thru experimental containers
    • Experimental container are WIP
    • Need to follow this for individual items in Jira too, update DoD value in every Jira item
  • https://jira.opnfv.org/browse/BAROMETER-106
    • Available in Gerrit
  • https://jira.opnfv.org/browse/BAROMETER-92
    • Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
    • Tracked with https://github.com/collectd/collectd/issues/2858
    • PR submitted --https://github.com/collectd/collectd/pull/2865
      • This option seems to be the most popular
    • Looking for reviewers and feedback!
  • https://gerrit.opnfv.org/gerrit/#/c/61591/1
    • Add support for 'collectd-master' container
    • Need reviewers
    • The CI integration part is WIP, Radek/Emma are following up
  • Review: Ansible scripts
    • https://gerrit.opnfv.org/gerrit/#/c/61575/
    • Need reviews
    • Need to have in Gambia
  • Release Plan Items
    • https://jira.opnfv.org/browse/BAROMETER-99
      • Virt plugin enhancement -- VM names
      • https://github.com/collectd/collectd/pull/2807
      • Milestone 5.9
      • Work completed, needs to be merged into collectd
    • https://jira.opnfv.org/browse/BAROMETER-96
      • Enable OVS-DPDK PMD Statistics
      • Some related merges upstream in OVS
      • https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c

• • Introductions: Vinay Kumar
    • Joined with RedHat, Metrics & Monitoring.
    • Looking in to Gnocchi, AODH, Ceilometer, etc. Interested in integrating Collectd with OpenStack.

• • Necessity of gRPC interface for collectd.
    • Clover project and cloud native WG have proposal to integrate most of OPNFV projects with gRPC interface.
    • GRPC is hot, good thing is binary format is very compact, while http is very verbose using up a lot of bandwidth
    • ONAP talks a lot on using GRPC instead of kafka
    • No downside on having GRPC
    • Good to float the idea within Collectd community
    • Florian & others added in write_prometheus, to enable cloud native
      • It creates a scrape target
      • Superior from Collectd exporter from Prometheus itself
    • Real key is to provide correlation between app metrics and infrastructure metrics. Have them be in common data definitions & timestamps.
      • Collectd timestamps are when metrics are generated
      • Prometheus timestamp is when it gets scraped
      • There is a disconnect
    • We need to keep reminding CN folks about correlation on time/locality, between virtual/physical
    • Need to check for direct integration between Jaeger and Collectd
    • A list of metrics/capabilities through node_exporter in Prometheus might be helpful.
      • Strengths, missing metrics?
      • Get stuff in to node_exporter?
      • CN folks might know as they are from different community than OpenStack, as there are different tools, etc.
    • Aaron to help us out here to get started! 
    • Al to contribute here.

• • Importance of having “hostname” as uniform reporting instead of IPv4 address:
    • Memcached plugin is special -> provide both hostname & IPv4 address. Opened a PR in PuppetCollectd to fix proper reporting.
    • It would be good to have additional text along with hostname, like rack name, tag datacenters
    • Need to work with plugin authors

• • Require following PR Reviews contributed by Intel:
    • Virt: https://github.com/collectd/collectd/pull/2874
    • Intel_rdt: https://github.com/collectd/collectd/pull/2891
    • Trubostat: https://github.com/collectd/collectd/pull/2806
    • Cpufreq: https://github.com/collectd/collectd/pull/2803
    • DPDK stats: https://github.com/collectd/collectd/pull/2924
    • Redfish: https://github.com/collectd/collectd/pull/2926

September 11, 2018

• Good discussion last week around what service providers really want to use related to telemetry.  Do they need to install additional agents for monitoring?

• Node Exporter vs. Collectd vs. No additional agents

• Not everything is nor will be cloud native -- Providing native poll interfaces may not be possible

• Node Exporter is the Prometheus / cloud native agent for collecting data from the hardware.

• Collectd is the historical metrics / events collection agent.  

• Multi-VIM environments

• Need a solution across all environments

• Need a solution for baremetal, switches, SDN, etc...

• Filed exception for MS5

• Missed Sept 11th meeting -- Will be covered in next meeting.

• Gambia release behind

• Milestones

• MS6 9/07/18 (PAST)

• Test case implementation completed.

• Preliminary documentation completed.

• Complete documentation compliance table for MS6.

• First day that projects may request creation of the stable branch for their project.

• MS7 9/21/18

• Last day that projects may request creation of the stable branch for their project.

• Any project not yet branched will be branched by LF.

• https://jira.opnfv.org/browse/BAROMETER-106

• Available in Gerrit

• https://jira.opnfv.org/browse/BAROMETER-92

• Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface

• Tracked with https://github.com/collectd/collectd/issues/2858

• PR submitted --https://github.com/collectd/collectd/pull/2865

• This option seems to be the most popular

• Looking for reviewers and feedback!

• https://gerrit.opnfv.org/gerrit/#/c/61591/1

• Add support for 'collectd-master' container

• Need reviewers

• Release Plan Items

• https://jira.opnfv.org/browse/BAROMETER-99

• Virt plugin enhancement -- VM names

• https://github.com/collectd/collectd/pull/2807

• Milestone 5.9

• Work completed, needs to be merged into collectd

• https://jira.opnfv.org/browse/BAROMETER-96

• Enable OVS-DPDK PMD Statistics

• Some related merges upstream in OVS

• https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c

September 04, 2018

• Good discussion around what service providers really want to use related to telemetry

• Node Exporter vs. Collectd vs. No additional agents

• Not everything is or will be cloud native

• Multi-VIM environments

• Filed exception for MS5

• In approval process

• Milestones

• MS6 9/07/18

• Test case implementation completed.

• Preliminary documentation completed.

• Complete documentation compliance table for MS6.

• First day that projects may request creation of the stable branch for their project.

• MS7 9/21/18

• Last day that projects may request creation of the stable branch for their project.

• Any project not yet branched will be branched by LF.

• Thanks for the heads up on Doc change Emma

• https://gerrit.opnfv.org/gerrit/#/c/58189/

• https://jira.opnfv.org/browse/BAROMETER-92

• Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface

• Tracked with https://github.com/collectd/collectd/issues/2858

• PR submitted --https://github.com/collectd/collectd/pull/2865

• This option seems to be the most popular

• Looking for reviewers

• https://gerrit.opnfv.org/gerrit/#/c/61591/1

• Add support for 'collectd-master' container

• Need reviewers

• Release Plan Items

• https://jira.opnfv.org/browse/BAROMETER-99

• Virt plugin enhancement -- VM names

• https://github.com/collectd/collectd/pull/2807

• Milestone 5.9

• Work completed, needs to be merged into collectd

• https://jira.opnfv.org/browse/BAROMETER-96

• Enable OVS-DPDK PMD Statistics

• Some related merges upstream in OVS

• https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c

• https://jira.opnfv.org/browse/BAROMETER-95

• DMA functionality

• https://jira.opnfv.org/browse/BAROMETER-94

• DMA container

• https://jira.opnfv.org/browse/BAROMETER-106

• Fix functest

• Waiting internal review

• https://jira.opnfv.org/browse/BAROMETER-92

• Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface

• Tracked with https://github.com/collectd/collectd/issues/2858

• PR submitted --https://github.com/collectd/collectd/pull/2865

• This option seems to be the most popular

• Looking for reviewers

• https://jira.opnfv.org/browse/BAROMETER-98

• Additional virt plugin functionality (VM Naming)

• PR ready for reviews

• https://github.com/collectd/collectd/pull/2874

• https://jira.opnfv.org/browse/BAROMETER-102

• Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)

08/28/2018

• Filed exception for MS5

• Milestones

• MS5 8/24/18

• Scenario integration completed

• All scenarios have deploy jobs in OPNFV CI

• Scenario status page is locked. No new scenarios may be added. However, scenario owners may request the removal of a scenario.

• MS6 9/07/18

• Test case implementation completed.

• Preliminary documentation completed.

• Complete documentation compliance table for MS6.

• First day that projects may request creation of the stable branch for their project.

• MS7 9/21/18

• Last day that projects may request creation of the stable branch for their project.

• Any project not yet branched will be branched by LF.

• Dev Updates

• Release Plan Items

• https://jira.opnfv.org/browse/BAROMETER-99

• Virt plugin enhancement -- VM names

• https://github.com/collectd/collectd/pull/2807

• Milestone 5.9

• Work completed, needs to be merged into collectd

• https://jira.opnfv.org/browse/BAROMETER-96

• Enable OVS-DPDK PMD Statistics

• Some related merges upstream in OVS

• https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c

• https://jira.opnfv.org/browse/BAROMETER-95

• DMA functionality

• https://jira.opnfv.org/browse/BAROMETER-94

• DMA container

• https://jira.opnfv.org/browse/BAROMETER-106

• Fix functest

• Waiting internal review

• https://jira.opnfv.org/browse/BAROMETER-92

• Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface

• Tracked with https://github.com/collectd/collectd/issues/2858

• PR submitted --https://github.com/collectd/collectd/pull/2865

• This option seems to be the most popular

• Looking for reviewers

• https://jira.opnfv.org/browse/BAROMETER-98

• Additional virt plugin functionality (VM Naming)

• PR ready for reviews

• https://github.com/collectd/collectd/pull/2874

• https://jira.opnfv.org/browse/BAROMETER-102

• Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)

• https://jira.opnfv.org/browse/BAROMETER-111

• Red Fish

• Collectd module completed

08/21/2018

• Dev Updates

• https://jira.opnfv.org/browse/BAROMETER-106

• Waiting internal review

• Week 33?

• https://jira.opnfv.org/browse/BAROMETER-92

• Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface

• Tracked with https://github.com/collectd/collectd/issues/2858

• PR submitted --https://github.com/collectd/collectd/pull/2865

• This option seems to be the most popular

• Looking for reviewers

• https://jira.opnfv.org/browse/BAROMETER-98

• PR ready for reviews

• https://github.com/collectd/collectd/pull/2874

• Week 33?

• https://jira.opnfv.org/browse/BAROMETER-102

• Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)

• https://jira.opnfv.org/browse/BAROMETER-96

• Enable OVS-DPDK PMD Statistics

• Some related merges upstream in OVS

• https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c

• https://jira.opnfv.org/browse/BAROMETER-99

• Virt plugin enhancement -- VM names

• https://github.com/collectd/collectd/pull/2807

• Milestone 5.9

• https://jira.opnfv.org/browse/BAROMETER-111

• Red Fish

• Collectd module completed

• OPNFV Testing Harmonization

• https://lists.opnfv.org/g/opnfv-tech-discuss/message/21702

• Self-healing Sig Update

• https://etherpad.openstack.org/p/self-healing-project-integrations

08/14/2018

• Dev Updates

• https://jira.opnfv.org/browse/BAROMETER-106

• Waiting internal review

• Week 33?

• https://jira.opnfv.org/browse/BAROMETER-92

• Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface

• Tracked with https://github.com/collectd/collectd/issues/2858

• PR submitted --https://github.com/collectd/collectd/pull/2865

• This option seems to be the most popular

• Looking for reviewers

• https://jira.opnfv.org/browse/BAROMETER-98

• PR ready for reviews

• https://github.com/collectd/collectd/pull/2874

• Week 33?

• https://jira.opnfv.org/browse/BAROMETER-102

• Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)

• https://jira.opnfv.org/browse/BAROMETER-96

• Enable OVS-DPDK PMD Statistics

• Some related merges upstream in OVS

• https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c

• https://jira.opnfv.org/browse/BAROMETER-99

• Virt plugin enhancement -- VM names

• https://github.com/collectd/collectd/pull/2807

• Milestone 5.9

• https://jira.opnfv.org/browse/BAROMETER-111

• Red Fish

• Collectd module completed

• Upcoming milestones (Update with outcome)

• MS6 -- August 24

• Test cases implemented, preliminary documentation completed, and stable branch open

• Major feature should at least be proposed and partly reviewed at this time.

• Functest support should be mostly done (tests upstreamed for collectd-plugins), bug fixes are okay after this date but no new tests.

• MS7 -- September 14

• Stable branch window close

• Need to offer help to collectd to get the next release out (5.9)  

• Contact maintainers and ask “what can I do to help?”

• Also, join #collectd on Freenode if possible

• Won’t make Gambia, given that we would need to provide config, docs, validation in Barometer once it is closed; However, we should continue to help.

• New RFEs (NEEDINFO)

• https://bugzilla.redhat.com/buglist.cgi?bug_status=NEW&bug_status=ASSIGNED&bug_status=ON_DEV&component=collectd&list_id=9247960&product=Red%20Hat%20OpenStack&query_format=advanced

• OPNFV Testing Harmonization

• https://lists.opnfv.org/g/opnfv-tech-discuss/message/21702

• Self-healing Sig Update

• https://etherpad.openstack.org/p/self-healing-project-integrations

08/07/2018

• Dev Updates

• https://jira.opnfv.org/browse/BAROMETER-106

• Waiting internal review?

• https://jira.opnfv.org/browse/BAROMETER-92

• Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface

• PR submitted -- https://github.com/collectd/collectd/pull/2880.

• Looking for reviewers

• https://jira.opnfv.org/browse/BAROMETER-98

• PR ready for reviews

• https://github.com/collectd/collectd/pull/2874

• https://jira.opnfv.org/browse/BAROMETER-102

• Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)

• https://jira.opnfv.org/browse/BAROMETER-96

• Enable OVS-DPDK PMD Statistics

• Some related merges upstream in OVS

• https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c

• https://jira.opnfv.org/browse/BAROMETER-99

• Virt plugin enhancement -- VM names

• https://github.com/collectd/collectd/pull/2807

• https://gerrit.opnfv.org/gerrit/#/c/59209/

• Upcoming milestones (Update with outcome)

• MS6 -- August 24

• Test cases implemented, preliminary documentation completed, and stable branch open

• Major feature should at least be proposed and partly reviewed at this time.

• Functest support should be mostly done (tests upstreamed for collectd-plugins), bug fixes are okay after this date but no new tests.

• MS7 -- September 14

• Stable branch window close

• Need to offer help to collectd to get the next release out (5.9)  

• Contact maintainers and ask “what can I do to help?”

• Also, join #collectd on Freenode if possible

• Won’t make Gambia, given that we would need to provide config, docs, validation in Barometer once it is closed; However, we should continue to help.

• Barometer-related paper submissions

• KubeCon

• Monitoring Tug of War: Matching Cloud Native and Infrastructure Monitoring (Sunku/Aaron)

• OpenStack

• DMA Team

• Barometer on the Edge

• OpenSource Summit (LinuxCon)

• Barometer has two Prom dates

• ONS Europe

• DMA -- Tomo/Aaron

• OPNFV Testing Harmonization

• https://lists.opnfv.org/g/opnfv-tech-discuss/message/21702

• Self-healing Sig Update

• https://etherpad.openstack.org/p/self-healing-project-integrations

07/30/2018

·        Dev Updates

o   https://jira.opnfv.org/browse/BAROMETER-106

[ELF] Patches created; waiting internal approval to upstream

o   https://gerrit.opnfv.org/gerrit/#/c/59635/

§  Write redis plugin enable

§  Need +1

o   https://gerrit.opnfv.org/gerrit/#/c/59209/

o   Upcoming milestones

§  MS6 -- August 24

·        Test cases implemented, preliminary documentation completed, and stable branch open

·        Need to have development “mostly” complete by then

[ELF] Major feature should at least be proposed and partly reviewed at this time.

Functest support should be mostly done (tests upstreamed for collectd-plugins), bug fixes are okay after this date but no new tests.

§  MS7 -- September 14

·        Stable branch window close

·        Need feedback on the following list of collect plugins

o   https://bugzilla.redhat.com/buglist.cgi?bug_status=NEW&bug_status=ASSIGNED&bug_status=POST&bug_status=MODIFIED&bug_status=ON_DEV&bug_status=ON_QA&bug_status=VERIFIED&component=collectd&known_name=collectd-all&list_id=9166173&product=Red%20Hat%20OpenStack&query_based_on=collectd-all&query_format=advanced

o   Feedback will help prioritize work

·        Need to offer help to collectd to get the next release out (5.9)  

o   Contact maintainers and ask “what can I do to help?”

o   Also, join #collectd on Freenode if possible

[ELF] Not likely to be available for Gambia, given that we would need to provide config, docs, validation in Barometer once it is closed; However, we should continue to help.

·        Openstack voting has begun

o   https://www.openstack.org/summit/berlin-2018/vote-for-speakers/#/22013

o   https://www.openstack.org/summit/berlin-2018/vote-for-speakers/#/22000

[ELF] There was a very short voting period this time around, and it’s already closed

AOB:

-        Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)

07/30/2018

• Dev Updates

• https://jira.opnfv.org/browse/BAROMETER-106

• https://gerrit.opnfv.org/gerrit/#/c/59635/

• Write redis plugin enable

• Need +1

• https://gerrit.opnfv.org/gerrit/#/c/59209/

• Upcoming milestones

• MS6 -- August 24

• Test cases implemented, preliminary documentation completed, and stable branch open

• Need to have development “mostly” complete by then

• MS7 -- September 14

• Stable branch window close

• Need feedback on the following list of collect plugins

• https://bugzilla.redhat.com/buglist.cgi?bug_status=NEW&bug_status=ASSIGNED&bug_status=POST&bug_status=MODIFIED&bug_status=ON_DEV&bug_status=ON_QA&bug_status=VERIFIED&component=collectd&known_name=collectd-all&list_id=9166173&product=Red%20Hat%20OpenStack&query_based_on=collectd-all&query_format=advanced

• Feedback will help prioritize work

• Need to offer help to collectd to get the next release out (5.9)  

• Contact maintainers and ask “what can I do to help?”

• Also, join #collectd on Freenode if possible

• Openstack voting has begun

• https://www.openstack.org/summit/berlin-2018/vote-for-speakers/#/22013

• https://www.openstack.org/summit/berlin-2018/vote-for-speakers/#/22000

07/24/2018

• Dev Update

• https://jira.opnfv.org/browse/BAROMETER-106

• Thanks for the update Radoslow

• Do you think the fix will be a lot of work?

• https://jira.opnfv.org/browse/BAROMETER-94

• Tentative schedule

• https://gerrit.opnfv.org/gerrit/#/c/59635/

• Write redis plugin enable

• https://gerrit.opnfv.org/gerrit/#/c/59209/

• Late comment

• Moving forward?

• Upcoming milestones

• MS6 -- August 24

• Test cases implemented, preliminary documentation completed, and stable branch open

• Need to have development “mostly” complete by then

• MS7 -- September 14

• Stable branch window close

• Need feedback on the following list of collect plugins

• https://bugzilla.redhat.com/buglist.cgi?bug_status=NEW&bug_status=ASSIGNED&bug_status=POST&bug_status=MODIFIED&bug_status=ON_DEV&bug_status=ON_QA&bug_status=VERIFIED&component=collectd&known_name=collectd-all&list_id=9166173&product=Red%20Hat%20OpenStack&query_based_on=collectd-all&query_format=advanced

• Feedback will help prioritize work

• Need to offer help to collectd to get the next release out (5.9)  

• Contact maintainers and ask “what can I do to help?”

• Also, join #collectd on Freenode if possible

• Openstack voting has begun

• https://www.openstack.org/summit/berlin-2018/vote-for-speakers/#/22013

• https://www.openstack.org/summit/berlin-2018/vote-for-speakers/#/22000

07/03/2018

• Barometer CI

• Al

• TST010 -- Using Barometer test code to invoke faults

• Lucakz

• Virt plugin enhancements by end of week

• 106 WIP

• John, Prometheus WIP to be removed soon

• Test lab /hardware for Nokia / RedFish

• UNH

• Parker Berberian <pberberian@iol.unh.edu>

• Lincoln Lavoie <lylavoie@iol.unh.edu>

• Sunku to send contacts for Intel

• Pharos Lab

• Non OpenStack installed hardware

• Requestor to send e-mail

• Prometheus / collectd native times stamp

06/12/2018

• Development

• https://jira.opnfv.org/browse/BAROMETER-99

• Apologies on the confusion on who would do the work.

• Thanks for the review

• https://jira.opnfv.org/browse/BAROMETER-96

• Additional clarification added / needed

• https://gerrit.opnfv.org/gerrit/#/c/57807/

• INTEL_PMU loading issue

• https://gerrit.opnfv.org/gerrit/#/c/41405/

• Rename -- Need to check with APEX

• Did new contributors get added?

• Yes!

• Plugfest (Al Morton)

• ETSI NFVI Testing group might be interested in using Barometer

• Might use Barometer to collect metrics during API compliance testing

• Would also like to use fault triggering code from one of the Barometer demos

• Bring an interface down / up, etc…

06/05/2018

• DMA team (Tomo) to present a demo of Local Agent collecting OpenStack metadata.

• One of the features of the DMA project is to collect virtual infrastructure information from OpenStack and make it available to collectd so that metadata can be added to metrics / events.

• Tomo gave a demo of Local Agent using OpenStack API to gather metadata information for use by Collectd.

• Development

• https://jira.opnfv.org/browse/BAROMETER-99

• VM -- Names

• Proposal

• https://jira.opnfv.org/browse/BAROMETER-98

• Variable defined

• Installer Integration -- No_sdn - 6/15/18

• Nomination of new contributors

• Kamil: kamilx.wiatrowski@intel.com

• Lukasz: lukaszx.cybura@intel.com

• Sunku: sunku.ranganath@intel.com

• JC: jean-christophe.bouche@intel.com

• Kevin: kevin.laatz@intel.com

• Self Healing Sig

• Use case templates about DMA project and local healing

• What about 5 9’s

• White paper on Barometer’s role in self-healing / availability

• Originally discussed in Sydney

• What should be included and what people care about

• NEC, Verizon, etc…

• Focus is HA.

• Go over monitoring paper

• Go with Confluence Wiki on Barometer home page

• New dedicated resource for collectd.

• Ryan McCabe (Red Hat)

05/29/2018

• Barometer OS Summit

• Feedback was good

• Questions

• Starting to use collectd, Barometer

• What different plugins available?  Turns out most are already in Barometer

• Prometheus was mentioned -- Mostly about host to get data into Prometheus from collectd.  Not necessarily replacing collectd.

• Virt Plugin

• 3 missing variables.  

• Added to JIRA

• Ovs-stats

• Extended DPDK stats

• JC to check

• PMU Plugin Wiki updates

• Al Morton

• List of VES metrics meeting this week

• Going to agree with Al that IPMI are important.  What will we do with those on ETSI side?

• Give feedback to Al on VES.

• NFVI Monitoring White Paper

• Create google doc

• Start outline

• Should cover why to monitor specific metrics / conditions, not just these are the things that are available to monitor.

• Sunku --

• Had a chat Sando - Paul

• Call at end of week

• Self healing Sig

• List of projects (OPNFV, etc…, )

• Sunku to e-mail...

05/22/2018

• (MS3) Installer integration with OpenStack

• 3.0 Integration / nosdn deploy / run HC  6/15

• 3.1 deploy SDN / pass HC  6/29

• PMU Plugin

• Evaluating options

• JIRA item to track virt plugin metric additions (gaps with ceilometer) -- https://jira.opnfv.org/browse/BAROMETER-98

• JIRA item to track virt plugin VM name enhancements -- https://jira.opnfv.org/browse/BAROMETER-99

• Ceilometer / Collectd parity

• Can Ceilometer be replaced with collectd?

• https://github.com/openstack/collectd-openstack-plugins

• NFVI (OpenStack Services) monitoring

• https://github.com/rochaporto/collectd-openstack

• NFVI Monitoring Whitepaper -- https://jira.opnfv.org/browse/BAROMETER-97

• How to collaborate? Google docs?

05/08/2018 --

• Gambia release planning

• Gambia release will concentrate on maintenance and support of plugins delivered in Fraser release.

• Need to check on status of ovs-dpdk-stats, ovs-dpdk-events plugins

• One or two features might be added -- TBD

• Need code review of container build changes!  Gerrit # -- 53805

• Standards

• VES

• Prometheus

05/01/2018 --

• Gambia Release -- traditional release

• Need scenarios and deliverables defined by May 11

• Gambia Additions

• More information added to virt plugin?

• Cpu pinning

• NUMA node characteristics

• What to do about (mostly) static information?

• Additional plugins?

• May need modification to RAS

• MCElog might be incomplete

• Looking at out of band platform hardware

• Additional containers?

• Ceilometer replacement?

• How to get metadata?

• Need code review of container build changes!  Gerrit # -- 53805

• Standards

• VES

• Prometheus

• Interest in using Prometheus as polling engine / TSDB

• Prometheus_collectd_exporter vs. Prometheus_node_exporter

04/24/2018 --

• Gambia Release

• Traditional, XCI, both?

• Not clear on XCI requirements.  

• When do the tests need to be in place for XCI?

• What are tentative development goals for the Gambia release?

• RPMs / Container build

• New pull request - https://gerrit.opnfv.org/gerrit/#/c/53805/9

• Standards

• All the info we’re collecting will end up in analytic engines

• Analytics processing tasks need info all the way down to the agent layer

• Need to make sure there’s a measurement timestamp to provide context

• Does test008 spec have the flexibility to talk about measurement of network interface using a particular VLAN tag?

• Yes, scope parameter makes that possible

• Scope must be conveyed with the measurements

• VES

• 6.0 specs on the way (next week)

• Multi-VM reqs

• Compass support -- not for Gambia or Fraser?

• Barometer will be supported in Gambia

• HA scenario issues with build

• A problem with OOO?

• Fails every third build or so.

• Will be looked at soon (next week)

• Edge Cloud

• Requirements

• Categories

• Use cases

• Latency

• Use cases where latency is critical

• Example feedback loop?

• What does lightweight mean in the context of edge telemetry?

04/17/2018 --

• Spoke with DMA project team.  They are ok with working in a separate container.  They will swing back in a few weeks with a demo.

• Standards with Al Morton

• No updates

• VES with Bryan Sullivan

• Most work done by Goku

• Bryan will update VES for latest release to make sure it works with everything

• Plan is place to move items forward in Barometer

• RPMs with Leif

• Making progress

• Func tests

• Will not support Compass this cycle

• Collectd pull requests

• Used to be tracked on wiki

• We need to track open pull requests and put them on Barometer development update page: https://wiki.opnfv.org/display/fastpath/Barometer+Development+Updates

• Release

• Gambia path or something else?

• Which track do we follow?

• Continuous delivery

• Flexibility with milestones, since you establish them yourself?

• Bryan doesn’t think we should do traditional path -- not enough resources

• FCI could be a good thing if it marries VES and Barometer

• Edge Cloud

• What are the requirements?

• Need categories

• Always about latency for faults and metrics

• Framework and edge computing use cases would be good

• Is VES a good fit?

• Good for cloud-native

• What is a cloud?  What value does opensource ecosystem get from:

• Common telemetry date model

• Consistent set of mechanisms by which data delivered to collector

• How lightweight?

• Less than 1% CPU, and 5% memory

• Two VES encodings: C and Java

• Goku: tokenized VES data structure

• Overhead of data and complexity of stack

• Go from binary XML to tokenized JSON

• Current implementation is not lightweight but is “easy”

• Use gzip, as it is natively available to HTTP stack (works out of box)

04/10/18 --

• DMA Project discussion

• Positive feedback on DMA proposal.  Want to move forward.

• Work should be done in a separate container.

• Standards

• Al has been reviewing Alok’s VES proposals.  Found some VMWare specific items. Vendor-specific provisions are discouraged.  Al to talk with Alok ;).

• VES is starting to incorporate some TOSCA information.

• Collectd

• Emma suggested that all collectd PRs be from the same fork, Barometer, in order to make collectd aware of who the reviews are for.

• Also, should have more Red Hat people reviewing collectd.  Need to talk with local Red Hatters.

• VES

• Bryan returned.  Wants to keep the VES agent development moving forward.  Did not know about DDS messaging stuff in ONAP. However, see’s that Kafka is not set in stone.  What to do at the edge.

• General

• Next week I will be out.  Andrew Bays will run meeting.

04/03/18 --

• DMA Project

• Presentation given by Tomofumi Hayashi.  Slides available on the wiki.

• Major takeaways…

• Run time reconfiguration of collectd.  There were some questions as to whether this should be a feature of something like an Ansible playbook.

• Topology annotation.  Questions about security and what information would be included.  It was stated that only infrastructure information would be annotated.  

• Data reduction and analysis at the edge.

• DMA project should be an add-on.  Might need to be able to “unwind” project in the future.

• OPNFV Bottlenecks project using Barometer container
  
  

• Development

• Thanks to Emma for updating the docs and helping track down Funtest issues

• Still seeing an error with Functest… seems to be related to Functest, not Barometer.  Emma tracked down the internal Barometer issues!

• Barometer container -> multistage build from RPMs progressing slowly..

• ONS recap

03/20/18 --

• Made MS6...

• Next upcoming milestone, MS7, April 6th -- last day to request a stable branch.  Can request one anytime until then.

• After than MS8, April 16, completion of testing

• Current Fraser status

• api_check failing

• test_add_remove_volume

• test_attach_volume_nowait

• test_detach_volume_nowait

• ….

• Perhaps it was a system / connectivity failure?

• Emma good catch on Hugepages failing fix

• Gnocchi failures

• Results not appearing quickly enough due to Gnocchi archive policy

• Change default policy to High

• AODH failures

• Need to modify the tests to perform specific failure action

• REDFISH Plugin

• Purpose  -- node or rack?

• Design review

• Standards Update

• VES Updates

• Progress on ETSI?

• VES Mobile edge platforms?

• Is there a cadvisor plugin for collectd?

• https://github.com/maier/cadvisor-collectd

• C, Java VES libraries

• Microservice heatbeat

• ONAP flow

• Vendor VNF

• Closed loop control

• Services goes into VNF

• Any missing heatheats

• At the FM layer

03/13/18 --

• Functest debug and then power loss ;(

03/06/18 --

• Milestone 5 complete

• Scenario deployment passed

• Functest failing

• MS6 03/16/18

• Test case implementation completed.

• Preliminary documentation completed.

• Complete documentation compliance table for MS6.

• First day that projects may request creation of the stable branch for their project.

• APEX

• Functests failing

• Virtual deploy -- RDT, Hugepages…  Should we skip during virtual deploy?

• APEX deployment help -- Aaron has a test setup running and can answer questions.

• Collectd

• PRs

• Pcie -- Stuck in review, new PCIe issue request

• pmu plugin / pmu core -- Reviewer comments -- 03/06/2018

• ovs link status -- Is this still relevant?

• AMQP1 -- Needs review

• Connectivity Event -- Reviews in progress

• Process Event -- Reviews in progress

• System Event -- Reviews in progress

• DMA project would like to have another meeting (possibly at ONS)

• Did you get your feedback to Alok?  I know I didn’t yet :(.

• Want to get comments by the 15th

• Produce a spec update by end of March

• Have a weekly update

• VES Update

• VES Project into ETSI

• Parts of the project, metric / event definitions, transport

• Pair things down to what’s important

• 10’s of collectors at present

• VES mobile edge platforms

• CAdvisor plugin for collectd?

• Maybe try in the Barometer container?

02/27/18 --

• Milestone 5 approaching

• Thanks for the help on Apex and Barometer

• Tracked down issue with deploy

• Standards Update

• VES Update

• Barometer containers to be part of RDO release

• Team to work on building Kolla containers

• AMQP1.0 container being built

02/20/18 --

• Collectd on Cumulus

• Open Compute / Networking

• Standards Updates?

• VES Updates?

• Development

• Apex scenarios are currently failing

• Ansible script reviews in progress

• MS5 approaching

• Barometer next?

02/13/18 --

• Should Barometer Graduate? (https://www.opnfv.org/software/technical-project-governance/project-lifecycle)

• Are we a part of enough scenarios (another installer)?

• Would be a good recognition of the work done by Barometer

• Have had good recognition at shows (OpenStack Summit, OPNFV, etc)

• Bryan would be supportive of applying for graduation

• No definitive answer, but positive reception

• Standards Update (Al)

• Meeting with IFA working group completed work on all measurement content.  Al provided an edit / rewrite of the document and resubmitted.

• Discussion of GAPs in Baromter

• https://jira.opnfv.org/browse/BAROMETER-89

• VES Update

• Bryan working on Barometer Kubernetes scenario.  Should be ready soon. Barometer as DaemonSet

• Conversion of VES to gRPC in the testing phase.

• Development Update

• Ansible scripts submitted to Gerrit

• Clarification that plugins not in collectd yet should still make it into Barometer / Fraser

• (MS5) Scenario integration and feature freeze -- 03/02/18

• Good discussion on “What’s next for Barometer”

• Scope expansion -- Should Barometer move beyond metrics / events to policy

• Scope continuation into container space --

• OPNFV Barometer people going to ONS in March

• Aaron

• Al

• Bryan

• ??

·         Filed exception for MS5

o    Sept 18th meeting for approval