订阅内容
Linux 

When it comes to performance metrics data collection and visualization on Linux, PCP metrics collection and visualization are key. Red Hat Enterprise Linux (RHEL) 8 provides an excellent framework for collecting performance metrics and visualizing them! The days of poring over command line output to try and figure out what is happening on a system are gone. In this series, I’d like to introduce the power of using Performance Co-Pilot (PCP) and Grafana to visualize system performance data in RHEL.

By default, Performance Co-Pilot is not installed on RHEL 8. We believe in giving users choices and as such, you have to opt-in to using Performance Co-Pilot.

Prerequisites

  1. RHEL 8.3 installed on two servers (in this case our examples are servers with hostnames server-1 and server-2)

  2. Grafana version: grafana-6.7.4-3.el8.x86_64

  3. PCP version: pcp-5.1.1-3.el8.x86_64 

On server-1, run these commands:

yum install pcp-zeroconf -y

systemctl restart pmcd

That’s it! We now have Performance Co-Pilot installed and running on the local server! We can do things like look at the pre-installed performance metrics:

pminfo | wc -l
3101
pminfo | grep kernel | head -n 15
kernel.all.load
kernel.all.intr
kernel.all.pswitch
kernel.all.sysfork
kernel.all.running
kernel.all.blocked
kernel.all.boottime
kernel.all.hz
kernel.all.uptime
kernel.all.idletime
kernel.all.nusers
kernel.all.nroots
kernel.all.nsessions
kernel.all.lastpid
kernel.all.runnable

And then we can report on a metric with pmrep, as such:

pmrep kernel.all.load -s 5
  k.a.load  k.a.load  k.a.load
  1 minute  5 minute  15 minut
                           
  0.020  0.020 0.080
  0.020  0.020 0.080
  0.020  0.020 0.080
  0.020  0.020 0.080
  0.020  0.020 0.080

In the example, I’ve used “-s 5” to indicate that I only want 5 samples of the metric displayed. 

Now that we have Performance Co-Pilot set up, it’s time to use Grafana to give us a good overview of our systems. 

To do that, run the following commands on server-1 to install grafana:

yum install grafana grafana-pcp -y
systemctl enable grafana-server
systemctl start grafana-server
firewall-cmd –add-service=grafana –permanent
firewall-cmd –reload

Now in a browser, we can go to http://server-1:3000 and login with the username of admin and the password of admin. This is the default password, and as soon as you login, you will be prompted to change the admin user’s password to something more secure.

pcp grafana 1 login

Next, we need to click the Configuration cog and then “Plugins.” Once on this page, we’ll search for “Performance Co-Pilot App,” click on it and then click “Enable.” 

pcp grafana 2 configuration

Click on the configuration cog again and go back to “Data Sources.” Click “Add Data Source,” mouse over “PCP Vector” and click the “Select” button that appears. On this form, in the HTTP section, add the url of “http://localhost:44322” and then at the bottom of the form, click “Save & Test.” You should get the message back “Data source is working.”

pcp grafana 3 pcp vector

 Click the Dashboard icon and then click “Manage.” You will see an option for “PCP Vector Host Overview.” Click that option.

pcp grafana 4 dashboard PCP Vector Host Overview

On this Dashboard, we see a live view of metrics data for server-1. We get metrics such as:

  • CPU Percentage

  • Load Average

  • Memory Utilization

  • Disk Utilization

  • Per-CPU busy (user/system)

  • CPU user%,system%,interrupt%,wait%

  • Scheduler context switches per second and runnable processes.

  • Memory Used/Cached/Free/Page Fault Rate/Hard Fault Rate

  • Network throughput in/out

  • Network drops in/out

  • Network packets in/out

  • TCP connections/timeouts/close-waits/time wait/established/listen errors/retransmits

  • Disk latency/iops/throughput/utilization

pcp grafana 5 dashboard So once again, this is a very broad dashboard of host level data that is easy to enable on a RHEL server. When set up in this manner, PCP and grafana provide a nice, on-demand environment for analyzing performance metrics.

In the next post in this series, we’ll expand our use case to explore using pmseries and Redis to store metrics data from across our estate for historical analysis.


关于作者

Karl Abbott is a Senior Product Manager for Red Hat Enterprise Linux focused on the kernel and performance. Abbott has been at Red Hat for more than 15 years, previously working with customers in the financial services industry as a Technical Account Manager.

Read full bio
UI_Icon-Red_Hat-Close-A-Black-RGB

按频道浏览

automation icon

自动化

有关技术、团队和环境 IT 自动化的最新信息

AI icon

人工智能

平台更新使客户可以在任何地方运行人工智能工作负载

open hybrid cloud icon

开放混合云

了解我们如何利用混合云构建更灵活的未来

security icon

安全防护

有关我们如何跨环境和技术减少风险的最新信息

edge icon

边缘计算

简化边缘运维的平台更新

Infrastructure icon

基础架构

全球领先企业 Linux 平台的最新动态

application development icon

应用领域

我们针对最严峻的应用挑战的解决方案

Original series icon

原创节目

关于企业技术领域的创客和领导者们有趣的故事