Skip to main content

Monitoring Validators

There is a Grafana dashboard compatible with all the cosmos-sdk and tendermint based blockchains.

Preview

Let's set it up for our network.

Prerequisites

First install Grafana and Prometheus on your machine.

Enable Tendermint Metrics

sed -i 's/prometheus = false/prometheus = true/g' <YOUR-NODE-HOMEDIR>/config/config.toml

After restarting your node, you should be able to access the tendermint metrics(default port is 26660): http://localhost:26660

Configure Prometheus Targets

Find prometheus.yml file and append the following job under the scrape_configs:

  - job_name: archway
static_configs:
- targets: ['localhost:26660']
labels:
instance: validator

Note: On linux machines this file can be found under this path: /etc/prometheus/prometheus.yml

Resolving Port Conflicts

If you run your archway network and Prometheus on the same machine, you will see one of them cannot run due to a port conflict. Let's resolve it.

Open the ./node-main/config/app.toml file and look for

[grpc]
address = "0.0.0.0:9090"

Then change the port to something else like this:

[grpc]
address = "0.0.0.0:9095"

Restart Prometheus

sudo service prometheus restart

Check the status if the prometheus service is running properly:

systemctl status prometheus.service

If you see some output like this, it means it is running without an issue:

● prometheus.service - Monitoring system and time series database
Loaded: loaded (/lib/systemd/system/prometheus.service; enabled; vendor preset: enabled)
Active: active (running) since Wed 2021-10-06 15:32:48 CEST; 17min ago
Docs: https://prometheus.io/docs/introduction/overview/
Main PID: 457917 (prometheus)
Tasks: 21 (limit: 37746)
Memory: 48.3M
CGroup: /system.slice/prometheus.service
└─457917 /usr/bin/prometheus

Configure Grafana

if you have grafana installed on your machine, you can access it via navigating to this address: http://localhost:3000

The default username and password is admin.

Click on config, then add a data source.

Then select Prometheus from the list and add its URL.

If you have installed it on your machine, the default URL is: http://localhost:9090

Click on Save & test to make sure everything is alright.

Import Grafana Dashboard

Copy and paste the Grafana Dashboard ID 11036 and click on Load to complete importing.

Now you should be able to monitor your validator node.