-
Notifications
You must be signed in to change notification settings - Fork 388
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Nethermind not pushing metrics to Pushgateway? #6916
Comments
I was able to reproduce the issue on Mac with sedge. It feels like a configuration issue though, since the push gateway is working for our test nodes (although, we use a centralized instance). @stdevMac or @cbermudez97 maybe you can take a look at it? |
I also face similar issue, I'm running
Below is the scrape configs in my prometheus.yml file
I run Nethermind with this configs specified:
Here is an image that shows Pushgateway service active and running. Update: change "--Metrics.PushGatewayUrl http://127.0.0.1:9091 " in nethermind command to "--Metrics.PushGatewayUrl http://127.0.0.1:9091/metrics/" |
I have the same issue. Grafana runs. Nethermind runs. But when I access my Nethermind Dashboard in Grafana I get "no sync data" and the page is blank. Here is the output of localhost:9091/metrics/ for me:
|
This is indeed the solution for me, great find @chrisemmanuel17! |
Description
Despite setting both flags: --Metrics.Enabled true --Metrics.PushGatewayUrl http://pushgateway:9091 metric data does not seem to be sent to Pushgateway and group/instance remains empty.
Steps to Reproduce
Following: https://docs.nethermind.io/monitoring/metrics/setting-up-local-metrics-infrastracture => https://github.com/NethermindEth/metrics-infrastructure
I'm using latest docker images for both Nethermind (1.25.4) and Pushgateway. (1.8.0)
When I set the above flags for Nethermind, the metric page in the Pushgateway interface remains empty.
Actual behavior
No errors/exceptions reported and Nethermind is able to connect to the PushGatewayUrl http endpoint just fine.
Stopping the Pushgateway container, does give exceptions in Nethermind about not being able to connect to the given PushGatewayUrl. (so its not a network connectivity issue between both containers)
Upping the logging level and sifting through the logs, I found this:
Expected behavior
Metrics pushed by Nehtermind to Pushgateway should be visible on the metrics page in the Pushgateway interface.
Manually posting data with curl (from the docker host) to Pushgateway does work successfully and appears on the metric page, using following command:
Desktop (please complete the following information):
The text was updated successfully, but these errors were encountered: