Comments (3)
Hi @stefanprodan, thanks for your stack. I come up with a simialr problem as @Neru007 and didn't find out the best approach to take.
Actually I have 3 swarm clusters, all separated in different VPC on AWS. One of the swarm is for the tools (Prometheus, Grafana, Jenkins, and so on). The 2 others are production and staging.
I would like to scrape metrics of my production and staging stack from prometheus but I didn't find out how to have this setup dynamically. When on the same swarm cluster, I use the dockerflow/docker-flow-swarm-listener
that communicate with dockerflow/docker-flow-monitor
to automatically reconfigure the scrape config. But this work only within the same swarm cluster as it takes the internal swarm IP of the container to configure the scrape.
Do you think your stack can overcome this limitation? Or do you have any idea how this can be resolved without manually set a scrape config?
from swarmprom.
@hatched-DavidMichon did you solve this issue?
from swarmprom.
@yuklia Not really as I did a workaround by adding manual scrape configs for my production and staging stack.
On AWS I first created private hosted zones for my production and staging stack. On those hosted zones I created SRV entries for my exporters (node-exporters, cadvisor, etc..). Then I created scrape config that point to those SRV entries to dynamically get the list of internal node IPs so prometheus can scrape metrics from them.
This is not ideal because, even if the list of IPs (on the SRV entries) are build up dynamically as I add/remove nodes from my clusters, if dockerflow/docker-flow-monitor
restart, it does not get alerts setup from those 2 stacks because it looks only on the current swarm cluster it's running on.
To have my alerts from production and staging I have to restart dockerflow/docker-flow-swarm-listener
on those 2 stacks so it send the alerts config to prometheus.
Ideally dockerflow/docker-flow-monitor
should accept a list of LISTENER_ADDRESS
to call dockerflow/docker-flow-swarm-listener
on multiple hosts. Same for the DF_GET_NODES_URL
.
from swarmprom.
Related Issues (20)
- How do I clean the history of prometheus? HOT 1
- Updating packages HOT 2
- Docker compose empty environment variables HOT 1
- Grafana Loki integration
- Running swarmprom behind traefik HOT 3
- Docker swarm node - no data showing HOT 1
- Grafana & Caddy service is instantly terminating HOT 3
- Docker Swarm Nodes dashboard empty HOT 1
- Node exporter not starting through docker service create HOT 1
- add blackbox_exporter
- node_meta only contains mapping for 1 host HOT 1
- Mail notification HOT 1
- Mountpoint set to "/", swap file returns NaN and upgrade of containers ? HOT 1
- worker node details are missing in docker swarm node dashboard HOT 1
- swarm_node.rules.yml: no such file or directory
- Replace Unsee with it's successor Karma
- Swarmprom for kubernetes
- node exporter sends whole nodes metrics
- Custom Grafana Dashboards on Startup
- About project future HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from swarmprom.