Comments (7)
FYI, we have recently released new version of Prometheus exporter plugin (for OpenSearch 1.3.0.) here https://github.com/aiven/prometheus-exporter-plugin-for-opensearch/releases/tag/1.3.0.0
Happy to discuss any missing features in /issues section.
from opensearch-k8s-operator.
Thanks for the note @lukas-vlcek . We still haven't setup the monitoring through prom/grafana. If you would like to join the project and contribute the monitoring integration that would be great.
from opensearch-k8s-operator.
@segalziv what would be the metrics you would like to export. I can try to raise a PR adding prometheus exporter to the controler
from opensearch-k8s-operator.
@albertollamaso thanks. We plan to integrate one of the OpenSearch open source plugins for Prometheus exporter.
Either
https://github.com/aiven/prometheus-exporter-plugin-for-opensearch which is updated, or
https://github.com/aparo/opensearch-prometheus-exporter
The idea is that once adding config to the cluster CRD, it would install the plugin, and export through service. That's a high level draft, open to suggestions.
from opensearch-k8s-operator.
@segalziv: the one from aparo is AFAIK discontinued, the maintained one is the one from aiven.
once an application exposes the prometheus metrics on an unsecured HTTP endpoint you can "just" add the following k8s annotations (to the template
of the StatefulSet
in this case, not the StatefulSet
itself, of course):
annotations:
prometheus.io/scrape: 'true'
prometheus.io/scheme: 'http'
prometheus.io/port: '9200'
prometheus.io/path: '/_prometheus/metrics'
and of course add a NetworkPolicy
which grants prometheus access to it.
the main issue will be that the security plugin interferes with the prometheus plugin, see Aiven-Open/prometheus-exporter-plugin-for-opensearch#60 (and the older issues linked there at the beginning).
the discussion in this ticket so far has centered around OpenSearch. what about OpenSearch Dashboards (i'm not aware of a prometheus exporter plugin for it yet, there was this discussion on the one for kibana a while ago: pjhampton/kibana-prometheus-exporter#235)? and what about the opensearch-k8s-operator itself (you'd have to collect metrics and expose them on an HTTP endpoint and annotate your pods accordingly)?
note that it doesn't hurt to have this enabled even if somebody wouldn't have prometheus set up - then there are just a couple of additional endpoints running, exposing metrics and that's it.
from opensearch-k8s-operator.
Hey @rursprung, quick question - is the exporter is able to work with security plugin enabled? if it is, please add to the CRD under 'general' an Boolean 'exporter' filed, if it set to true, add the annotations and expose the metrics.
about opensearch-dashboard && opensearch-k8s-operator itself, lets focus on the opensearch exporters for now, when we will have the working logic of it we will add support for all the other exporters .
Thanks, let me know of you have any question
from opensearch-k8s-operator.
Implemented on that PR, closing the issue
#415
from opensearch-k8s-operator.
Related Issues (20)
- [BUG] OpenSearch operator panics and crashes when adding an OpenSearchISMPolicy HOT 1
- [BUG] Opensearch data node get's constantly excluded from shard allocations HOT 2
- [BUG] Operator is not Istio Servicemesh Bulletproof HOT 1
- Support managing snapshot policies HOT 2
- [BUG] Missing Options to set labels/annotations for "bootstrap" and "securityconfig-update-job" HOT 1
- [BUG] Operator cannot reliably bootstrap a cluster HOT 2
- [BUG] ISM policy "allocation" not working through CRD
- [BUG] Operator 2.6.0 can't be uninstalled cleanly due to finalizer
- [BUG] Operator certificate generation / renewals not working HOT 4
- [BUG] What are the ways to enable ssl hot reload?
- [FEATURE] Allow CRDs to target an `OpenSearchCluster` in another namespace HOT 2
- [BUG] Missing snapshotRepositories in Helm Chart (opensearch-cluster) Template HOT 1
- What is the diff between master role vs data role vs cluster_manager role? HOT 3
- [PROPOSAL] OpenSearchISMPolicy.applyToExistingIndices HOT 1
- [BUG] ISM CRD allocation action is broken
- [PROPOSAL] Seperate the operator helm chart release with the actual operator release HOT 2
- [PROPOSAL] Add the capability to use RoleBindings instead of ClusterRoleBindings
- [FEATURE] Allow overriding image spec for node group
- [BUG] ISM policies and index templates are constantly updated
- How to get common pvc for all nodes?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from opensearch-k8s-operator.