Comments (5)
@lispyclouds what is the current state of bob stats? Can you provide a little more context on what you have in mind for this issue?
from bob.
Essentially the intention here is to come up with a comprehensive map of what the state the cluster is in currently. Could be similar to what Elasticsearch provides for instance. Gather as much useful info as possible like:
- Runners connected to the queue and their metadata
- APIServers and their metadata
- The declared queues and exchanges in RabbitMQ
- Versions of things like RabbitMQ, Postgres, Podman etc
- something more useful...
Hence I thought of using the REST API of RabbitMQ as a source of a lot of this. This needs a bit of discovery too as I am not fully sure what all can be obtained and shown as well. 😄
Primary intention is for cluster debugging needs.
from bob.
Maybe the stats can be avoided now that the metrics API is there.
from bob.
Maybe the stats can be avoided now that the metrics API is there.
Partially, this metrics provide informations about the output of the behaviour of bob which is to process pipelines. If you see a lot of pipeline failures for example, is there a way to ask for a health
endpoint? If not, then it would be hard to know why pipelines are failing right? as you said, having a landscape of the cluster can be very handy.
I looking into what would be more useful for bob, there are a couple of issues but I don't know what to prioritize.
from bob.
is there a way to ask for a health endpoint?
We do have a health check endpoint. In addition to that Bob runs a periodic heartbeat that can warn about health issues too.
This is more about debugging or verifying cluster state. For instance nodes not joining the cluster, jobs not being picked up, wrong routing etc.
from bob.
Related Issues (20)
- Enable stopping jobs during container provisioning HOT 2
- Add status when pipeline cannot be paused HOT 1
- Cascade delete resources of a pipeline when a pipeline is deleted
- Make each type of runner listen to its own queue HOT 2
- Record the timestamp of pipeline status changes HOT 19
- Add get started guide for contributors HOT 7
- non-container runner HOT 12
- Add webhook for bob to notice new/changed resources HOT 4
- Test Bob with Bob
- Add support for webhooks HOT 1
- Rename Bob HOT 2
- Allow deploy time config HOT 1
- Event streaming from api-server HOT 14
- Naming of identifier of a run is confusing HOT 3
- Allow testing specific ns HOT 2
- Improve REPL test development HOT 6
- Figure out necessary java modules HOT 3
- Add end to end tests
- Add metrics for the runner for picking up jobs
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bob.