Comments (2)
The "complete":false
part is because Burrow has not yet seen the configured number of offsets (set in the lagcheck
section with the intervals
config) for that consumer group. This is correct behavior. If your consumer is committing offsets on 1 minute intervals, and intervals
is set to 10, it will take 10 minutes before results are complete. If your offset commit interval is 10 minutes, it will take 1 hour and 40 minutes.
The change you made essentially only allows offsets to be stored where the timestamp does not change. This is bad behavior. This means that if a consumer committing offsets to Zookeeper stops committing offsets, either because it has hung or gone away, Burrow would continue to fill up the offsets ring for that consumer with offsets with the same timestamp and offset.
from burrow.
Thanks for @toddpalino.
from burrow.
Related Issues (20)
- tls option for AWS MSK HOT 1
- Failed to get zk lock, trying to acquire a lock twice HOT 7
- Dynamically reading burrow config
- burrow lags in generating consumer/topic list
- Groups Reaper functionality no longer deletes prometheus metrics
- Authenticating using SASL_OAUTHBEARER HOT 1
- Burrow failed to connect kafka cluster (kafka: client has run out of available brokers to talk to) HOT 3
- Burrow SASL_SSL configs HOT 7
- "cluster or consumer not found" problem
- Compatibility with kafka version 0.11.0.
- Is it possible to use Burrow with Kafka cluster running in the KRaft mode? HOT 4
- Return high watermark in the /consumer/<consumer-name> api
- Burrow new release based on master to fix CVE-2022-23806 HOT 4
- Zookeeper authentication failed
- Sarama looking for new maintainers HOT 1
- Cannot find storm consumers and kafka consumers
- Prevent flushing data during update
- Burrow force GOMAXPROCS to be equal to `runtime.NumCPU()` HOT 2
- Add possibility to change prometheus metrics name
- Query: Multiple Burrow instances HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from burrow.