Comments (10)
Looks like there are two problems here.
- When the user attempts to read an evicted offset. The error, in that case, is the valid behavior, but, we do need to improve reporting there. I created a separate ticket for it.
- The storage layer does not recognize that the segment is gone, and tries to read from it. That's why we have
File not found
error. This issue will be fixed within this ticket.
@SecretPocketCat After all these fixes, you will still need to manually restart the consuming. We can't do it implicitly, because this is the kind of decision that every user has to make according to project specifics.
from fluvio.
Added a repro link.
I've also tried clamping the offset, but the result is the same. I'm not sure whether this'd be considered a bug or if it works as intended, but then I'd be at a loss on how to use absolute (stored) offsets.
from fluvio.
I was mistaken in the fact it happens just with an absolute offset - the same thing occurs with Offset::beginning()
. The fetched offsets used for the offset resolve seem to be stale.
from fluvio.
@SecretPocketCat thanks for reporting.
@galibey is this issue related to the other issue you are working on? If yes, please share the proposed solution here.
from fluvio.
Related Issues (20)
- Better fvm versioning
- MQTT Connector: Prefix auto generated Client ID to prevent connection drops HOT 5
- connector: fluvio-http-source, add an option to read data from a websocket HOT 6
- [Bug]: Unable to consume in batches. HOT 11
- When a topic is deleted, connected clients should have their connection closed HOT 9
- [Release Checklist]: v0.11.4
- Build a new python wrapping for the fluvio client crate HOT 9
- fluvio topic how to increase number of partition HOT 3
- Does it support data persistence to object storage? eg S3 HOT 4
- Python client async and admin upgrade HOT 16
- [Release Checklist]: v0.11.5 HOT 1
- [Bug]: Fluvio cluster fails to start on Arch Linux and Debian HOT 5
- Remove localhost from fluvio in favor of 127.0.0.1
- Have you considered continuing to support the kafka protocol? This is very conducive to migrating the system from kafka to fluvio HOT 6
- [Bug]: Profile not created on cloud login HOT 3
- `fvm list <CHANNEL>` should list artifact versions in that channel
- curl error on windows subsystem for Linux HOT 4
- [Bug]: Fluvio install k8s docs are out of date HOT 7
- Report evicted batch back to consumer
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fluvio.