[QUESTION] - Custom Offset storage about laravel-kafka HOT 5 CLOSED

Hi @AdrianoRamalho21 to be honest i've never had this use case, but from what i know about kafka, you typically starts either from earliest or the latest offset. If the consumer crashes, then all partitions of the crashed consumer will be reset to the last commited offset, and all messages arrived since the last commit will be read again. Kafka ensures at least once delivery, which means that no messages willbe missed, but duplicated can occur, so you should handle it in your app.

from laravel-kafka.

@mateusjunges thank you for the fast response.
I changed my offset_reset from "latest" to "earliest", based on this stackoverflow thread https://stackoverflow.com/questions/48320672/what-is-the-difference-between-kafka-earliest-and-latest-offset-values#comment83661137_48320871
just in case.

Can you answer me one more question?
Is it possible with your package to get a message from a kafka topic with a specific offset ?

The thing is, Im listening to 2 topics, lets say topic-1 and topic-2, where the handle of the topic-2 has some logic that depends on the data saved from topic-1, and I am pretty sure the producer sends the message from topic-1 first, than, a few minutes later, sends the message from topic-2, and there is the problem.

If the handling of the topic-2 is missing the data from the topic-1, it throws a custom Exception, and that is happening a lot lately :/

from laravel-kafka.

@AdrianoRamalho21 sorry for the delay, i was very busy at work this past days. Currently, consuming from specific offset is no possible, since it is not implemented yet. I will take a look at this and possibly implement as a new feature, but don't expect it for the next few days.

from laravel-kafka.

@mateusjunges no problem ;) Thank you, and I think it will be a useful new feature, in some particularly/specific cases.

No need to rush it tho :D

Thanks one more time, and you may close this issue.

Good work and have a nice day

from laravel-kafka.

Thank you. Feel free to open a new issue as a feature request for that. Closing this for now.

from laravel-kafka.