Consumer lag as time. about kafka_exporter HOT 6 OPEN

Let me see if I can explain this better. Right now, the exporter I can see how many messages behind a consumer is, but I don't know how far back in time they are. being 1000 messages behind could mean I 10 minutes behind, or it could mean I'm 10 hours behind.

Since all messages also have a timestamp associated with them, I was hoping we could get that timestamp exported along with the offset for the latest offset and each consumer group. I did a quick poke around the sarama libs, but I didn't see an easy way to get that information.

from kafka_exporter.

+1

from kafka_exporter.

@wy100101 @maxtar Kafka exporter is stateless now. Pls using Grafana to show lags curve. It's easy to find out the timestamp.

from kafka_exporter.

@danielqsj i don't understand. How I can find time last commited and last message in topic using grafana?
Please write example.

from kafka_exporter.

@maxtar When using grafana, you could find out when the lags starts getting higher and the consumer offset remains the same.

from kafka_exporter.

@danielqsj No. I mean I no need when it happend. I want to see time from message last committed and time from last offset message. I think I need consume message from all topic partitions, not from kafka_topic?

from kafka_exporter.