Storm UI showing improper values for Kafka Trident about kafka-storm-starter HOT 6 CLOSED

This might be an issue of Storm itself. May I suggest sending a note to the Storm mailing list?

from kafka-storm-starter.

I assume you were also the person asking the question Storm UI improper values and Capillary tool on StackOverflow a few days ago?

from kafka-storm-starter.

I checked the screenshot in the SO question -- the numbers for emitted/transferred are pretty low. Are you possibly seeing the what I'd call the UI metric artifacts of Trident, which -- as mentioned in the SO thread -- creates its own tuples behind the scenes, which also show up in the Storm UI?

Trident executes a batch every 500ms (by default). A batch involves a bunch
of coordination messages going out to all the bolts to coordinate the batch
(even if the batch is empty). So that's what you're seeing.

(source: Trident Kafka Spout - Ack Count Increasing Even Though No Messages Are Processed)

from kafka-storm-starter.

@miguno Thanks so much for your reply. True I did post in SO. Yes probably that is what I am seeing in the UI. Is there a way to get the actual number of messages emitted/processed leaving out the coordination message counts as asked in the link you menioned?

from kafka-storm-starter.

@miguno As you said, I've asked in the storm user group. If I get any answers I'll post here.

from kafka-storm-starter.

Is there a way to get the actual number of messages emitted/processed leaving out the coordination message counts as asked in the link you menioned?

I am not aware of any way to filter the numbers.

from kafka-storm-starter.