Update the grafana-graphite docker image dashboard with best practices in mind about kamon HOT 1 CLOSED

Additional info that I just replied on another issue:

To monitor the number of messages in a mailbox I would recommend displaying at least this 3 metrics together for a given mailbox:

• upper
• mean
• lower

If you want more, add a few more upper_xx metrics, never use the mean_xx as it reflects the mean of all values bellow the xx percentile which might make you thing that everything is better than what it really is. If you need to take something out, take out the mean. When monitoring mailboxes we find it more important to see the bounds between which it moves (by plotting lower and upper) and some other metrics in the middle (like the mean) to give you an idea of where it might have been the most during certain period of time. If the lower starts going up, something is slowing down the actor and it likely drive the upper to a higher value, that's a pattern that, if present for some time without proper back pressure control, will lead to a OOM. If the upper goes down, whoever produces the work done by this actor is slowing down or the actor is magically working faster. You can correlate with the processing time metric to find out which of the two cases apply.

Finally, please note that this recommendations are specific for displaying the mailbox size and should not be applied for latency measurements such as processing-time and time-in-mailbox.

from kamon.