Configure multiple caches/relays per host about graphite HOT 11 CLOSED

Can you elaborate how you would like to see this work?

from graphite.

You should be able to define multiple caches & relays in carbon.conf as follows:

[cache:a]
<<options>>

[cache:b]
<<options>>

[relay:a]
<<options>>

[relay:b]
<<options>>

Etc.

I'm actually looking to add this in myself right now to move my current bottleneck from CPU (single-threaded relay) to disk IO (multiple caches distributed over CPUs). The configuration certainly allows it, but it should be configurable via Chef. I'm currently thinking of defining the individual cache and/or relay configurations in nested attribute hashes. Alternatively perhaps a LWRP could be created to piece together the configuration? Not sure what the best mechanism for accomplishing this is yet.

Also, your cookbook has no notion of clustered or distributed Graphite. We have modified your cookbook to use a search to define the DESTINATIONS parameter for the relay, but its somewhat environment specific in how we have it working currently. For running multiple caches we'll need multiple levels of relays as well as the ability to auto-generate destinations to both other relays and the local caches under them.

I can produce a diagram if necessary.

from graphite.

Same over here. Federated recipe is saying that it was inspired by R. Crowley's blog post, which has typos in it and it's confusing. What you should essentially be aiming for is this diagram:

http://www.slideshare.net/AnatolijDobrosynets/graphite-cluster-setup-blueprint

Simples. I am already re-working this cookbook for our own use. Nevertheless this cookbook is so far the best one I've managed to find on Graphite.

from graphite.

Yes, that's it exactly. I have it done the way I want in-house, but I need to merge what we have with this community version so I can push my changes up-stream. I just haven't had a chance to get to that yet.

from graphite.

@benjamink do you have it public somewhere ? It would save me tons of time 👍

from graphite.

I can try and get it online today. I'll have to give it a once-over to make sure it's clean. I'm fairly certain it's not the best it could be, but it's certainly functional.

from graphite.

@milosgajdos83 most of this is from an earlier version of this cookbook, but it's been modified to suit our needs. I'd really like to get it merged into the current state of the community cookbook at some point soon. https://github.com/benjamink/graphite-with-instances

from graphite.

Thanks a lot ! I'll check it out !

from graphite.

I'd love to see this merged in. I'm not happy with the current federated recipe as I think it's overly complex, but it's better than no support.

Looking forward to any PRs

from graphite.

This is supported with the current version of the cookbook, closing issue. Please open a PR if you can with changes. thanks!

from graphite.

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

from graphite.