[Question] Runtime configuration about kaffe HOT 11 CLOSED

Hello! Yes that's entirely possible. The easiest approach would be to set heroku_kafka_env: true in the configuration and then ensure that KAFKA_URL is set as an ENV variable at runtime. The other Heroku compatible Kafka ENV variables for SSL are optional.

from kaffe.

@sdball is this conflating Heroku concerns w/ env-var concerns?

from kaffe.

I don't think so. The flag is for declaring the app is behaving in a Heroku-compatible manner. Kaffe's entire existence is designed around making talking to Heroku Kafka easy.

from kaffe.

I think I disagree, but can also see it's orthogonal to @sweco-semtne's questions so will take it offline 😄

from kaffe.

@sweco-semtne I wrote a library for run-time configuration for Kubernetes and Swarm (though environment vars are supported too)

https://github.com/GT8Online/weave

This is my handler for such a use-case:

  def handle_configuration("kafka_hosts", host_string) do
    brokers = host_string
    |> String.split(",")
    |> Enum.map(fn(uri) ->
      [host, port] = String.split(uri, ":")

      Keyword.put([], String.to_atom(host), String.to_integer(port))
    end)
    |> List.flatten()

    {:kaffe, :consumer, [endpoints: brokers]}
  end

  def handle_configuration("kafka_topic", topic) do
    {:kaffe, :consumer, [topics: [topic]]}
  end

from kaffe.

Thanks! It looks like it is exactly what I'm looking for.

from kaffe.

Wow, that looks fantastic @rawkode! Would you mind writing up that runtime configuration approach as a PR for the readme? Perhaps another section Runtime Configuration?

from kaffe.

Yeah, happy to @sdball. No problem 👍

from kaffe.

@sweco-semtne I've made it easier to configure a consumer and producer with a single handle_configuration/1:

https://github.com/GT8Online/weave/pull/27/files

from kaffe.

I believe this could be closed now, @sweco-semtne ?

Hopefully you got everything working 👍

from kaffe.

Looks like this issue has been resolved with #34. Closing due to inactivity.

from kaffe.