Welcome to the New Relic Fluent Bit Output Plugin for Kubernetes! There are only a few quick steps to getting this working in your cluster.
- Clone this repo
- Deploy the chart using your New Relic license key:
helm install --set licenseKey=(your-license-key) ./helm/newrelic-logging
- If you are in the EU:
- Add
--set fluentBit.endpoint=https://log-api.eu.newrelic.com/log/v1
to thehelm install
command line above - Make sure that the license key you are using is an EU key
- Add
- Check the Logging product for your logs
- Clone this repo
- Configure the plugin. In
new-relic-fluent-plugin.yml
:- Specify your New Relic license key in the value for
LICENSE_KEY
- If you are in the EU:
- Override the
ENDPOINT
environment variable tohttp://log-api.eu.newrelic.com/log/v1
- Make sure that the license key you are using is an EU key
- Override the
- Specify your New Relic license key in the value for
- From this directory, run
kubectl apply -f .
on your cluster - Check the Logging product for your logs
We default to tailing /var/log/containers/*.log
. If you want to change what's tailed, just update the PATH
value in new-relic-fluent-plugin.yml
.
We currently support parsing json and docker logs. If you want more parsing, feel free to add more parsers in fluent-conf.yml
.
Here are some parsers for your parsing pleasure.
[PARSER]
Name apache
Format regex
Regex ^(?<host>[^ ]*) [^ ]* (?<user>[^ ]*) \[(?<time>[^\]]*)\] "(?<method>\S+)(?: +(?<path>[^\"]*?)(?: +\S*)?)?" (?<code>[^ ]*) (?<size>[^ ]*)(?: "(?<referer>[^\"]*)" "(?<agent>[^\"]*)")?$
Time_Key time
Time_Format %d/%b/%Y:%H:%M:%S %z
[PARSER]
Name apache2
Format regex
Regex ^(?<host>[^ ]*) [^ ]* (?<user>[^ ]*) \[(?<time>[^\]]*)\] "(?<method>\S+)(?: +(?<path>[^ ]*) +\S*)?" (?<code>[^ ]*) (?<size>[^ ]*)(?: "(?<referer>[^\"]*)" "(?<agent>[^\"]*)")?$
Time_Key time
Time_Format %d/%b/%Y:%H:%M:%S %z
[PARSER]
Name apache_error
Format regex
Regex ^\[[^ ]* (?<time>[^\]]*)\] \[(?<level>[^\]]*)\](?: \[pid (?<pid>[^\]]*)\])?( \[client (?<client>[^\]]*)\])? (?<message>.*)$
[PARSER]
Name nginx
Format regex
Regex ^(?<remote>[^ ]*) (?<host>[^ ]*) (?<user>[^ ]*) \[(?<time>[^\]]*)\] "(?<method>\S+)(?: +(?<path>[^\"]*?)(?: +\S*)?)?" (?<code>[^ ]*) (?<size>[^ ]*)(?: "(?<referer>[^\"]*)" "(?<agent>[^\"]*)")?$
Time_Key time
Time_Format %d/%b/%Y:%H:%M:%S %z
This project is provided AS-IS WITHOUT WARRANTY OR SUPPORT, although you can report issues and contribute to the project here on GitHub.