kzk / docker-compose-efk Goto Github PK

Step 2/2 : RUN ["gem", "install", "fluent-plugin-elasticsearch", "--no-rdoc", "--no-ri", "--version", "1.9.5"]
---> Running in c98fc764323f
ERROR: Could not find a valid gem 'fluent-plugin-elasticsearch' (= 1.9.5), here is why:
Unable to download data from https://rubygems.org/ - no such name (https://rubygems.org/specs.4.8.gz)
ERROR: Service 'fluentd' failed to build: The command 'gem install fluent-plugin-elasticsearch --no-rdoc --no-ri --version 1.9.5' returned a non-zero code: 2

Step 2/2 : RUN ["gem", "install", "fluent-plugin-elasticsearch", "--no-rdoc", "--no-ri", "--version", "1.9.5"]
---> Running in b9228068d59a
ERROR: Could not find a valid gem 'fluent-plugin-elasticsearch' (= 1.9.5), here is why:
Unable to download data from https://rubygems.org/ - no such name (https://rubygems.org/specs.4.8.gz)
ERROR: Service 'fluentd' failed to build: The command 'gem install fluent-plugin-elasticsearch --no-rdoc --no-ri --version 1.9.5' returned a non-zero code: 2

Recently, I deployed a docker-compose-efk environment. At the beginning it could work normally, but the fluentd could not send logs to the elasticsearch next day. After I restart the fluentd container, it was normal. Unfortunately, It was wrong yet next day. I cannot find the reason. Who can help me?

The elastic search container shuts down after the startup. Please find the logs below:
[tibco@ip-172-31-26-149 elk]$ docker logs bbf392f5c980
[2020-03-07T17:41:29,618][INFO ][o.e.n.Node ] [] initializing ...
[2020-03-07T17:41:29,778][INFO ][o.e.e.NodeEnvironment ] [mgOsXBI] using [1] data paths, mounts [[/ (rootfs)]], net usable_space [9.7gb], net total_space [9.9gb], spins? [unknown], types [rootfs]
[2020-03-07T17:41:29,779][INFO ][o.e.e.NodeEnvironment ] [mgOsXBI] heap size [1.9gb], compressed ordinary object pointers [true]
[2020-03-07T17:41:29,783][INFO ][o.e.n.Node ] node name [mgOsXBI] derived from node ID [mgOsXBIIQgqCDC5p7LPLXw]; set [node.name] to override
[2020-03-07T17:41:29,784][INFO ][o.e.n.Node ] version[5.3.0], pid[1], build[3adb13b/2017-03-23T03:31:50.652Z], OS[Linux/3.10.0-327.22.2.el7.x86_64/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_92-internal/25.92-b14]
[2020-03-07T17:41:33,001][INFO ][o.e.p.PluginsService ] [mgOsXBI] loaded module [aggs-matrix-stats]
[2020-03-07T17:41:33,001][INFO ][o.e.p.PluginsService ] [mgOsXBI] loaded module [ingest-common]
[2020-03-07T17:41:33,001][INFO ][o.e.p.PluginsService ] [mgOsXBI] loaded module [lang-expression]
[2020-03-07T17:41:33,001][INFO ][o.e.p.PluginsService ] [mgOsXBI] loaded module [lang-groovy]
[2020-03-07T17:41:33,001][INFO ][o.e.p.PluginsService ] [mgOsXBI] loaded module [lang-mustache]
[2020-03-07T17:41:33,001][INFO ][o.e.p.PluginsService ] [mgOsXBI] loaded module [lang-painless]
[2020-03-07T17:41:33,001][INFO ][o.e.p.PluginsService ] [mgOsXBI] loaded module [percolator]
[2020-03-07T17:41:33,001][INFO ][o.e.p.PluginsService ] [mgOsXBI] loaded module [reindex]
[2020-03-07T17:41:33,002][INFO ][o.e.p.PluginsService ] [mgOsXBI] loaded module [transport-netty3]
[2020-03-07T17:41:33,002][INFO ][o.e.p.PluginsService ] [mgOsXBI] loaded module [transport-netty4]
[2020-03-07T17:41:33,003][INFO ][o.e.p.PluginsService ] [mgOsXBI] loaded plugin [x-pack]
[2020-03-07T17:41:39,234][INFO ][o.e.n.Node ] initialized
[2020-03-07T17:41:39,235][INFO ][o.e.n.Node ] [mgOsXBI] starting ...
[2020-03-07T17:41:39,640][WARN ][i.n.u.i.MacAddressUtil ] Failed to find a usable hardware address from the network interfaces; using random bytes: 32:da:97:cc:92:5e:fc:25
[2020-03-07T17:41:39,847][INFO ][o.e.t.TransportService ] [mgOsXBI] publish_address {172.20.0.2:9300}, bound_addresses {0.0.0.0:9300}
[2020-03-07T17:41:39,876][INFO ][o.e.b.BootstrapChecks ] [mgOsXBI] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
ERROR: bootstrap checks failed
max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
[2020-03-07T17:41:39,924][INFO ][o.e.n.Node ] [mgOsXBI] stopping ...
[2020-03-07T17:41:40,115][INFO ][o.e.n.Node ] [mgOsXBI] stopped
[2020-03-07T17:41:40,115][INFO ][o.e.n.Node ] [mgOsXBI] closing ...
[2020-03-07T17:41:40,134][INFO ][o.e.n.Node ] [mgOsXBI] closed
[tibco@ip-172-31-26-149 elk]$

I execute the command

docker-compose up -d

and I get an error

Creating network "docker-compose-efk_elastic" with driver "bridge" Pulling kibana (docker.elastic.co/kibana/kibana:7.8.1)... 7.8.1: Pulling from kibana/kibana 86dbb57a3083: Already exists fe2e912251c2: Pulling fs layer 565c9b40a27d: Pulling fs layer 298ba39da80b: Pulling fs layer f6057c975a14: Waiting 75ebf1658d48: Waiting 1b7b5f7489f8: Waiting 61705f5cf851: Waiting 0d40651b1f3c: Waiting 9d19e28c4d6c: Waiting ed47f904cd11: Waiting ERROR: error pulling image configuration: Get https://d2iks1dkcwqcbx.cloudfront.net/docker/registry/v2/blobs/sha256/22/22bc1dd9a48a0e5b1608a727ed860eb18492214758406db888ed01b67ab7c48e/data?Expires=1620303782&Signature=gkusiEryYbGdjWpJzKpnE0U1Gy89gLz7z4W0LoXP3~WPIwjjGbdVq2NVBBkBoWIap8vXRJjyhhpv5tNgyFNkV70CEOhzKQU-eMfOh1ag9wx9FUd0yT-gUHOPUjIzr95rnlcu907m00~0a0CtDKpci7egQ5Xlj20fobkTUsWHKzmvEhJ~fI2bxz3rzdNpI9a~~SJ7lT9Bd8AebaszrRW9Kbr26ro74xOKGaKyJKe986kaiZjmupbE97glAKYJENaOOsWHBij8QipCupadqN37HWg8TUasYvaIk7iEiVL3mwmn-x9ls~Zm-ceVTOF-oEUFn~t-9YW9YZAmUnmFoNCJ~g__&Key-Pair-Id=APKAIVAVKHB6SNHJAJQQ: read tcp 192.168.0.201:47898->52.85.114.81:443: read: connection reset by peer

Could you assist me how do I create a visualize dashboard
Something like this https://misterhex.github.io/assets/img/k8_1.png

OpenShift version: 3.9
EFK deployed

I am struck in create a dashboard

I was able to deploy everything as described but Kibana keeps asking me for login and password while trying to access it thought localhost:5601.
Can you please advice ?

Thanks.