aleonsan / ansible-kafka Goto Github PK

I have configured the same playbooks with kafka , zookeper and java packages variables ,

ansible is ruuning kafka playbook successfully , but both services of kafka and zookeeper are failed to start

`[centos@kafka03 ~]$ systemctl status zookeeper.service
● zookeeper.service - Zookeeper
Loaded: loaded (/etc/systemd/system/zookeeper.service; enabled; vendor preset: disabled)
Active: failed (Result: exit-code) since Thu 2021-10-14 07:41:22 UTC; 15min ago
Process: 970 ExecStart=/etc/apache-zookeeper-3.7.0/bin/zkServer.sh start (code=exited, status=1/FAILURE)
Main PID: 970 (code=exited, status=1/FAILURE)

Oct 14 07:41:21 kafka03.novalocal systemd[1]: Started Zookeeper.
Oct 14 07:41:21 kafka03.novalocal zkServer.sh[970]: ZooKeeper JMX enabled by default
Oct 14 07:41:21 kafka03.novalocal zkServer.sh[970]: Using config: /etc/apache-zookeeper-3.7.0/bin/../conf/zoo.cfg
Oct 14 07:41:22 kafka03.novalocal systemd[1]: zookeeper.service: main process exited, code=exited, status=1/FAILURE
Oct 14 07:41:22 kafka03.novalocal systemd[1]: Unit zookeeper.service entered failed state.
Oct 14 07:41:22 kafka03.novalocal systemd[1]: zookeeper.service failed.
[centos@kafka03 ~]$ journalctl -xe
Oct 14 07:39:22 kafka03.novalocal polkitd[491]: Registered Authentication Agent for unix-process:786:6285306 (system bus name :1.182 [/
Oct 14 07:39:24 kafka03.novalocal polkitd[491]: Unregistered Authentication Agent for unix-process:786:6285306 (system bus name :1.182,
Oct 14 07:39:24 kafka03.novalocal polkitd[491]: Operator of unix-process:786:6285306 FAILED to authenticate to gain authorization for a
Oct 14 07:39:26 kafka03.novalocal sudo[801]: centos : TTY=pts/1 ; PWD=/home/centos ; USER=root ; COMMAND=/bin/systemctl restart zooke
Oct 14 07:39:26 kafka03.novalocal sudo[801]: pam_unix(sudo:session): session opened for user root by centos(uid=0)
Oct 14 07:39:26 kafka03.novalocal polkitd[491]: Registered Authentication Agent for unix-process:804:6285656 (system bus name :1.185 [/
Oct 14 07:39:26 kafka03.novalocal systemd[1]: Started Zookeeper.
-- Subject: Unit zookeeper.service has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel

-- Unit zookeeper.service has finished starting up.

-- The start-up result is done.
Oct 14 07:39:26 kafka03.novalocal sudo[801]: pam_unix(sudo:session): session closed for user root
Oct 14 07:39:26 kafka03.novalocal polkitd[491]: Unregistered Authentication Agent for unix-process:804:6285656 (system bus name :1.185,
Oct 14 07:39:26 kafka03.novalocal zkServer.sh[810]: ZooKeeper JMX enabled by default
Oct 14 07:39:26 kafka03.novalocal zkServer.sh[810]: Using config: /etc/apache-zookeeper-3.7.0/bin/../conf/zoo.cfg
Oct 14 07:39:27 kafka03.novalocal zkServer.sh[810]: Starting zookeeper ... FAILED TO START
Oct 14 07:39:27 kafka03.novalocal systemd[1]: zookeeper.service: main process exited, code=exited, status=1/FAILURE
Oct 14 07:39:27 kafka03.novalocal systemd[1]: Unit zookeeper.service entered failed state.
Oct 14 07:39:27 kafka03.novalocal systemd[1]: zookeeper.service failed.
Oct 14 07:39:55 kafka03.novalocal sudo[882]: centos : TTY=pts/1 ; PWD=/home/centos ; USER=root ; COMMAND=/bin/systemctl status zookee
Oct 14 07:39:55 kafka03.novalocal sudo[882]: pam_unix(sudo:session): session opened for user root by centos(uid=0)
Oct 14 07:39:55 kafka03.novalocal sudo[882]: pam_unix(sudo:session): session closed for user root
Oct 14 07:41:18 kafka03.novalocal sudo[957]: centos : TTY=pts/1 ; PWD=/home/centos ; USER=root ; COMMAND=/sbin/setenforce 0
Oct 14 07:41:18 kafka03.novalocal sudo[957]: pam_unix(sudo:session): session opened for user root by centos(uid=0)
Oct 14 07:41:18 kafka03.novalocal sudo[957]: pam_unix(sudo:session): session closed for user root
Oct 14 07:41:21 kafka03.novalocal sudo[962]: centos : TTY=pts/1 ; PWD=/home/centos ; USER=root ; COMMAND=/bin/systemctl restart zooke
Oct 14 07:41:21 kafka03.novalocal sudo[962]: pam_unix(sudo:session): session opened for user root by centos(uid=0)
Oct 14 07:41:21 kafka03.novalocal polkitd[491]: Registered Authentication Agent for unix-process:964:6297174 (system bus name :1.191 [/
Oct 14 07:41:21 kafka03.novalocal systemd[1]: Started Zookeeper.
-- Subject: Unit zookeeper.service has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel

-- Unit zookeeper.service has finished starting up.

-- The start-up result is done.
Oct 14 07:41:21 kafka03.novalocal sudo[962]: pam_unix(sudo:session): session closed for user root
Oct 14 07:41:21 kafka03.novalocal polkitd[491]: Unregistered Authentication Agent for unix-process:964:6297174 (system bus name :1.191,
Oct 14 07:41:21 kafka03.novalocal zkServer.sh[970]: ZooKeeper JMX enabled by default
Oct 14 07:41:21 kafka03.novalocal zkServer.sh[970]: Using config: /etc/apache-zookeeper-3.7.0/bin/../conf/zoo.cfg
Oct 14 07:41:22 kafka03.novalocal zkServer.sh[970]: Starting zookeeper ... FAILED TO START
Oct 14 07:41:22 kafka03.novalocal systemd[1]: zookeeper.service: main process exited, code=exited, status=1/FAILURE
Oct 14 07:41:22 kafka03.novalocal systemd[1]: Unit zookeeper.service entered failed state.
Oct 14 07:41:22 kafka03.novalocal systemd[1]: zookeeper.service failed.
Oct 14 07:41:23 kafka03.novalocal sudo[1009]: centos : TTY=pts/1 ; PWD=/home/centos ; USER=root ; COMMAND=/bin/systemctl status zooke
Oct 14 07:41:23 kafka03.novalocal sudo[1009]: pam_unix(sudo:session): session opened for user root by centos(uid=0)
Oct 14 07:41:23 kafka03.novalocal sudo[1009]: pam_unix(sudo:session): session closed for user root
Oct 14 07:49:21 kafka03.novalocal sudo[1428]: centos : TTY=pts/1 ; PWD=/home/centos ; USER=root ; COMMAND=/bin/systemctl status kafka
Oct 14 07:49:21 kafka03.novalocal sudo[1428]: pam_unix(sudo:session): session opened for user root by centos(uid=0)
Oct 14 07:49:21 kafka03.novalocal sudo[1428]: pam_unix(sudo:session): session closed for user root`

bin/kafka-topics.sh --create --zookeeper 192.168.131.168:2181 --replication-factor 1 --partitions 1 --topic clicks_topic1
WARNING: Due to limitations in metric names, topics with a period ('.') or underscore ('_') could collide. To avoid issues it is best to use either, but not both.
Error while executing topic command : replication factor: 1 larger than available brokers: 0
[2017-03-11 10:11:39,649] ERROR org.apache.kafka.common.errors.InvalidReplicationFactorException: replication factor: 1 larger than available brokers: 0
(kafka.admin.TopicCommand$)
[root@li819-138 kafka_2.12-0.10.2.0]# bin/kafka-topics.sh --create --zookeeper 192.168.131.168:2181 --replication-factor 1 --partitions 1 --topic clicks_topic1
Exception in thread "main" org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server '192.168.131.168:2181' with timeout of 30000 ms
at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:1233)
at org.I0Itec.zkclient.ZkClient.(ZkClient.java:157)
at org.I0Itec.zkclient.ZkClient.(ZkClient.java:131)
at kafka.utils.ZkUtils$.createZkClientAndConnection(ZkUtils.scala:79)
at kafka.utils.ZkUtils$.apply(ZkUtils.scala:61)
at kafka.admin.TopicCommand$.main(TopicCommand.scala:56)
at kafka.admin.TopicCommand.main(TopicCommand.scala)

Kafaka and zookeeper is running but when we try to create topic from below command and getting error.

bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 2 --partitions 30 --topic clicks_topic1
Error
/etc/kafka_2.11-0.10.0.0/bin/kafka-run-class.sh: line 243: exec: java: not found