Kafka Deployments using ACM
https://docs.confluent.io/platform/current/tutorials/examples/multiregion/docs/multiregion.html
Requirements
This is an example
- OpenShift 4.11
- ACM hub Cluster Networks
- Cluster Network: 10.128.0.0/14
- Service Network: 172.30.0.0/16
- ACM Managed Cluster Networks
- Cluster Network: 10.132.0.0/14
- Service Network: 172.31.0.0/16
- Configure Submariner
- Confluent for Kubernetes Operator
Pull podman image
Link: https://catalog.redhat.com/software/containers/rhacm2/subctl-rhel8/
$ podman login registry.redhat.io
$ oc image extract registry.redhat.io/rhacm2/subctl-rhel8:v0.14.3-1.1682479377 --path="/dist/subctl-v0.14*-linux-amd64.tar.xz":/tmp/ --confirm --registry-config=/run/user/1001/containers/auth.json
$ tar -C /tmp/ -xf /tmp/subctl-v0.14*-linux-amd64.tar.xz
$ chmod +x /tmp/subctl-v0.14.3/subctl-v0.14.3-linux-amd64
$ sudo mv /tmp/subctl-v0.14.3/subctl-v0.14.3-linux-amd64 /usr/local/bin/subctl
or Install using script
curl https://get.submariner.io | VERSION=0.14.3 bash
subctl diagnose all
This repository contains the resources to deploy Kafka on OpenShift using ACM. Link: https://github.com/confluentinc/confluent-kubernetes-examples
git clone https://github.com/confluentinc/confluent-kubernetes-examples.git
cd confluent-kubernetes-examples/hybrid/multi-region-clusters/external-access
Configure OpenShift Clusters with base-configs
oc apply -k https://github.com/tosin2013/kafka-confluent-rhacm/base-configs
Spoke Cluster
oc apply -k https://github.com/tosin2013/kafka-confluent-rhacm/clusters/overlay/spokecluster
subctl export service --namespace west zookeeper-hybrid
subctl export service --namespace west zookeeper-hybrid-0-internal
subctl export service --namespace west zookeeper-hybrid-1-internal
subctl export service --namespace west zookeeper-hybrid-2-internal
subctl export service --namespace west kafka-hybrid
subctl export service --namespace west kafka-hybrid-0-internal
subctl export service --namespace west kafka-hybrid-1-internal
oc delete -k https://github.com/tosin2013/kafka-confluent-rhacm/clusters/overlay/spokecluster
oc apply -k https://github.com/tosin2013/kafka-confluent-rhacm/clusters/overlay/spokecluster
kubectl -n west describe endpointslice
Hub Cluser
oc apply -k https://github.com/tosin2013/kafka-confluent-rhacm/clusters/overlay/hubcluster
subctl export service --namespace east zookeeper-hybrid
subctl export service --namespace east zookeeper-hybrid-0-internal
subctl export service --namespace east zookeeper-hybrid-1-internal
subctl export service --namespace east zookeeper-hybrid-2-internal
subctl export service --namespace east kafka-hybrid
subctl export service --namespace east kafka-hybrid-0-internal
subctl export service --namespace east kafka-hybrid-1-internal
oc delete -k https://github.com/tosin2013/kafka-confluent-rhacm/clusters/overlay/hubcluster
oc apply -k https://github.com/tosin2013/kafka-confluent-rhacm/clusters/overlay/hubcluster
kubectl -n east describe endpointslice
curl -I zookeeper-hybrid-0-internal.west.svc.clusterset.local:3888
curl -I zookeeper-hybrid-2-internal.east.svc.clusterset.local:3888
Links:
- https://www.redhat.com/architect/submariner-acm-add-on
- https://submariner.io/getting-started/quickstart/openshift/aws/
basicsecret