Creates a 3 node (master + 2 workers) kubernetes cluster in VirtualBox using Vagrant
Tested on VirtualBox 5.1.28 and Vagrant 2.0
kubectl should be manually installed in the host machine (https://kubernetes.io/docs/tasks/tools/install-kubectl)
Start cluster:
1) Create vms:
vagrant up
2) Start Kubernetes master:
python myKube.py start-master
3) Wait until all master pods are ready. To check status:
kubectl get pods --all-namespaces -o wide
4) Start worker nodes:
python myKube.py start-workers
Stop cluster:
python mykube.py stop-cluster
Check that all nodes were successfully added:
dev:~/mykube$ kubectl get nodes
NAME STATUS ROLES AGE VERSION
kmaster Ready master 5m v1.8.0
kworker1 Ready <none> 1m v1.8.0
kworker2 Ready <none> 1m v1.8.0
Check all pods are running:
dev:~/mykube$ kubectl get pods --all-namespaces -o wide
NAMESPACE NAME READY STATUS RESTARTS AGE IP NODE
kube-system calico-etcd-ftflb 1/1 Running 0 4m 192.168.33.10 kmaster
kube-system calico-kube-controllers-6ff88bf6d4-m4bm7 1/1 Running 0 4m 192.168.33.10 kmaster
kube-system calico-node-7f2pm 2/2 Running 0 4m 192.168.33.10 kmaster
kube-system calico-node-mtcnn 2/2 Running 1 1m 192.168.33.20 kworker1
kube-system calico-node-pnfdn 2/2 Running 0 1m 192.168.33.30 kworker2
kube-system etcd-kmaster 1/1 Running 0 3m 192.168.33.10 kmaster
kube-system kube-apiserver-kmaster 1/1 Running 0 4m 192.168.33.10 kmaster
kube-system kube-controller-manager-kmaster 1/1 Running 0 3m 192.168.33.10 kmaster
kube-system kube-dns-545bc4bfd4-k25tz 3/3 Running 0 4m 192.168.189.1 kmaster
kube-system kube-proxy-5ztjb 1/1 Running 0 1m 192.168.33.20 kworker1
kube-system kube-proxy-9fk9m 1/1 Running 0 4m 192.168.33.10 kmaster
kube-system kube-proxy-tzsjg 1/1 Running 0 1m 192.168.33.30 kworker2
kube-system kube-scheduler-kmaster 1/1 Running 0 3m 192.168.33.10 kmaster
The network poc has the following structure:
edge(nginx)
|
|
Traefik
/ | \
/ | \
/ | \
/ | \
model-ingest | data-pipeline
|
authorization
model-ingest, authorization and data-pipeline are a python server that return the name of the service
To run the network poc:
cd network-poc
vagrant scp server.py kmaster:/opt/kdata/. (if vagrant-scp not installed: vagrant plugin install vagrant-scp)
kubectl create configmap wrapper --from-file=server.py
kubectl apply -f .
To validate routing:
- Get the edge port by executing kubectl get svc
- Test the following routes:
- http://kmaster_ip:edge_port/api/authorization
- http://kmaster_ip:edge_port/api/model-ingest
- http://kmaster_ip:edge_port/api/data-pipeline
Example on how to retrieve ports:
dev:~/mykube$ kubectl get svc
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
authorization NodePort 10.98.207.129 <none> 8000:32409/TCP 17m
data-pipeline NodePort 10.105.130.251 <none> 8000:32126/TCP 17m
edge NodePort 10.102.100.7 <none> 80:31076/TCP 17m
kubernetes ClusterIP 10.96.0.1 <none> 443/TCP 6h
model-ingest NodePort 10.100.110.158 <none> 8000:31151/TCP 17m
traefik-ingress-service NodePort 10.96.167.79 <none> 80:32684/TCP,8080:30822/TCP 17m
traefik-web-ui NodePort 10.107.219.87 <none> 80:32692/TCP 17m
edge port is 31076 and traefik-web-ui 32692
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent