主要参考了https://www.cnblogs.com/00986014w/p/9561901.html 这篇博文，但他zookeeper使用的不是官方镜像

我使用的是3个节点的Zookeeper集群，可以参照着修改。

搭建Zookeeper集群

集群Service的zookeeper-svc.yaml

apiVersion: v1
kind: Service
metadata:labels:app: zookeeper-cluster-service-1name: zookeeper-cluster1
spec:ports:- name: client port: 2181protocol: TCP- name: followerport: 2888protocol: TCP- name: leaderport: 3888protocol: TCPselector:app: zookeeper-cluster-service-1
---
apiVersion: v1
kind: Service
metadata:labels:app: zookeeper-cluster-service-2name: zookeeper-cluster2
spec:ports:- name: clientport: 2181protocol: TCP- name: followerport: 2888protocol: TCP- name: leaderport: 3888protocol: TCPselector:app: zookeeper-cluster-service-2
---
apiVersion: v1
kind: Service
metadata:labels:app: zookeeper-cluster-service-3name: zookeeper-cluster3
spec:ports:- name: clientport: 2181protocol: TCP- name: followerport: 2888protocol: TCP- name: leaderport: 3888protocol: TCPselector:app: zookeeper-cluster-service-3

通过sudo kubectl create -f zookeeper-svc.yaml创建3个Service。

集群Deployment的zookeeper-deployment.yaml

apiVersion: extensions/v1beta1
kind: Deployment
metadata:labels:app: zookeeper-cluster-service-1 name: zookeeper-cluster-1
spec:replicas: 1template:metadata:labels:app: zookeeper-cluster-service-1name: zookeeper-cluster-1 spec:containers:- image: zookeeperimagePullPolicy: IfNotPresentname: zookeeper-cluster-1 ports:- containerPort: 2181env:- name: ZOO_MY_IDvalue: "1"- name: ZOO_SERVERSvalue: "server.1=0.0.0.0:2888:3888 server.2=zookeeper-cluster2:2888:3888 server.3=zookeeper-cluster3:2888:3888"
---
apiVersion: extensions/v1beta1
kind: Deployment
metadata:labels:app: zookeeper-cluster-service-2name: zookeeper-cluster-2
spec:replicas: 1template:metadata:labels:app: zookeeper-cluster-service-2name: zookeeper-cluster-2spec:containers:- image: zookeeperimagePullPolicy: IfNotPresentname: zookeeper-cluster-2ports:- containerPort: 2181env:- name: ZOO_MY_IDvalue: "2"- name: ZOO_SERVERSvalue: "server.1=zookeeper-cluster1:2888:3888 server.2=0.0.0.0:2888:3888 server.3=zookeeper-cluster3:2888:3888"
---
apiVersion: extensions/v1beta1
kind: Deployment
metadata:labels:app: zookeeper-cluster-service-1name: zookeeper-cluster-3
spec:replicas: 1template:metadata:labels:app: zookeeper-cluster-service-3name: zookeeper-cluster-3spec:containers:- image: zookeeperimagePullPolicy: IfNotPresentname: zookeeper-cluster-3ports:- containerPort: 2181env:- name: ZOO_MY_IDvalue: "3"- name: ZOO_SERVERSvalue: "server.1=zookeeper-cluster1:2888:3888 server.2=zookeeper-cluster2:2888:3888 server.3=0.0.0.0:2888:3888"

通过sudo kubectl create -f zookeeper-deployment.yaml创建3个Deployment。

检查集群是否启动成功

等3个Pod成为Running状态后，通过sudo kubectl log zookeeper-cluster-1-xxxxxx检查日志中是否有错误。

然后通过sudo kubectl exec -it zookeeper-cluster-1-676df4686f-c7b6d /bin/bash分别进入两个Pod，执行/bin/zkCli.sh分别创建查看，试试是否能成功。

搭建Kafka集群

集群Service的kafka-svc.yaml

apiVersion: v1
kind: Service
metadata:name: kafka-cluster1labels:app: kafka-cluster-1
spec:type: NodePortports:- port: 9092name: kafka-cluster-1targetPort: 9092nodePort: 30091protocol: TCPselector:app: kafka-cluster-1
---
apiVersion: v1
kind: Service
metadata:name: kafka-cluster2labels:app: kafka-cluster-2
spec:type: NodePortports:- port: 9092name: kafka-cluster-2targetPort: 9092nodePort: 30092protocol: TCPselector:app: kafka-cluster-2
---
apiVersion: v1
kind: Service
metadata:name: kafka-cluster3labels:app: kafka-cluster-3
spec:type: NodePortports:- port: 9092name: kafka-cluster-3targetPort: 9092nodePort: 30093protocol: TCPselector:app: kafka-cluster-3

通过sudo kubectl create -f kafka-svc.yaml创建3个Service。

集群Deployment的kafka-deployment.yaml

这里需要注意，要把env中KAFKA_ADVERTISED_HOST_NAME改成各个Pod对应Service的ClusterIP。

PS： 如果上面zookeeper的service和我定义的不同，就对应着修改KAFKA_ZOOKEEPER_CONNECT

kind: Deployment
apiVersion: extensions/v1beta1
metadata:name: kafka-cluster-1
spec:replicas: 1selector:matchLabels:name: kafka-cluster-1 template:metadata:labels:name: kafka-cluster-1app: kafka-cluster-1spec:containers:- name: kafka-cluster-1image: wurstmeister/kafkaimagePullPolicy: IfNotPresentports:- containerPort: 9092env:- name: KAFKA_ADVERTISED_PORTvalue: "9092"- name: KAFKA_ADVERTISED_HOST_NAMEvalue: "[zookeeper-cluster1  的 ClusterIP]"- name: KAFKA_ZOOKEEPER_CONNECTvalue: zookeeper-cluster1:2181,zookeeper-cluster2:2181,zookeeper-cluster3:2181- name: KAFKA_BROKER_IDvalue: "1"
---
kind: Deployment
apiVersion: extensions/v1beta1
metadata:name: kafka-cluster-2
spec:replicas: 1selector:matchLabels:name: kafka-cluster-2template:metadata:labels:name: kafka-cluster-2app: kafka-cluster-2spec:containers:- name: kafka-cluster-2image: wurstmeister/kafkaimagePullPolicy: IfNotPresentports:- containerPort: 9092env:- name: KAFKA_ADVERTISED_PORTvalue: "9092"- name: KAFKA_ADVERTISED_HOST_NAMEvalue: "[zookeeper-cluster2 的  ClusterIP]"- name: KAFKA_ZOOKEEPER_CONNECTvalue: zookeeper-cluster1:2181,zookeeper-cluster2:2181,zookeeper-cluster3:2181- name: KAFKA_BROKER_IDvalue: "2"
---
kind: Deployment
apiVersion: extensions/v1beta1
metadata:name: kafka-cluster-3
spec:replicas: 1selector:matchLabels:name: kafka-cluster-3template:metadata:labels:name: kafka-cluster-3app: kafka-cluster-3spec:containers:- name: kafka-cluster-3image: wurstmeister/kafkaimagePullPolicy: IfNotPresentports:- containerPort: 9092env:- name: KAFKA_ADVERTISED_PORTvalue: "9092"- name: KAFKA_ADVERTISED_HOST_NAMEvalue: "[zookeeper-cluster3  的  ClusterIP]"- name: KAFKA_ZOOKEEPER_CONNECTvalue: zookeeper-cluster1:2181,zookeeper-cluster2:2181,zookeeper-cluster3:2181- name: KAFKA_BROKER_IDvalue: "3"

通过sudo kubectl create -f zookeeper-deployment.yaml创建3个Deployment。

检查集群是否启动成功

等3个Pod成为Running状态后，通过sudo kubectl log kafka-cluster-1-xxxxxx检查日志中是否有错误。

然后通过sudo kubectl exec -it -sudo kubectl exec -it kafka-cluster-1-558747bc7d-5n94p /bin/bash进入Pod，执行kafka-console-producer.sh --broker-list [zookeeper-cluster1 的 ClusterIP]:9092 --topic test创建了topic test。

通过sudo kubectl exec -it kafka-cluster-2-66c88f759b-8wlvp /bin/bash进入Pod，执行kafka-console-consumer.sh --bootstrap-server [zookeeper-cluster2 的 ClusterIP]:9092 --topic test --from-beginning接收topic test的消息。

然后试着在cluster-1中发送消息，看看在cluster-2中是否能接收。