需求

k8s(Kubernetes)中安装Redis集群
使用nfs存储
部署Redis集群 3主3从
服务器内部ip：192.168.0.254

必备环境安装

ubuntu20.x 服务器 nfs服务安装

https://foxwho.blog.csdn.net/article/details/116994098

#创建nfs redis 存储目录 共 6个
mkdir -p /nfs/redis/pv{1..6}#编辑 nfs 存储配置文件
vim /etc/exports

增加或修改如下

/nfs/redis/pv1 *(ro,sync,no_root_squash,no_subtree_check)
/nfs/redis/pv2 *(ro,sync,no_root_squash,no_subtree_check)
/nfs/redis/pv3 *(ro,sync,no_root_squash,no_subtree_check)
/nfs/redis/pv4 *(ro,sync,no_root_squash,no_subtree_check)
/nfs/redis/pv5 *(ro,sync,no_root_squash,no_subtree_check)
/nfs/redis/pv6 *(ro,sync,no_root_squash,no_subtree_check)

重新刷新配置共享配置文件中的共享目录

exportfs -rv

查看 nfs共享目录

showmount -e 192.168.0.254

输出

Export list for 192.168.0.254:
/nfs/redis/pv6 *
/nfs/redis/pv5 *
/nfs/redis/pv4 *
/nfs/redis/pv3 *
/nfs/redis/pv2 *
/nfs/redis/pv1 *

k8s 安装略

请自行搜索 k8s 安装

Kubernetes部署redis集群

创建ConfigMap

redis-cm.yml

apiVersion: v1
kind: ConfigMap
metadata:name: redis-cluster
data:update-node.sh: |#!/bin/shREDIS_NODES="/data/nodes.conf"sed -i -e "/myself/ s/[0-9]\{1,3\}\.[0-9]\{1,3\}\.[0-9]\{1,3\}\.[0-9]\{1,3\}/${POD_IP}/" ${REDIS_NODES}exec "$@"redis.conf: |+cluster-enabled yescluster-require-full-coverage nocluster-node-timeout 15000cluster-config-file /data/nodes.confcluster-migration-barrier 1dir /dataappendonly yesprotected-mode no

执行创建命令

kubectl apply -f redis-cm.yml

查看ConfigMap

kubectl get cm

输出

NAME               DATA   AGE
kube-root-ca.crt   1      42h
redis-cluster      2      16h

创建pv

redis-pv.yml

apiVersion: v1
kind: PersistentVolume
metadata:name: redis-pv1
spec:capacity:storage: 5GiaccessModes:- ReadWriteOncepersistentVolumeReclaimPolicy: RecyclestorageClassName: "redis-cluster"nfs:path: /nfs/redis/pv1server: 192.168.0.254
---
apiVersion: v1
kind: PersistentVolume
metadata:name: redis-pv2
spec:capacity:storage: 5GiaccessModes:- ReadWriteOncepersistentVolumeReclaimPolicy: RecyclestorageClassName: "redis-cluster"nfs:path: /nfs/redis/pv2server: 192.168.0.254
---
apiVersion: v1
kind: PersistentVolume
metadata:name: redis-pv3
spec:capacity:storage: 5GiaccessModes:- ReadWriteOncepersistentVolumeReclaimPolicy: RecyclestorageClassName: "redis-cluster"nfs:path: /nfs/redis/pv3server: 192.168.0.254
---
apiVersion: v1
kind: PersistentVolume
metadata:name: redis-pv4
spec:capacity:storage: 5GiaccessModes:- ReadWriteOncepersistentVolumeReclaimPolicy: RecyclestorageClassName: "redis-cluster"nfs:path: /nfs/redis/pv4server: 192.168.0.254
---
apiVersion: v1
kind: PersistentVolume
metadata:name: redis-pv5
spec:capacity:storage: 5GiaccessModes:- ReadWriteOncepersistentVolumeReclaimPolicy: RecyclestorageClassName: "redis-cluster"nfs:path: /nfs/redis/pv5server: 192.168.0.254
---
apiVersion: v1
kind: PersistentVolume
metadata:name: redis-pv6
spec:capacity:storage: 5GiaccessModes:- ReadWriteOncepersistentVolumeReclaimPolicy: RecyclestorageClassName: "redis-cluster"nfs:path: /nfs/redis/pv6server: 192.168.0.254

执行创建命令

kubectl apply -f redis-pv.yml

输出

persistentvolume/redis-pv1 created
persistentvolume/redis-pv2 created
persistentvolume/redis-pv3 created
persistentvolume/redis-pv4 created
persistentvolume/redis-pv5 created
persistentvolume/redis-pv6 created

查看pv

kubectl get pv

输出

NAME        CAPACITY   ACCESS MODES   RECLAIM POLICY   STATUS   CLAIM                          STORAGECLASS    REASON   AGE
redis-pv1   5Gi        RWO            Recycle          Bound    default/data-redis-cluster-0   redis-cluster            16h
redis-pv2   5Gi        RWO            Recycle          Bound    default/data-redis-cluster-1   redis-cluster            16h
redis-pv3   5Gi        RWO            Recycle          Bound    default/data-redis-cluster-2   redis-cluster            16h
redis-pv6   5Gi        RWO            Recycle          Bound    default/data-redis-cluster-3   redis-cluster            16h
redis-pv4   5Gi        RWO            Recycle          Bound    default/data-redis-cluster-4   redis-cluster            16h
redis-pv5   5Gi        RWO            Recycle          Bound    default/data-redis-cluster-5   redis-cluster            16h

创建 StatefulSet

redis-sts.yml

---
apiVersion: apps/v1
kind: StatefulSet
metadata:name: redis-cluster
spec:serviceName: redis-clusterreplicas: 6selector:matchLabels:app: redis-clustertemplate:metadata:labels:app: redis-clusterspec:containers:- name: redisimage: redis:6.2-alpineports:- containerPort: 6379name: client- containerPort: 16379name: gossipcommand: ["/conf/update-node.sh", "redis-server", "/conf/redis.conf"]env:- name: POD_IPvalueFrom:fieldRef:fieldPath: status.podIPvolumeMounts:- name: confmountPath: /confreadOnly: false- name: datamountPath: /datareadOnly: falsevolumes:- name: confconfigMap:name: redis-clusterdefaultMode: 0755volumeClaimTemplates:- metadata:name: dataspec:accessModes: [ "ReadWriteOnce" ]resources:requests:storage: 5GistorageClassName: redis-cluster

执行创建命令

kubectl apply -f redis-sts.yml

输出

statefulset.apps/redis-cluster created

查看

kubectl get pods -l app=redis-cluster

输出

NAME              READY   STATUS    RESTARTS   AGE
redis-cluster-0   1/1     Running   0          16h
redis-cluster-1   1/1     Running   0          16h
redis-cluster-2   1/1     Running   0          16h
redis-cluster-3   1/1     Running   0          16h
redis-cluster-4   1/1     Running   0          16h
redis-cluster-5   1/1     Running   0          16h

创建 svc

redis-svc.yml

---
apiVersion: v1
kind: Service
metadata:name: redis-cluster
spec:type: ClusterIPports:- port: 6379targetPort: 6379name: client- port: 16379targetPort: 16379name: gossipselector:app: redis-cluster

执行创建命令

kubectl apply -f redis-svc.yml

输出

service/redis-cluster created

查看 svc redis-cluster

kubectl get svc redis-cluster

输出

NAME            TYPE        CLUSTER-IP      EXTERNAL-IP   PORT(S)              AGE
redis-cluster   ClusterIP   10.43.216.117   <none>        6379/TCP,16379/TCP   17h

初始化 Redis Cluster

在命令执行中有Can I set the above configuration? (type 'yes' to accept):时，要输入yes创建集群

kubectl exec -it redis-cluster-0 -- redis-cli --cluster create --cluster-replicas 1 $(kubectl get pods -l app=redis-cluster -o jsonpath='{range.items[*]}{.status.podIP}:6379 {end}')

输出

····
Can I set the above configuration? (type 'yes' to accept): yes
····

验证集群部署

kubectl exec -it redis-cluster-0 -- redis-cli cluster info

输出

····
cluster_state:ok
cluster_slots_assigned:16384
cluster_slots_ok:16384
cluster_slots_pfail:0
cluster_slots_fail:0
cluster_known_nodes:6
cluster_size:3
cluster_current_epoch:6
cluster_my_epoch:1
cluster_stats_messages_ping_sent:57351
cluster_stats_messages_pong_sent:55991
cluster_stats_messages_sent:113342
cluster_stats_messages_ping_received:55986
cluster_stats_messages_pong_received:57351
cluster_stats_messages_meet_received:5
cluster_stats_messages_received:113342
····

查看各个redis的主从状态

for x in $(seq 0 5); do echo "redis-cluster-$x"; kubectl exec redis-cluster-$x -- redis-cli role; echo; done

输出

redis-cluster-0
master
80332
10.42.0.19
6379
80332redis-cluster-1
master
80332
10.42.0.20
6379
80332redis-cluster-2
master
80332
10.42.0.18
6379
80332redis-cluster-3
slave
10.42.0.17
6379
connected
80332redis-cluster-4
slave
10.42.0.15
6379
connected
80332redis-cluster-5
slave
10.42.0.16
6379
connected
80346

参考

https://github.com/zuxqoj/kubernetes-redis-cluster

https://github.com/llmgo/redis-sts.git

https://rancher.com/blog/2019/deploying-redis-cluster/

https://www.cnblogs.com/winstom/p/11881882.html

https://blog.csdn.net/zhutongcloud/article/details/90768390

k8s(Kubernetes) 上部署 Redis 集群(3主3从)相关推荐

在K8s上部署Redis 集群
一.前言架构原理:每个Master都可以拥有多个Slave.当Master下线后,Redis集群会从多个Slave中选举出一个新的Master作为替代,而旧Master重新上线后变成新Master的 ...
在三台Redis节点上部署哨兵集群以及主备切换、故障恢复的容灾演练中哨兵各自的日志信息、状态查看分析
1. 创建哨兵的配置文件先在 /etc 目录创建一个sentinel目录作为哨兵的配置信息存放目录,并将Redis安装目录的sentinel.conf文件(我这边路径是 /usr/local/red ...
k8s部署redis集群
K8S部署Redis Cluster集群 kubernetes部署单节点redis: https://www.cnblogs.com/zisefeizhu/p/14282299.html Redis ...
Kubernetes学习总结（16）—— Kubernetes 实战之部署 Redis 集群
一.问题分析本质上来说在 k8s 上部署一个 redis 集群和部署一个普通应用没有什么太大的区别,但需要注意下面几个问题: Redis 是一个有状态应用:这是部署 redis 集群时我们最需要注意 ...
redis映射的概念_在K8S上搭建Redis集群
今天让我们试着在k8s里部署一个redis集群,了解更多k8s的细节和特性. 环境:minikube v0.30 (kubernetes 1.10) 问题分析本质上来说,在k8s上部署一个redis ...
通过operator部署redis集群（ucloud版）
operator部署有状态的应用会简单很多 github文档:https://github.com/ucloud/redis-cluster-operator#deploy-redis-cluster ...
Centos6.6部署Redis集群
Centos6.6部署Redis集群 1 环境准备 1 环境安装redis 1 安装ruby 2 配置redis主从环境 3 部署redis sentinel服务器 5 集群使用 13 当前集群环境说 ...
operator部署redis集群
operator部署redis集群 1.现在operator的redis相关包 git clone https://github.com/ucloud/redis-cluster-operator.g ...
在windows上搭建redis集群（主从复制）
Redis集群策略主要有: 主从复制哨兵模式 (在windows上搭建redis集群(Redis-Sentinel)) 集群 (在windows上搭建redis集群(Redis-Cluster)) ...
在windows上搭建redis集群（Redis-Sentinel）
Redis集群策略主要有: 哨兵模式主从复制(在windows上搭建redis集群(主从复制)) 集群 (在windows上搭建redis集群(Redis-Cluster)) 分片本文主要讲解如何 ...

k8s(Kubernetes) 上部署 Redis 集群(3主3从)

需求

必备环境安装

ubuntu20.x 服务器 nfs服务安装

重新刷新配置共享配置文件中的共享目录

查看 nfs共享目录

k8s 安装略

Kubernetes部署redis集群

创建ConfigMap

执行创建命令

查看ConfigMap

创建pv

执行创建命令

查看pv

创建 StatefulSet

执行创建命令

查看

创建 svc

执行创建命令

查看 svc redis-cluster

初始化 Redis Cluster

验证集群部署

查看各个redis的主从状态

k8s(Kubernetes) 上部署 Redis 集群(3主3从)相关推荐

最新文章

热门文章

k8s(Kubernetes) 上部署 Redis 集群(3主3从)

需求

必备环境安装

ubuntu20.x 服务器 nfs服务安装

重新 刷新配置共享配置文件中的共享目录

查看 nfs共享目录

k8s 安装略

Kubernetes部署redis集群

创建ConfigMap

执行创建命令

查看ConfigMap

创建pv

执行创建命令

查看pv

创建 StatefulSet

执行创建命令

查看

创建 svc

执行创建命令

查看 svc redis-cluster

初始化 Redis Cluster

验证集群部署

查看各个redis的主从状态

k8s(Kubernetes) 上部署 Redis 集群(3主3从)相关推荐

最新文章

热门文章

重新刷新配置共享配置文件中的共享目录