PXC5.7(Percona XtraDB Cluster)+HAproxy集群部署
PXC是Percona XtraDB Cluster的缩写,是一种具有高可用性和高扩展性的MySQL开源集群。它集成了Percona Server和Percona XtraBackup,同时采用了Codership Galera库。
优点:
1.准同步复制
2.多个可同时读写节点,可实现写扩展,较分片方案更进一步
3.自动节点管理
4.数据严格一致
5.服务高可用
缺点:
1.只支持innodb引擎
2.所有表都要有主键
3.所有的写操作都将发生在所有节点上,存在写扩大问题
4.加入新节点,开销大。需要复制完整的数据。
部署准备工作
主机名 | IP |
pxc-linux-28 | 192.168.253.28 |
pxc-linux-29 | 192.168.253.29 |
pxc-linux-30 | 192.168.253.30 |
haproxy-linux-31 | 192.168.253.31 |
三个PXC节点分别配置防火墙
[root@pxc-linux-28 ~]# firewall-cmd --add-port=3306/tcp --permanent [root@pxc-linux-28 ~]# firewall-cmd --add-port=4567/tcp --permanent [root@pxc-linux-28 ~]# firewall-cmd --add-port=4568/tcp --permanent [root@pxc-linux-28 ~]# firewall-cmd --add-port=4444/tcp --permanent [root@pxc-linux-28 ~]# firewall-cmd --reload
安装相关yum源
rpm -Uvh https://www.percona.com/downloads/percona-release/redhat/latest/percona-release-0.1-4.noarch.rpm
安装pxc
yum install Percona-XtraDB-Cluster-57 -y
分别在三个节点创建数据存储目录
mkdir -p /data/local/percona-xtradb-cluster/data chown -R mysql:mysql /data/local/percona-xtradb-cluster/data mkdir -p /data/local/percona-xtradb-cluster/run chown -R mysql:mysql /data/local/percona-xtradb-cluster/run mkdir -p /data/logs/mysql chown -R mysql:mysql /data/logs/mysql
修改/etc/my.cnf配置文件,其他两台节点需要修改server_id和wsrep_node_address
pxc-linux-28:
#cat /etc/my.cnf [client] port = 3306 socket = /data/local/percona-xtradb-cluster/run/mysql.sock default-character-set = utf8mb4 [mysqld] user = mysql innodb_buffer_pool_size = 1024M character_set_server = utf8mb4 datadir = /data/local/percona-xtradb-cluster/data port = 3306 server_id = 28 socket = /data/local/percona-xtradb-cluster/run/mysql.sock pid-file = /data/local/percona-xtradb-cluster/run/mysql.pid log-error = /data/logs/mysql/error.log log_warnings = 2 slow_query_log_file = /data/logs/mysql/slow.log long_query_time = 2 log_timestamps=SYSTEM lower_case_table_names = 1 key_buffer_size = 1344M event_scheduler=ON sql_mode=NO_ENGINE_SUBSTITUTION,STRICT_TRANS_TABLES wsrep_provider=/usr/lib64/libgalera_smm.so wsrep_cluster_address=gcomm://192.168.253.28,192.168.253.29,192.168.253.30 binlog_format=ROW pxc_strict_mode=PERMISSIVE max_connect_errors=1000 max_allowed_packet = 1024M default_storage_engine=InnoDB #Innodb innodb_flush_method = O_DIRECT innodb_log_files_in_group = 5 innodb_lock_wait_timeout = 50 innodb_log_file_size = 1024M innodb_flush_log_at_trx_commit = 1 innodb_file_per_table = 1 innodb_thread_concurrency = 8 innodb_buffer_pool_size = 5G innodb_read_io_threads = 24 innodb_write_io_threads = 24 log_bin_trust_function_creators=1 innodb_autoinc_lock_mode=2 innodb_locks_unsafe_for_binlog=1 # CACHES AND LIMITS # tmp_table_size = 32M max_heap_table_size = 32M max_connections = 1000 thread_cache_size = 50 open_files_limit = 65535 table_definition_cache = 4096 table_open_cache = 5000 #wsrep wsrep_retry_autocommit=1 wsrep_auto_increment_control=1 wsrep_node_name = pxc-linux-28 wsrep_node_address=192.168.253.28 wsrep_sst_method=xtrabackup-v2 wsrep_cluster_name=test-pxc wsrep_sst_auth="sync_rep:abc123"
pxc-linux-29:
[client] port = 3306 socket = /data/local/percona-xtradb-cluster/run/mysql.sock default-character-set = utf8mb4 [mysqld] user = mysql innodb_buffer_pool_size = 1024M character_set_server = utf8mb4 datadir = /data/local/percona-xtradb-cluster/data port = 3306 server_id = 29 socket = /data/local/percona-xtradb-cluster/run/mysql.sock pid-file = /data/local/percona-xtradb-cluster/run/mysql.pid log-error = /data/logs/mysql/error.log log_warnings = 2 slow_query_log_file = /data/logs/mysql/slow.log long_query_time = 2 log_timestamps=SYSTEM log_bin_trust_function_creators=1 lower_case_table_names=1 key_buffer_size = 1344M event_scheduler=ON sql_mode=NO_ENGINE_SUBSTITUTION,STRICT_TRANS_TABLES wsrep_provider=/usr/lib64/libgalera_smm.so wsrep_cluster_address=gcomm://192.168.253.28,192.168.253.29,192.168.253.30 binlog_format=ROW pxc_strict_mode=PERMISSIVE max_connect_errors=1000 max_allowed_packet = 1024M default_storage_engine=InnoDB #Innodb innodb_flush_method = O_DIRECT innodb_log_files_in_group = 5 innodb_lock_wait_timeout = 50 innodb_log_file_size = 1024M innodb_flush_log_at_trx_commit = 1 innodb_file_per_table = 1 innodb_thread_concurrency = 8 innodb_buffer_pool_size = 5G innodb_read_io_threads = 24 innodb_write_io_threads = 24 log_bin_trust_function_creators=1 innodb_autoinc_lock_mode=2 innodb_locks_unsafe_for_binlog=1 # CACHES AND LIMITS # tmp_table_size = 32M max_heap_table_size = 32M max_connections = 1000 thread_cache_size = 50 open_files_limit = 65535 table_definition_cache = 4096 table_open_cache = 5000 #wsrep wsrep_retry_autocommit=1 wsrep_auto_increment_control=1 wsrep_node_name =pxc-linux-29 wsrep_node_address=192.168.253.29 wsrep_sst_method=xtrabackup-v2 wsrep_cluster_name=test-pxc wsrep_sst_auth="sync_rep:abc123"
pxc-linux-30:
[client] port = 3306 socket = /data/local/percona-xtradb-cluster/run/mysql.sock default-character-set = utf8mb4 [mysqld] user = mysql innodb_buffer_pool_size = 1024M character_set_server = utf8mb4 datadir = /data/local/percona-xtradb-cluster/data port = 3306 server_id = 30 socket = /data/local/percona-xtradb-cluster/run/mysql.sock pid-file = /data/local/percona-xtradb-cluster/run/mysql.pid log-error = /data/logs/mysql/error.log log_warnings = 2 slow_query_log_file = /data/logs/mysql/slow.log long_query_time = 2 log_timestamps=SYSTEM lower_case_table_names = 1 key_buffer_size = 1344M event_scheduler=ON sql_mode=NO_ENGINE_SUBSTITUTION,STRICT_TRANS_TABLES wsrep_provider=/usr/lib64/libgalera_smm.so wsrep_cluster_address=gcomm://192.168.253.28,192.168.253.29,192.168.253.30 binlog_format=ROW pxc_strict_mode=PERMISSIVE max_connect_errors=1000 max_allowed_packet = 1024M default_storage_engine=InnoDB #Innodb innodb_flush_method = O_DIRECT innodb_log_files_in_group = 5 innodb_lock_wait_timeout = 50 innodb_log_file_size = 1024M innodb_flush_log_at_trx_commit = 1 innodb_file_per_table = 1 innodb_thread_concurrency = 8 innodb_buffer_pool_size = 5G innodb_read_io_threads = 24 innodb_write_io_threads = 24 log_bin_trust_function_creators=1 innodb_autoinc_lock_mode=2 innodb_locks_unsafe_for_binlog=1 # CACHES AND LIMITS # tmp_table_size = 32M max_heap_table_size = 32M max_connections = 1000 thread_cache_size = 50 open_files_limit = 65535 table_definition_cache = 4096 table_open_cache = 5000 #wsrep wsrep_retry_autocommit=1 wsrep_auto_increment_control=1 wsrep_node_name = pxc-linux-30 wsrep_node_address=192.168.253.30 wsrep_sst_method=xtrabackup-v2 wsrep_cluster_name=test-pxc wsrep_sst_auth="sync_rep:abc123"
pxc-linux-28启动
systemctl start mysql@bootstrape
备注:谨记,只要是启动集群的第一个Node(首次搭建集群或者集群全部关闭),都要用此命令
pxc-linux-29和pxc-linux-30启动
systemctl start mysql
备注:谨记,只要集群有一个Node启动,其余节点都是用此命令
修改密码
mysql5.7版本日志均在error.log 里面生成
grep "temporary password" /data/logs/mysql/error.log
使用改密码登陆MySQL,修改成自己想要的密码
mysql> alter user 'root'@'localhost' idnetified by '123456';
在pxc-linux-28MySQL中创建SST同步用户
mysql> GRANT PROCESS,RELOAD,LOCK TABLES,REPLICATION CLIENT ON *.* TO 'sync_rep'@'192.168.%.%' IDENTIFIED BY 'abc123'; mysql> flush privileges;
State Snapshot Transfer 是可以让one node (donor) 通过数据拷贝升级至joining node (joiner)。
一个新节点加入至集群中,需要同步数据,那么SST可以传输数据,让新节点成为集群的一部分。
SST的三个有效方法:mysqldump, rsync andxtrabackup。不过多解释,目前最好用的是xtrabackup
查看集群状态
集群验证
[root@pxc-linux-28 ~]# mysql -uroot -p mysql> show variables like 'version'; +---------------+--------------+ | Variable_name | Value | +---------------+--------------+ | version | 5.7.19-17-57 | +---------------+--------------+ 1 row in set (0.00 sec) mysql> create database pxcdb; mysql> use pxcdb; mysql> create table t1(id tinyint,ename varchar(20)); mysql> insert into t1 values(1,'Leshami'); 在29上进行验证 [root@pxc-linux-29 ~]# mysql -uroot -p mysql> show databases; +--------------------+ | Database | +--------------------+ | information_schema | | mysql | | performance_schema | | pxcdb | | sys | +--------------------+ 5 rows in set (0.00 sec) mysql> show variables like 'server_id'; +---------------+-------+ | Variable_name | Value | +---------------+-------+ | server_id | 29 | +---------------+-------+ 1 row in set (0.01 sec) mysql> select * from pxcdb.t1; +------+---------+ | id | ename | +------+---------+ | 1 | Leshami | +------+---------+ 1 row in set (0.00 sec) --查看集群状态 mysql> show status like '%wsrep_clust%'; +--------------------------+--------------------------------------+ | Variable_name | Value | +--------------------------+--------------------------------------+ | wsrep_cluster_conf_id | 13 | | wsrep_cluster_size | 3 | | wsrep_cluster_state_uuid | aeb87793-ebb2-11e7-b33e-eeaf4988bbe4 | | wsrep_cluster_status | Primary | +--------------------------+--------------------------------------+ 4 rows in set (0.00 sec) mysql> show status like 'wsrep_connected'; +-----------------+-------+ | Variable_name | Value | +-----------------+-------+ | wsrep_connected | ON | +-----------------+-------+ 1 row in set (0.00 sec)
openssl版本过低导致的错误
2017-12-28T09:23:19.605353Z 0 [ERROR] WSREP: wsrep_load(): dlopen(): /usr/lib64/galera3/libgalera_smm.so: symbol SSL_COMP_free_compression_methods, version libssl.so.10 not defined in file libssl.so.10 with link time reference 2017-12-28T09:23:19.605379Z 0 [ERROR] WSREP: Failed to load wsrep_provider (/usr/lib64/galera3/libgalera_smm.so).Error: Invalid argument (code: 22). Reverting to no provider. 2017-12-28T09:23:19.605386Z 0 [Note] WSREP: Setting wsrep_ready to false [root@pxc-linux-29 ~]# rpm -qa|grep openssl openssl-1.0.1e-42.el7.9.x86_64 openssl-libs-1.0.1e-42.el7.9.x86_64 [root@pxc-linux-29 ~]# yum update openssl -y
需要升级openssl,建议全部升级后再启动集群,这问题在CentOS 7.4.1708不存在即openssl版本较新
Haproxy负载均衡
Haproxy是一个反向代理负载均衡解决方案,支持4层和7层模式,提供后端服务器健康检查,非常稳定。淘宝前期也使用Haproxy作为CDN系统负载均衡器。
安装haproxy
yum -y install haproxy
简单配置文件:
cat /etc/haproxy/haproxy.cfg #--------------------------------------------------------------------- # Example configuration for a possible web application. See the # full configuration options online. # # http://haproxy.1wt.eu/download/1.4/doc/configuration.txt # #--------------------------------------------------------------------- #--------------------------------------------------------------------- # Global settings #--------------------------------------------------------------------- global# to have these messages end up in /var/log/haproxy.log you will# need to:## 1) configure syslog to accept network log events. This is done# by adding the '-r' option to the SYSLOGD_OPTIONS in# /etc/sysconfig/syslog## 2) configure local2 events to go to the /var/log/haproxy.log# file. A line like the following can be added to# /etc/sysconfig/syslog## local2.* /var/log/haproxy.log#log 127.0.0.1 local2chroot /var/lib/haproxypidfile /var/run/haproxy.pidmaxconn 4000user haproxygroup haproxydaemon# turn on stats unix socketstats socket /var/lib/haproxy/stats #--------------------------------------------------------------------- # common defaults that all the 'listen' and 'backend' sections will # use if not designated in their block #--------------------------------------------------------------------- defaultsmode httplog globaloption httplogoption dontlognulloption http-server-closeoption forwardfor except 127.0.0.0/8option redispatchretries 3timeout http-request 10stimeout queue 1mtimeout connect 10stimeout client 1mtimeout server 1mtimeout http-keep-alive 10stimeout check 10smaxconn 3000 #--------------------------------------------------------------------- # main frontend which proxys to the backends #--------------------------------------------------------------------- frontend pxc-frontbind *:3306mode tcpdefault_backend pxc-back frontend statas-frontbind *:8088mode httpdefault_backend stats-back #--------------------------------------------------------------------- # static backend for serving up images, stylesheets and such #--------------------------------------------------------------------- backend pxc-backmode tcpbalance leastconnoption httpchkserver pxc-linux-28 192.168.253.28:3306 check port 9200 inter 12000 rise 3 fall 3server pxc-linux-29 192.168.253.29:3306 check port 9200 inter 12000 rise 3 fall 3server pxc-linux-30 192.168.253.30:3306 check port 9200 inter 12000 rise 3 fall 3 #--------------------------------------------------------------------- # round robin balancing between the various backends #--------------------------------------------------------------------- backend stats-backmode httpbalance roundrobinstats uri /haproxy/statsstats auth pxcstats:xxwzopop
在cluster的MySQL上创建用户
(一个节点创建,会被复制到其它节点)
监控用帐号:
grant usage on *.* to 'pxc-monitor'@'%' identified by 'testpxc';
服务测试帐号:
grant all privileges on *.* to 'zxw'@'%' identified by 'xxwzopop';
更改用户名和密码(三个节点都得修改)
#vim /usr/bin/clustercheck MYSQL_USERNAME="pxc-monitor" MYSQL_PASSWORD="testpxc"
测试
[root@pxc-linux-28 ~]# clustercheck HTTP/1.1 200 OK Content-Type: text/plain Connection: close Content-Length: 40 Percona XtraDB Cluster Node is synced.
更改/etc/services添加mysqlchk的端口号:
mysqlchk 9200/tcp #mysqlchk
配置xinetd
vi /etc/xinetd.d/mysqlchk
该文件保持默认即可
测试
#for i in `seq 1 1000`;do mysql -h 192.168.253.31 -P3306 -upxc -pabc123 -e "select @@hostname;";done mysql: [Warning] Using a password on the command line interface can be insecure. +--------------+ | @@hostname | +--------------+ | pxc-linux-30 | +--------------+ mysql: [Warning] Using a password on the command line interface can be insecure. +--------------+ | @@hostname | +--------------+ | pxc-linux-28 | +--------------+ mysql: [Warning] Using a password on the command line interface can be insecure. +--------------+ | @@hostname | +--------------+ | pxc-linux-29 | +--------------+
可以看到负载了
查看haproxy状态
http://192.168.253.31:8088/haproxy/stats
帐号密码是:pxcstats:xxwzopop
/etc/haproxy/haproxy.cfg 指定的。
企业级Docker+Jenkins+Gitlab自动化流水线构建实践
http://edu.51cto.com/course/14600.html
更多经常内容请关注,以下公众号,免费教程随便下
转载于:https://blog.51cto.com/11243465/2104885
PXC5.7(Percona XtraDB Cluster)+HAproxy集群部署相关推荐
- 基于Docker搭建Percona XtraDB Cluster数据库集群
本文实验的环境参数 阿里云ECS Centos7.5 Docker version 18.06.0-ce percona/percona-xtradb-cluster:5.7 Percona Xtra ...
- PXC(Percona XtraDB Cluster)集群安装
作者在2014Oracle数据库嘉年华中有幸听到了关于去哪网的MySQL数据库基于PXC的高可用架构设计主题. MySQL和Oracle是完全不同的两种数据库,Oracle重于管理,而MySQL更重要 ...
- Mysql搭建PXC集群 - Percona XtraDB Cluster
转载来源:https://blog.csdn.net/lvshaorong/article/details/80501905 pxc集群是Percona XtraDB Cluster的缩写,是基于p ...
- Apache Durid (HDFS原理 特性 读写测试 集群部署 架构设计)
Apache Durid (HDFS 集群部署) Apache Durid (HDFS 集群部署) 1. 分布式文件HDFS 1.1 HDFS简介 1.1.1 HDFS发展历史 1.1.2 HDFS设 ...
- Percona XtraDB Cluster 集群参数配置说明(PXC 5.7)
从PXC5.7版本开始,集群的配置主要是通过wsrep.cnf配置来实现.这个文件有几个常用的参数配置.下文对其做简要说明. 一.PXC 5.7集群配置文件 如果是直接通过yum方式安装,那么配置文件 ...
- 在CentOS上配置Percona XtraDB集群(Percona XtraDB Cluster)
原作者:Percona官网 翻译&转载来源:https://www.percona.com/doc/percona-xtradb-cluster/LATEST/howtos/centos_ho ...
- Percona XtraDB Cluster(PXC) Mysql 集群
Percona XtraDB Cluster(PXC) ---原理介绍篇 目录 一.简介 1 二.优缺点 2 三.区别/局限性 3 四. PXC复制原理 4 五. 服务解释 5 ...
- mysql集群方案PXC_【Mysql】MySQL集群方案之PXC(percona xtradb cluster)
Mysql PXC介绍 在传统的Mysql主从架构上,采用的Replaction是异步复制方式,这种方式会存在数据弱一致性的问题,数据写入主库之后因为网络及复制的延迟从库不能马上获取刚刚插入的数据,同 ...
- mysql percona 集群_MySQL高可用性解决方案—Percona XtraDB Cluster
MySQL数据库的性能是服务器运维中不可缺少的部分,需要不断的优化数据库的性能,寻找出系统的瓶颈.今天就来分享一款提高数据库高可用性的解决方案.Percona XtraDB Cluster---MyS ...
最新文章
- Spring Cloud应用开发(三:客户端的负载均衡)
- linux6 yum安装mysql_linux CentOS6.5 yum安装mysql5.6
- redis trie
- FreeMarker的使用
- android联网程序,android 联网 HttpClient
- ASP.NET Core Blazor Webassembly 之 数据绑定
- jigsaw kaggle_使用Project Jigsaw的JDK 9 Early Access上的Eclipse IDE
- dede首页如何调用单页文档内容标签
- C++实现均值滤波器和中值滤波器
- MAC安装maven步骤
- gaussdb 安全维护【设置帐户权限】【02】
- 关于H3C-WAP712C AP的胖瘦切换说明
- 粒子群算法(PSO)光伏发电 MPPT实现多峰值寻优,阴影遮蔽光伏发电算法 使用s函数编写粒子群算法,阴影遮蔽,实现多峰值寻优
- vue设置必填项和判断必填项是否填入的弹窗提示
- Keil警告:warning: #223-D: function “xxx“ declared implicitly解决
- [Mitchell 机器学习读书笔记]——人工神经网络
- 【MySQL】创建高性能的索引
- Windows Azure Virtual Network (13) 跨数据中心之间的虚拟网络点对点连接VNet Peering
- python列表添加_Python-如何为列表添加元素
- 文华财经指标安装使用步骤,开多开空成功率95%公式指标多空买卖点信号
热门文章
- 物联网可编程高灵活度IoT网关或集线器是解决方案
- BIEE连接数据库的方法
- C# DataSet性能最佳实践
- 用c#开发微信 (13) 微统计 - 阅读分享统计系统 3 UI设计及后台处理
- Android屏幕尺寸适配注意事项
- AnkhSVN的自动加锁
- 网站页首可关闭广告条
- SVN 自动部署到开发环境
- Android简单实现BroadCastReceiver广播机制
- 子查询返回的值不止一个。当子查询跟随在 =、!=、、=、、= 之后,或子查询用作表达式时,这种情况是不允许的。...