mysql 分库分表实战_DBLE分库分表实战
环境: DBLE 2.19.03.0
OS版本: CentOS Linux release 7.6.1810 (Core)
IP: 192.168.20.10/24
MySQL版本:MySQL-社区版-5.7.26
添加2个账号授权:
create user 'rw'@'%' identified by 'rw123456';
create user 'rd'@'%' identified by 'rd123456';
GRANT SELECT, INSERT, UPDATE, DELETE, CREATE,REFERENCES,CREATE TEMPORARY TABLES,INDEX ON *.* TO rw@'%' ;
GRANT SELECT ON *.* TO 'rd'@'%' ;
连接方式:
读写:
mysql -urw -prw123456 --port 8066 -h 192.168.20.10 testdb
只读:
mysql -urd -prd123456 --port 8066 -h 192.168.20.10 testdb
ddl专用:
mysql -uop -p123456 --port 8066 -h 192.168.20.10 testdb
管理账号:
mysql -uman1 -p654321 --port 9066 -h 192.168.20.10
解压DBLE:
tar xf dble-2.19.03.tar.gz /usr/local/
cd /usr/local
ln -s dble-2.19.03 dble
cd conf/
vim schema.xml 修改后的如下:<?xml version="1.0"?>
dble:schema SYSTEM "schema.dtd">
select user()
vim rule.xml 修改后的内容如下:
id
rangeLong2
id
hashmod3
open_id
hashStringmod3
autopartition-long_t.txt
0
3
1
3
1
0:20
[root@centos7 /usr/local/dble/conf ]# vim autopartition-long_t.txt # 增加一个路由规则文件# range start-end ,data node index
# K=1000,M=10000.
# 范围:前开后闭 (开区间,闭区间]
0-1M=0
1M-2M=1
2M-3M=2
vim server.xml 内容如下:修改user部分为如下:
654321
true
123456
testdb
rw123456
testdb
rd123456
testdb
true
然后, reload 下 dble , 进行测试
ddl专用:
mysql -uop -p123456 --port 8066 -h 192.168.20.10 testdb
去创建符合上面的要求的几个表,并写入数据测试:
## 测试range分区
(testdb) > create table travelrecord (
id bigint not null primary key,
user_id varchar(100),
traveldate DATE,
fee decimal(10,2),
days int
) ENGINE=InnoDB DEFAULT CHARSET=utf8;
(testdb) > insert into travelrecord (id,user_id,traveldate,fee,days) values(10,'wang','2014-01-05',510,3);
(testdb) > insert into travelrecord (id,user_id,traveldate,fee,days) values(13000,'lee','2011-01-05',26.5,3);
(testdb) > insert into travelrecord (id,user_id,traveldate,fee,days) values(29800,'zhang','2018-01-05',23.3,3);
(testdb) > select * from travelrecord ;
+-------+---------+------------+--------+------+
| id | user_id | traveldate | fee | days |
+-------+---------+------------+--------+------+
| 10 | wang | 2014-01-05 | 510.00 | 3 |
| 13000 | lee | 2011-01-05 | 26.50 | 3 |
| 29800 | zhang | 2018-01-05 | 23.30 | 3 |
+-------+---------+------------+--------+------+
## 测试全局表
(testdb) > create table company(id int not null primary key,name varchar(100));
(testdb) > insert into company(id,name) values(1,'hp');
(testdb) > insert into company(id,name) values(2,'ibm');
(testdb) > insert into company(id,name) values(3,'oracle');
(testdb) > select * from company ;
+----+--------+
| id | name |
+----+--------+
| 1 | hp |
| 2 | ibm |
| 3 | oracle |
+----+--------+
3 rows in set (0.01 sec)
多执行几次,你会看到三个分片上都插入了3条数据,因为company定义为全局表。
(testdb) > explain insert into company(id,name) values(1,'hp');
+-----------+----------+---------------------------------------------+
| DATA_NODE | TYPE | SQL/REF |
+-----------+----------+---------------------------------------------+
| dn1 | BASE SQL | insert into company(id,name) values(1,'hp') |
| dn2 | BASE SQL | insert into company(id,name) values(1,'hp') |
| dn3 | BASE SQL | insert into company(id,name) values(1,'hp') |
+-----------+----------+---------------------------------------------+
3 rows in set (0.00 sec)
使用 explain select * from company ; 命令也可以看到随机分发到3个节点的。
## 测试hashmod分区
create table hotnews (id bigint unsigned not null primary key ,title varchar(400) ,created_time datetime) ENGINE=InnoDB DEFAULT CHARSET=utf8;
然后, 我们写个脚本,批量插入些数据,看看情况:
for i in {1..1000}; do
mysql -uop -p123456 --port 8066 -h 192.168.20.10 testdb -e "insert into hotnews(id,title,created_time) values($i,'one',now());"
done
然后,到后端的3个分片上看下数据量,大致如下,还是比较均匀的:
(db1) > select count(*) from db1.hotnews;
+----------+
| count(*) |
+----------+
| 333 |
+----------+
1 row in set (0.00 sec)
(db1) > select count(*) from db2.hotnews;
+----------+
| count(*) |
+----------+
| 334 |
+----------+
1 row in set (0.00 sec)
(db1) > select count(*) from db3.hotnews;
+----------+
| count(*) |
+----------+
| 333 |
+----------+
1 row in set (0.00 sec)
## hashStringmod分区
CREATE TABLE `user_auth` (
`id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT '主键id',
`open_id` varchar(100) NOT NULL DEFAULT '' COMMENT '第三方授权id',
`union_id` varchar(100) NOT NULL DEFAULT '' COMMENT '授权的关联id',
PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COMMENT='用户AUTH信息表' ;
#### 注意:实际生产环境的主键id需要由程序去保证唯一性(例如使用雪花算法)
(testdb) > insert into user_auth (id,open_id,union_id) values(1,'331116828422393856','oy0IAj9mdPUr7bLMl879Jp37eV3Y');
(testdb) > insert into user_auth (id,open_id,union_id) values(2,'341170994247204864','oy0IA3Yj9mdPUr7bLMl879Jp37eV');
(testdb) > insert into user_auth (id,open_id,union_id) values(3,'330414325695332352','oy0IAj9mdPU3Yr7bLMl879Jp37eV');
(testdb) > insert into user_auth (id,open_id,union_id) values(4,'328588424011591680','oy0IAj9mdPUr7bLMl8Jp37e79V');
(testdb) > insert into user_auth (id,open_id,union_id) values(5,'330414325695332352','oy0IA3Yj9mdPUr7p37ebLMl879JV3Y');
(testdb) > insert into user_auth (id,open_id,union_id) values(6,'341172222247211111','oy0IAj9bLMl879Jp37eV3YmdPUr7');
(testdb) > insert into user_auth (id,open_id,union_id) values(7,'341173334247755464','Jp37eoy0IAj9mdPUr73YbLMl879V');
(testdb) > select id,open_id,union_id from user_auth order by id asc ;
+----+--------------------+--------------------------------+
| id | open_id | union_id |
+----+--------------------+--------------------------------+
| 1 | 331116828422393856 | oy0IAj9mdPUr7bLMl879Jp37eV3Y |
| 2 | 341170994247204864 | oy0IA3Yj9mdPUr7bLMl879Jp37eV |
| 3 | 330414325695332352 | oy0IAj9mdPU3Yr7bLMl879Jp37eV |
| 4 | 328588424011591680 | oy0IAj9mdPUr7bLMl8Jp37e79V |
| 5 | 330414325695332352 | oy0IA3Yj9mdPUr7p37ebLMl879JV3Y |
| 6 | 341172222247211111 | oy0IAj9bLMl879Jp37eV3YmdPUr7 |
| 7 | 341173334247755464 | Jp37eoy0IAj9mdPUr73YbLMl879V |
+----+--------------------+--------------------------------+
7 rows in set (0.00 sec)
(testdb) > explain select id,open_id,union_id from user_auth where open_id = '341173334247755464' ;
+-----------+----------+--------------------------------------------------------------------------------+
| DATA_NODE | TYPE | SQL/REF |
+-----------+----------+--------------------------------------------------------------------------------+
| dn2 | BASE SQL | select id,open_id,union_id from user_auth where open_id = '341173334247755464' |
+-----------+----------+--------------------------------------------------------------------------------+
1 row in set (0.00 sec)
(testdb) > explain select id,open_id,union_id from user_auth where open_id = '331116828422393856' ;
+-----------+----------+--------------------------------------------------------------------------------+
| DATA_NODE | TYPE | SQL/REF |
+-----------+----------+--------------------------------------------------------------------------------+
| dn1 | BASE SQL | select id,open_id,union_id from user_auth where open_id = '331116828422393856' |
+-----------+----------+--------------------------------------------------------------------------------+
1 row in set (0.00 sec)
(testdb) > explain select id,open_id,union_id from user_auth where open_id = '328588424011591680' ;
+-----------+----------+--------------------------------------------------------------------------------+
| DATA_NODE | TYPE | SQL/REF |
+-----------+----------+--------------------------------------------------------------------------------+
| dn3 | BASE SQL | select id,open_id,union_id from user_auth where open_id = '328588424011591680' |
+-----------+----------+--------------------------------------------------------------------------------+
1 row in set (0.00 sec)
############################################################################
上面就是几种常用的分区了, 另外还有种 date类型按时间分区的可能在日志表的场景下也常用些。
date类型分区的实验:
先去后端的db上创建物理的库:create database userdb1 ;
create database userdb2 ;
create database userdb3 ;
create database userdb4 ;
create database userdb5 ;
create database userdb6 ;
create database userdb7 ;
create database userdb8 ;
create database userdb9 ;
create database userdb10 ;
create database userdb11 ;
create database userdb12 ;
create database userdb13 ;
修改后的 schema.xml 类似如下:<?xml version="1.0"?>
dble:schema SYSTEM "schema.dtd">
select user()
然后,到 rule.xml中添加规则:
addData
partbymonth-user
yyyy-MM-dd
2018-01-01
30
0
(testdb) > create table if not exists user (addData date, dbname varchar(32),username varchar(32),province varchar(16),age int(3));
(testdb) > insert into user (addData,dbname,username,age) values ('2015-01-01',database(),'user1',12);
(testdb) > insert into user (addData,dbname,username,age) values ('2016-02-01',database(),'user1',12);
(testdb) > explain insert into user (addData,dbname,username,age) values ('2017-03-01',database(),'user1',12);
+-----------+----------+--------------------------------------------------------------------------------------------------+
| DATA_NODE | TYPE | SQL/REF |
+-----------+----------+--------------------------------------------------------------------------------------------------+
| user_dn1 | BASE SQL | INSERT INTO user (addData, dbname, username, age) VALUES ('2017-03-01', DATABASE(), 'user1', 12) |
+-----------+----------+--------------------------------------------------------------------------------------------------+
(testdb) > insert into user (addData,dbname,username,age) values ('2017-03-01',database(),'user1',12);
(testdb) > insert into user (addData,dbname,username,age) values ('2018-04-01',database(),'user1',12);
(testdb) > insert into user (addData,dbname,username,age) values ('2018-04-11',database(),'user1',12);
(testdb) > insert into user (addData,dbname,username,age) values ('2018-04-21',database(),'user1',12);
(testdb) > insert into user (addData,dbname,username,age) values ('2018-04-25',database(),'user1',12);
(testdb) > insert into user (addData,dbname,username,age) values ('2018-04-30',database(),'user1',12);
(testdb) > insert into user (addData,dbname,username,age) values ('2018-05-01',database(),'user1',12);
(testdb) > insert into user (addData,dbname,username,age) values ('2018-05-03',database(),'user1',12);
(testdb) > insert into user (addData,dbname,username,age) values ('2018-05-05',database(),'user1',12);
(testdb) > insert into user (addData,dbname,username,age) values ('2018-06-21',database(),'user1',12);
(testdb) > insert into user (addData,dbname,username,age) values ('2018-07-30',database(),'user1',12);
(testdb) > insert into user (addData,dbname,username,age) values ('2019-01-01',database(),'user1',12);
(testdb) > insert into user (addData,dbname,username,age) values ('2019-06-01',database(),'user1',12);
ERROR 1064 (HY000): can't find any valid data node :user -> ADDDATA -> 2019-06-01
因此,我们需要提前人工把分片加好 并做好可用分区的监控,不然会造成无法写入数据的事故出现。
(testdb) > select * from user order by addData asc ;
+------------+----------+----------+----------+------+
| addData | dbname | username | province | age |
+------------+----------+----------+----------+------+
| 2015-01-01 | userdb1 | user1 | NULL | 12 |
| 2016-02-01 | userdb1 | user1 | NULL | 12 |
| 2017-03-01 | userdb1 | user1 | NULL | 12 |
| 2018-04-01 | userdb4 | user1 | NULL | 12 |
| 2018-04-11 | userdb4 | user1 | NULL | 12 |
| 2018-04-21 | userdb4 | user1 | NULL | 12 |
| 2018-04-25 | userdb4 | user1 | NULL | 12 |
| 2018-04-30 | userdb4 | user1 | NULL | 12 |
| 2018-05-01 | userdb5 | user1 | NULL | 12 |
| 2018-05-03 | userdb5 | user1 | NULL | 12 |
| 2018-05-05 | userdb5 | user1 | NULL | 12 |
| 2018-06-21 | userdb6 | user1 | NULL | 12 |
| 2018-07-30 | userdb8 | user1 | NULL | 12 |
| 2019-01-01 | userdb13 | user1 | NULL | 12 |
+------------+----------+----------+----------+------+
14 rows in set (0.02 sec)
查询测试:
(testdb) > explain select * from user where addData between '2018-04-01' and '2018-04-30' ;
+-----------+----------+------------------------------------------------------------------------+
| DATA_NODE | TYPE | SQL/REF |
+-----------+----------+------------------------------------------------------------------------+
| user_dn4 | BASE SQL | select * from user where addData between '2018-04-01' and '2018-04-30' |
+-----------+----------+------------------------------------------------------------------------+
1 row in set (0.00 sec)
(testdb) > select * from user where addData between '2018-04-01' and '2018-04-30' ;
+------------+---------+----------+----------+------+
| addData | dbname | username | province | age |
+------------+---------+----------+----------+------+
| 2018-04-01 | userdb4 | user1 | NULL | 12 |
| 2018-04-11 | userdb4 | user1 | NULL | 12 |
| 2018-04-21 | userdb4 | user1 | NULL | 12 |
| 2018-04-25 | userdb4 | user1 | NULL | 12 |
| 2018-04-30 | userdb4 | user1 | NULL | 12 |
+------------+---------+----------+----------+------+
5 rows in set (0.01 sec)
(testdb) > explain select * from user where addData between '2018-04-01' and '2018-05-30' order by addData asc ;
+-----------------+---------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| DATA_NODE | TYPE | SQL/REF |
+-----------------+---------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| user_dn4_0 | BASE SQL | select `user`.`addData`,`user`.`dbname`,`user`.`username`,`user`.`province`,`user`.`age` from `user` where addData BETWEEN '2018-04-01' AND '2018-05-30' ORDER BY `user`.`addData` ASC |
| user_dn5_0 | BASE SQL | select `user`.`addData`,`user`.`dbname`,`user`.`username`,`user`.`province`,`user`.`age` from `user` where addData BETWEEN '2018-04-01' AND '2018-05-30' ORDER BY `user`.`addData` ASC |
| merge_1 | MERGE | user_dn4_0; user_dn5_0 |
| shuffle_field_1 | SHUFFLE_FIELD | merge_1 |
+-----------------+---------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
4 rows in set (0.00 sec)
(testdb) > select * from user where addData between '2018-04-01' and '2018-05-30' order by addData asc ;
+------------+---------+----------+----------+------+
| addData | dbname | username | province | age |
+------------+---------+----------+----------+------+
| 2018-04-01 | userdb4 | user1 | NULL | 12 |
| 2018-04-11 | userdb4 | user1 | NULL | 12 |
| 2018-04-21 | userdb4 | user1 | NULL | 12 |
| 2018-04-25 | userdb4 | user1 | NULL | 12 |
| 2018-04-30 | userdb4 | user1 | NULL | 12 |
| 2018-05-01 | userdb5 | user1 | NULL | 12 |
| 2018-05-03 | userdb5 | user1 | NULL | 12 |
| 2018-05-05 | userdb5 | user1 | NULL | 12 |
+------------+---------+----------+----------+------+
8 rows in set (0.01 sec)
date类型的可用分区的监控(脚本的原理同样适用于其他类型的分区):
简单的做法就是定期执行一个explain的insert插入测试, 如果有ERROR关键字就告警出来一个简单的脚本如下:
# 提前60天预警
DAYS=$(date -d 60days +%F)
echo $DAYS
if mysql -urw -prw123456 --port 8066 -h 192.168.20.10 testdb 2>/dev/null -e "explain insert into user (addData,dbname,username,age) values (\"$DAYS\",database(),'user1',12);" ; then
echo "当前可用分片数量处于安全状态"
else
echo "需要加新的分片了"
fi
date类型加新的分片的方法:1、修改schema.xml 加上新的分片的配置信息,修改后大致这样:
dble:schema SYSTEM "schema.dtd">
select user()
2、重载配置文件
reload @@config_all ;
3、去后端创建对应的物理库
create database userdb14;
.....这里省略其它的建库语句.......
create database userdb23;
4、通过dble再次下发下建表命令
create table if not exists user (addData date, dbname varchar(32),username varchar(32),province varchar(16),age int(3));
5、插入数据测试
(testdb) > explain insert into user (addData,dbname,username,age) values ('2019-11-01',database(),'user1',12);
+-----------+----------+--------------------------------------------------------------------------------------------------+
| DATA_NODE | TYPE | SQL/REF |
+-----------+----------+--------------------------------------------------------------------------------------------------+
| user_dn23 | BASE SQL | INSERT INTO user (addData, dbname, username, age) VALUES ('2019-11-01', DATABASE(), 'user1', 12) |
+-----------+----------+--------------------------------------------------------------------------------------------------+
1 row in set (0.00 sec)
(testdb) > explain insert into user (addData,dbname,username,age) values ('2019-12-01',database(),'user1',12);
ERROR 1064 (HY000): can't find any valid data node :user -> ADDDATA -> 2019-12-01
######################################################################################################
ER 表 (互联网场景下用多表JOIN的不多,因此ER分片规则不太常用到,但是需要大致的了解):
下面的内容大篇幅参考: https://blog.csdn.net/zhanglei_16/article/details/50779929
1:ER分片关系简介
有一类业务,例如订单(ORDER)跟订单明细表(ORDER_DETAIL),明细表会依赖订单单,就是该会存在表的主从关系,
这类似业务的切分可以抽象出合适的切分规则,比如根据用户ID切分,其它相关的表都依赖于用户ID,再或者根据订单ID进行切分,
总之部分业务总会可以抽象出父子关系的表。这类表适用于ER分片表,子表的记录与所关联的父表记录存放在同一个数据分片上,
避免数据Join跨库操作,以order与order_detail例子为例,schema.xml中定义合适的分片配置,order,order_detail 根据order_id
迕行数据切分,保证相同order_id的数据分到同一个分片上,在进行数据插入操作时,Mycat会获取order所在的分片,
然后将order_detail也插入到order所在的分片
2:父表按照主键ID分片,字表的分片字段与主表ID关联,配置为ER分片
2.1:在schema.xml添加如下配置配置文件修改
在rule.xml里面设定分片规则:
id
hashmod3
3
1
然后, reload 下 dble
2.2 先建表, order 和 order_detail 表,有主外键关系
mysql> explain CREATE TABLE order1 (id INT NOT NULL AUTO_INCREMENT PRIMARY KEY,sn VARCHAR(64),create_time DATETIME) ENGINE=InnoDB DEFAULT CHARSET=utf8;
+-----------+-----------------------------------------------------------------------------------------------------+
| DATA_NODE | SQL |
+-----------+-----------------------------------------------------------------------------------------------------+
| dn1 | CREATE TABLE order1(id int unsigned NOT NULL AUTO_INCREMENT PRIMARY KEY,sn VARCHAR(64),create_time DATETIME) |
| dn2 | CREATE TABLE order1(id int unsigned NOT NULL AUTO_INCREMENT PRIMARY KEY,sn VARCHAR(64),create_time DATETIME) |
| dn3 | CREATE TABLE order1(id int unsigned NOT NULL AUTO_INCREMENT PRIMARY KEY,sn VARCHAR(64),create_time DATETIME) |
+-----------+-----------------------------------------------------------------------------------------------------+
3 rows in set (0.02 sec)
mysql> CREATE TABLE order1(id INT NOT NULL AUTO_INCREMENT PRIMARY KEY,sn VARCHAR(64),create_time DATETIME) ENGINE=InnoDB DEFAULT CHARSET=utf8;
Query OK, 0 rows affected (0.35 sec)
mysql> CREATE TABLE order_detail(id INT AUTO_INCREMENT PRIMARY KEY, order_id INT,ord_status CHAR(1),address VARCHAR(128),create_time DATETIME,CONSTRAINT FK_ORDid FOREIGN KEY (order_id) REFERENCES order1 (id)) ENGINE=InnoDB DEFAULT CHARSET=utf8;
Query OK, 0 rows affected (0.44 sec)
3.3 录入数据:
mysql> explain INSERT INTO order1(id,sn,create_time) VALUES(1,'BJ0001',NOW());
+-----------+----------------------------------------------------------------+
| DATA_NODE | SQL |
+-----------+----------------------------------------------------------------+
| dn2 | INSERT INTO order1(id,sn,create_time) VALUES(1,'BJ0001',NOW()) |
+-----------+----------------------------------------------------------------+
1 row in set (0.03 sec)
录入数据,一组组录入,涉及到外键关系:
第一组北京的订单
mysql> INSERT INTO order1(id,sn,create_time) VALUES(1,'BJ0001',NOW());
Query OK, 1 row affected (0.05 sec)
mysql> INSERT INTO ORDER_DETAIL(id,order_id,ord_status,address,create_time) VALUES (1,1,'1','test data of order1(id=1,BJ001) ',NOW());
第二组上海的订单:
mysql> explain INSERT INTO order1(id,sn,create_time) VALUES(3,'SHH001',NOW());
+-----------+----------------------------------------------------------------+
| DATA_NODE | SQL |
+-----------+----------------------------------------------------------------+
| dn1 | INSERT INTO order1(id,sn,create_time) VALUES(3,'SHH001',NOW()) |
+-----------+----------------------------------------------------------------+
1 row in set (0.02 sec)
mysql> INSERT INTO order1(id,sn,create_time) VALUES(3,'SHH001',NOW());
Query OK, 1 row affected (0.04 sec)
mysql> INSERT INTO ORDER_DETAIL(id,order_id,ord_status,address,create_time) VALUES (3,3,'1','test data of order1(id=3,SHH001)',NOW());
Query OK, 1 row affected (0.06 sec)
第三组广州的订单:
mysql> explain INSERT INTO order1(id,sn,create_time) VALUES(4,'GZH004',NOW());
+-----------+----------------------------------------------------------------+
| DATA_NODE | SQL |
+-----------+----------------------------------------------------------------+
| dn2 | INSERT INTO order1(id,sn,create_time) VALUES(4,'GZH004',NOW()) |
+-----------+----------------------------------------------------------------+
1 row in set (0.00 sec)
mysql> INSERT INTO order1(id,sn,create_time) VALUES(4,'GZH004',NOW());
Query OK, 1 row affected (0.06 sec)
mysql> INSERT INTO ORDER_DETAIL(id,order_id,ord_status,address,create_time) VALUES (4,4,'1','test data of order1(id=4,GZH004) ',NOW());
Query OK, 1 row affected (0.05 sec)
第四组 武汉的订单,这里故意将order_id设置成4,看看效果,是否随id为4的广州的那组分片:
mysql> explain INSERT INTO order1(id,sn,create_time) VALUES(5,'WUHAN005',NOW());
+-----------+------------------------------------------------------------------+
| DATA_NODE | SQL |
+-----------+------------------------------------------------------------------+
| dn3 | INSERT INTO order1(id,sn,create_time) VALUES(5,'WUHAN005',NOW()) |
+-----------+------------------------------------------------------------------+
1 row in set (0.01 sec)
mysql> explain INSERT INTO order1(id,sn,create_time) VALUES(6,'WUHAN006',NOW());
Query OK, 1 row affected (0.03 sec)
mysql> INSERT INTO ORDER_DETAIL(id,order_id,ord_status,address,create_time) VALUES (6,4,'1','test data of order1(id=6,WUHAN006) ',NOW());
Query OK, 1 row affected (0.05 sec)
通过DBLE,查看下数据写入的情况:
(testdb) > select * from order1;
+----+--------+---------------------+
| id | sn | create_time |
+----+--------+---------------------+
| 1 | BJ0001 | 2019-08-31 23:05:36 |
| 4 | GZH004 | 2019-08-31 23:06:57 |
| 3 | SHH001 | 2019-08-31 23:06:43 |
+----+--------+---------------------+
3 rows in set (0.01 sec)
(testdb) > select * from order_detail ;
+----+----------+------------+--------------------------------------+---------------------+
| id | order_id | ord_status | address | create_time |
+----+----------+------------+--------------------------------------+---------------------+
| 1 | 1 | 1 | test data of ORDER1(ID=1,BJ001) | 2019-08-31 23:06:17 |
| 4 | 4 | 1 | test data of ORDER1(ID=4,GZH004) | 2019-08-31 23:07:01 |
| 6 | 4 | 1 | test data of ORDER1(ID=6,WUHAN006) | 2019-08-31 23:07:23 |
| 3 | 3 | 1 | test data of ORDER1(ID=3,SHH001) | 2019-08-31 23:06:47 |
+----+----------+------------+--------------------------------------+---------------------+
4 rows in set (0.01 sec)
直连后端的db1,看下数据情况 (db2 和 db3 上面的数据查看,使用同样的方法);
((none)) > select * from db1.order1;
+----+--------+---------------------+
| id | sn | create_time |
+----+--------+---------------------+
| 3 | SHH001 | 2019-08-31 23:06:43 |
+----+--------+---------------------+
1 row in set (0.00 sec)
((none)) > select * from db1.order_detail;
+----+----------+------------+----------------------------------+---------------------+
| id | order_id | ord_status | address | create_time |
+----+----------+------------+----------------------------------+---------------------+
| 3 | 3 | 1 | test data of ORDER1(ID=3,SHH001) | 2019-08-31 23:06:47 |
+----+----------+------------+----------------------------------+---------------------+
1 row in set (0.00 sec)
2.6 走DBLE,模拟下业务的查询:
(testdb) > explain select t1.*,t2.* from order1 t1,order_detail t2 where t2.ord_status='1' and t2.id=1 and t1.id=t2.order_id;
+-----------------+---------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| DATA_NODE | TYPE | SQL/REF |
+-----------------+---------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| dn1_0 | BASE SQL | select `t2`.`id`,`t2`.`order_id`,`t2`.`ord_status`,`t2`.`address`,`t2`.`create_time`,`t1`.`id`,`t1`.`sn`,`t1`.`create_time` from `order1` `t1` join `order_detail` `t2` on `t1`.`id` = `t2`.`order_id` where (`t2`.`ord_status` = '1') AND (`t2`.`id` = 1) |
| dn2_0 | BASE SQL | select `t2`.`id`,`t2`.`order_id`,`t2`.`ord_status`,`t2`.`address`,`t2`.`create_time`,`t1`.`id`,`t1`.`sn`,`t1`.`create_time` from `order1` `t1` join `order_detail` `t2` on `t1`.`id` = `t2`.`order_id` where (`t2`.`ord_status` = '1') AND (`t2`.`id` = 1) |
| dn3_0 | BASE SQL | select `t2`.`id`,`t2`.`order_id`,`t2`.`ord_status`,`t2`.`address`,`t2`.`create_time`,`t1`.`id`,`t1`.`sn`,`t1`.`create_time` from `order1` `t1` join `order_detail` `t2` on `t1`.`id` = `t2`.`order_id` where (`t2`.`ord_status` = '1') AND (`t2`.`id` = 1) |
| merge_1 | MERGE | dn1_0; dn2_0; dn3_0 |
| shuffle_field_1 | SHUFFLE_FIELD | merge_1 |
+-----------------+---------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
5 rows in set (0.00 sec)
(testdb) > SELECT
t1.*,
t2.*
FROM
order1 t1,
order_detail t2
WHERE t2.ord_status = '1'
AND t2.id = 1
AND t1.id = t2.order_id ;
+----+--------+---------------------+----+----------+------------+-----------------------------------+---------------------+
| id | sn | create_time | id | order_id | ord_status | address | create_time |
+----+--------+---------------------+----+----------+------------+-----------------------------------+---------------------+
| 1 | BJ0001 | 2019-08-31 23:05:36 | 1 | 1 | 1 | test data of ORDER1(ID=1,BJ001) | 2019-08-31 23:06:17 |
+----+--------+---------------------+----+----------+------------+-----------------------------------+---------------------+
1 row in set (0.00 sec)
2.7 总结:当子表与父表的关联字段正好是父表的分片字段时,子表直接根据父表规则进行分片,在数据录入的时候子表直接放在父表的分片上面,在进行关联查询join的时候,走的是父表的路由。
【重要】其它的总结:
当子表与父表的关联字段不是父表的分片字段时,必须通过查找对应的父表记录来确认子表所在分片,如果找不到则会抛出错误,在join查询的时候,路由走的是所有分片节点!!!!
mysql 分库分表实战_DBLE分库分表实战相关推荐
- mysql pdo 插入没效果_MySQL分库分表后用PHP如何来完美操作
当单表达到几千万时,查询一次要很久,如果有联合查询,有可能会死在那 分库分表主要就是解决这个问题,减小数据库的负担,缩短查询时间分库 1)按功能分 用户类库.商品类库.订单类库.日志类.统计类库... ...
- mysql 分库分表 建表_【分库分表】sharding-jdbc实践—分库分表入门
一.准备工作 1.准备三个数据库:db0.db1.db2 2.每个数据库新建两个订单表:t_order_0.t_order_1 DROP TABLE IF EXISTS`t_order_x`;CREA ...
- asp.net mysql 读写分离_.NET Core实现分表分库、读写分离的通用 Repository功能
首先声明这篇文章不是标题党,我说的这个类库是 FreeSql.Repository,它作为扩展库现实了通用仓储层功能,接口规范参考 abp vnext 定义,实现了基础的仓储层(CURD). 安装 d ...
- mysql为什么要分库_我们为什么要分库分表
当一张表的数据达到几千万时,查询一次所花的时间会变长.这时候,如果有联合查询的话,可能会卡死在那儿,甚至把系统给拖垮. 而分库分表的目的就在于此:减小数据库的负担,提高数据库的效率,缩短查询时间.另外 ...
- mysql 配置文件在哪_MySQL+MyCat分库分表 读写分离配置
一. MySQL+MyCat分库分表 1 MyCat简介 java编写的数据库中间件 Mycat运行环境需要JDK. Mycat是中间件,运行在代码应用和MySQL数据库之间的应用. 前身: corb ...
- mysql 分表后排序_MySQL优化分库分表,为什么要分表,分表以后如何进行排序查询,业务如何设计?...
昨天面试新人的时候,遇到了这么一个问题,按照自己的想法大体聊了一些,但大多是感性的,并没有完整的了解why and how. 今天查了一些相关的资料,包括<MySQL性能调优与架构设计>. ...
- mysql 分表_MySQL如何分库分表
数据库分库分表估计很多伙伴都没有实践过,就是因为自己公司的业务不是很多,没有那么多数据.假如有一天项目的人数上来了,你写的系统支撑不住了,希望这篇文章带给你一丝丝的思路." 前言 在面试过程 ...
- mysql 分表分库mycat_Mysql数据库之如何Mycat分表分库?
Mycat分表分库虽然能解决大表对数据库系统的压力,但也有一些不利,因此Mycat分表分库要先解决的问题是,分不分库,分哪些库,什么规则分,分多少分片.那么究竟是怎么分的呢? 1.能不分就不分,100 ...
- mysql 表字段信息从一张表迁移到另一张表_Mysql之分库分表
互联网系统需要处理大量用户的请求.比如微信日活用户破10亿,海量的用户每天产生海量的数量:美团外卖,每天都是几千万的订单,那这些系统的用户表.订单表.交易流水表等是如何处理呢? 数据量只增不减,历史数 ...
- mysql分库分表 ppt_数据库分库分表中间件架构解析.ppt
数据库分库分表中间件架构解析 Processor(1) Processor(n) MySQL MySQL MySQL Cobar结构 Front-end Communication Applicati ...
最新文章
- 常用巡检语句(oracle)
- IronRuby and ASP.NET MVC
- php使用redis生成自增序列号码,Redis使用Eval多个键值自增的操作实例
- 靠谱推荐 | 我读完了所有数据产品经理的书?!
- 华为固件解包工具linux,华为解包工具官方下载
- sequence跳号问题及解决办法
- html css 深入理解float
- excel能创建html吗,如何通过Excel电子表格使用循环创建单独的HTML发布页面
- [转载] 七龙珠第一部——第068话 最后的龙珠
- Atitit.cto 与技术总监的区别
- WEBPACK+ES6+REACT入门(1/7)-创建webpack4.x项目
- 网络安全-wifi攻防
- 深耕MySQL - 50道SQL练习题
- 13.实现鼠标中断处理
- R语言回归及混合效应模型及贝叶斯实现
- 1688item_search新品数据获取API接口调用示例
- openstack policy机制
- SQL Injection的猥琐技巧
- 公网平台保障铁路通信方案设计
- 【文本编辑】PPT文档被设置密码允许只读模式【解除限制】
热门文章
- 欧盟 | 地平线 2020 ENSEMBLE:D2.13 SOTIF Safety Concept(上)
- 群晖系统ftp服务器,群晖对接云服务器ftp
- canvas画布——太极图
- 查询结果按中文拼音顺序排序
- bos 文件上传-调研
- 大数据职业理解_大数据的职业发展规划
- 10年涨7倍!纵观南京房价变迁史,看哭多少买房人!
- linux local root exploit,Linux非交互环境下本地提权思路与反思 linux localroot exploit
- 微信号注册人工服务器,两个方法让你一次性找到微信人工客服,简单而又粗暴!...
- canvas实现5张图片合成一张图片