Oracle GoldenGate 异构平台同步（Mysql到Oracle）

如图所示：源端采用Mysql库，目标端采用Oracle库

一、OGG安装配置（源端）

1、OGG下载

https://edelivery.oracle.com/EPD/Download/get_form?egroup_aru_number=14841438

https://edelivery.oracle.com/EPD/Download/get_form?egroup_aru_number=14841440

[oracle@ogg ogg_ms]$ uname -a

Linux ogg 2.6.32-71.el6.i686 #1 SMP Wed Sep 1 01:26:34 EDT 2010 i686 i686 i386 GNU/Linux

[oracle@ogg ~]$ cd /u01/ogg_ms/
[oracle@ogg ogg_ms]$ ls
ggs_Linux_x86_MySQL_32bit.tar
[oracle@ogg ogg_ms]$ tar xvf ggs_Linux_x86_MySQL_32bit.tar

[oracle@ogg ogg_ms]$ ./ggsci
Oracle GoldenGate Command Interpreter for MySQL
Version 11.2.1.0.1 OGGCORE_11.2.1.0.1_PLATFORMS_120423.0230
Linux, x86, 32bit (optimized), MySQL Enterprise on Apr 23 2012 04:29:30
Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved.
GGSCI (ogg) 1> create subdirs
Creating subdirectories under current directory /u01/ogg_ms
Parameter files                /u01/ogg_ms/dirprm: already exists
Report files                   /u01/ogg_ms/dirrpt: created
Checkpoint files               /u01/ogg_ms/dirchk: created
Process status files           /u01/ogg_ms/dirpcs: created
SQL script files               /u01/ogg_ms/dirsql: created
Database definitions files     /u01/ogg_ms/dirdef: created
Extract data files             /u01/ogg_ms/dirdat: created
Temporary files                /u01/ogg_ms/dirtmp: created
Stdout files                   /u01/ogg_ms/dirout: created

二、数据库配置

源端：mysql库配置

数据库配置文件：
[root@ogg ~]# cat /etc/my.cnf
# Replication Master Server (default)
# binary logging is required for replication
log-bin=mysql-bin# binary logging format - mixed recommended
#binlog_format=mixedbinlog_format=row启动数据库服务
[root@ogg ~]# service mysql start
Starting MySQL  连接数据库                                           [  OK  ]
[root@ogg ~]# mysql -h localhost -u mysql -p
Enter password:
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 1
Server version: 5.6.4-m7-log Source distribution
Copyright (c) 2000, 2010, Oracle and/or its affiliates. All rights reserved.
This software comes with ABSOLUTELY NO WARRANTY. This is free software,
and you are welcome to modify and redistribute it under the GPL v2 license
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> show databases;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| mysql              |
| performance_schema |
| test               |
+--------------------+
4 rows in set (0.00 sec)
mysql> use test;
Database changed
mysql> show tables;
Empty set (0.00 sec)创建测试表（存储引擎采用innodb）
mysql> create table test2 (id int,name char(10)) engine=innodb;
Query OK, 0 rows affected (0.02 sec)
mysql> show tables;
+----------------+
| Tables_in_test |
+----------------+
| test2          |
+----------------+
1 row in set (0.00 sec)
mysql> select * from test2;
Empty set (0.00 sec)

目标端：Oracle 库配置：

三、OGG同步配置

源端：Mysql库配置

[oracle@ogg ogg_ms]$ ./ggsci

Oracle GoldenGate Command Interpreter for MySQL
Version 11.2.1.0.1 OGGCORE_11.2.1.0.1_PLATFORMS_120423.0230
Linux, x86, 32bit (optimized), MySQL Enterprise on Apr 23 2012 04:29:30
Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved.
用户登录（root）：
GGSCI (ogg) 2> dblogin sourcedb test@localhost:3306,userid root,password oracle
Successfully logged into database.配置mgr：
GGSCI (ogg) 3> edit param mgr
port 7809
dynamicportlist 7800-8000
autorestart extract *,waitminutes 2,resetminutes 5GGSCI (ogg) 4> start mgr
Manager started.
GGSCI (ogg) 5> info mgr
Manager is running (IP port ogg.7809).GGSCI (ogg) 6> info all
Program     Status      Group       Lag at Chkpt  Time Since Chkpt
MANAGER     RUNNING配置extract进程组：
GGSCI (ogg) 7> edit param ext_1
extract ext_1
setenv (MYSQL_HOME=”/var/lib/mysql”)
tranlogoptions altlogdest /var/lib/mysql/mysql-bin.index
sourcedb test@localhost:3306,userid root,password oracle
exttrail ./dirdat/e2
dynamicresolution
gettruncates
table test.test2;GGSCI (ogg) 11> add extract ext_1,tranlog,begin now
EXTRACT added.
GGSCI (ogg) 12> add exttrail ./dirdat/e2,extract ext_1
EXTTRAIL added.配置pump进程组：
GGSCI (ogg) 13> edit params pump_1
extract pump_1
rmthost 192.168.8.249,mgrport 7809
rmttrail /u01/ogg/dirdat/e2
passthru
gettruncates
table test.test2;GGSCI (ogg) 14> add extract pump_1,exttrailsource ./dirdat/e2
EXTRACT added.GGSCI (ogg) 15> add rmttrail  /u01/ogg/dirdat/e2,extract pump_1
RMTTRAIL added.异构平台配置defgen：GGSCI (ogg) 16> edit params defgen
defsfile /u01/ogg_ms/dirdef/defgen.prm
sourcedb test@localhost:3306, userid root,password oracle
table test.test2;[oracle@ogg ogg_ms]$ ./defgen paramfile dirprm/defgen.prm
***********************************************************************Oracle GoldenGate Table Definition Generator for MySQLVersion 11.2.1.0.1 OGGCORE_11.2.1.0.1_PLATFORMS_120423.0230Linux, x86, 32bit (optimized), MySQL Enterprise on Apr 23 2012 04:59:19
Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved.Starting at 2014-09-26 16:01:05
***********************************************************************
Operating System Version:
Linux
Version #1 SMP Wed Sep 1 01:26:34 EDT 2010, Release 2.6.32-71.el6.i686
Node: ogg
Machine: i686soft limit   hard limit
Address Space Size   :    unlimited    unlimited
Heap Size            :    unlimited    unlimited
File Size            :    unlimited    unlimited
CPU Time             :    unlimited    unlimited
Process id: 2606
***********************************************************************
**            Running with the following parameters                  **
***********************************************************************
defsfile /u01/ogg_ms/dirdef/defgen.prm
sourcedb test@localhost:3306, userid root,password ******
table test.test2;
Retrieving definition for test.test2
Definitions generated for 1 table in /u01/ogg_ms/dirdef/defgen.prm传送defgen文件到目标端：
[oracle@ogg ogg_ms]$ scp dirdef/defgen.prm rh6:/u01/ogg/dirdef
GGSCI (ogg) 5> info all
Program     Status      Group       Lag at Chkpt  Time Since Chkpt
MANAGER     RUNNING
EXTRACT     ABENDED     EXT_1       00:00:00      00:21:03
EXTRACT     RUNNING     PUMP_1      00:00:00      00:00:06启动extract和pump进程：
GGSCI (ogg) 6> start extract ext_1
Sending START request to MANAGER ...
EXTRACT EXT_1 starting
GGSCI (ogg) 7> info all
Program     Status      Group       Lag at Chkpt  Time Since Chkpt
MANAGER     RUNNING
EXTRACT     ABENDED     EXT_1       00:00:00      00:21:17
EXTRACT     RUNNING     PUMP_1      00:00:00      00:00:09

extract进程启动异常（abended）！

查看日志：

GGSCI (ogg) 36> view ggsevt

2014-09-26 17:24:56  INFO    OGG-01053  Oracle GoldenGate Capture for MySQL, ext_1.prm:  Recovery completed for target file ./dirdat/e20

00026, at RBA 961.

2014-09-26 17:24:56  INFO    OGG-01057  Oracle GoldenGate Capture for MySQL, ext_1.prm:  Recovery completed for all targets.

2014-09-26 17:24:56  INFO    OGG-00182  Oracle GoldenGate Capture for MySQL, ext_1.prm:  VAM API running in single-threaded mode.

2014-09-26 17:24:56  INFO    OGG-01515  Oracle GoldenGate Capture for MySQL, ext_1.prm:  Positioning to begin time Sep 26, 2014 3:52:01

PM.

2014-09-26 17:24:56  ERROR   OGG-00146  Oracle GoldenGate Capture for MySQL, ext_1.prm:  VAM function VAMInitialize returned unexpected

result: error 600 - VAM Client Report <CAUSE OF FAILURE : ERROR NO 13 - Failed to access index file : Check File PATH/EXISTENCE/PERMISSI

ONS - /var/lib/mysql/mysql-bin.index

WHEN FAILED : While initializing binary log configuration

WHERE FAILED : MySQLBinLog Reader Module

CONTEXT OF FAILURE : No Information Available!>.

2014-09-26 17:24:56  ERROR   OGG-01668  Oracle GoldenGate Capture for MySQL, ext_1.prm:  PROCESS ABENDING.

附录：解决方法（参考网络文档）

GoldenGate的官方文档明确表示，GoldenGate需要将MySQL的日志格式（binlog_format）设置为ROW，其他两种格式（MIXED or STATEMENT）是不支持。

########################################################################官方描述如下：

binlog_format: This parameter sets the format of the logs. It must be set to the value of ROW, which directs the database to log DML statements in binary format. Any other log format (MIXED or STATEMENT) causes Extract to abend.

########################################################################

但是MySQL在版本5.1.5之前是不支持ROW和MIXED格式（MySQL 5.1.5引入ROW，5.1.8引入MIXED）

####  官方描述如下：http://dev.mysql.com/doc/refman/5.1/en/binary-log-formats.html

Support for row-based logging was added in MySQL 5.1.5. Mixed logging is available beginning with MySQL 5.1.8. In MySQL 5.1.12,MIXED become the default logging mode; in 5.1.29, the default was changed back to STATEMENT for compatibility with MySQL 5.0.

########################################################################

目前客户的MySQL版本是5.0.6-beta版：

D:\MySQL Server 5.0\bin>mysql -u root -p

Enter password: *****

Welcome to the MySQL monitor.  Commands end with ; or \g.

Your MySQL connection id is 111 to server version: 5.0.6-beta-nt-log

Type ‘help;‘ or ‘\h‘ for help. Type ‘\c‘ to clear the buffer.

mysql> select version();

+-------------------+

| version()         |

+-------------------+

| 5.0.6-beta-nt-log|

+-------------------+

1 row in set (0.02 sec)

这个版本是不支持binlog_format=ROW，所以安装好GolenGate后，启动抽取进程时，进程abend

########################################################################下面是出错信息：

2014-09-16 16:55:16  ERROR   OGG-00146  VAM function VAMRead returned unexpected result: error 600 - VAM Client Report <CAUSE OF FAILURE : STATEMENT or MIXED level logging found so abending

WHEN FAILED : While reading log event from binary log

WHERE FAILED : MySQLBinLog Reader Module

CONTEXT OF FAILURE : No Information Available!>

因此如果想要采用GoldenGate来实现MySQL的数据实时同步，需要将MySQL版本升级到5.1.5以上.

四、目标端ogg配置

配置MGR
GGSCI (rh6.cuug.net) 4> edit params mgr
port 7809
dynamicportlist 7800-8000
autorestart extract *,waitminutes 2,resetminutes 5
~
GGSCI (rh6.cuug.net) 5> start mgr
Manager started.
GGSCI (rh6.cuug.net) 6> info mgr
Manager is running (IP port rh6.cuug.net.7809).配置replicat进程组：
[oracle@rh6 ogg]$ ./ggsci
Oracle GoldenGate Command Interpreter for Oracle
Version 11.2.1.0.1 OGGCORE_11.2.1.0.1_PLATFORMS_120423.0230_FBO
Linux, x86, 32bit (optimized), Oracle 11g on Apr 23 2012 08:09:25
Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved.
GGSCI (rh6.cuug.net) 1>
GGSCI (rh6.cuug.net) 1> edit param rep_1
replicat rep_1
sourcedefs /u01/ogg/dirdef/defgen.prm
userid ogg,password ogg
reperror default,discard
discardfile /u01/ogg/dirrpt/rep_1.dsc,append,megabytes 50
dynamicresolution
map test.test2, target test.test2;GGSCI (rh6.cuug.net) 1>  add replicat rep_1,exttrail /u01/ogg/dirdat/e2
REPLICAT added.启动mgr和replicat进程：
GGSCI (rh6.cuug.net) 3> start mgr
Manager started.
GGSCI (rh6.cuug.net) 4> info all
Program     Status      Group       Lag at Chkpt  Time Since Chkpt
MANAGER     RUNNING
REPLICAT    STOPPED     REP_1       00:00:00      00:00:34
REPLICAT    ABENDED     RORA_1      00:00:00      383:08:47GGSCI (rh6.cuug.net) 5> start replicat rep_1
Sending START request to MANAGER ...
REPLICAT REP_1 starting
GGSCI (rh6.cuug.net) 6> info all
Program     Status      Group       Lag at Chkpt  Time Since Chkpt
MANAGER     RUNNING
REPLICAT    RUNNING     REP_1       00:00:00      00:00:00

 

   由于源端extract进程异常，数据不能同步，问题未解决，欢迎指导，待续...

问题解决：

更换mysql-5.5.12的版本，目前Golden Gate 版本不支持mysql-5.6

GGSCI (ogg) 1> edit param ext_1

配置/etc/my.cnf文件：

并编辑extract进程组配置文件

GGSCI (ogg) 1> edit param ext_1

extract ext_1

setenv (MYSQL_HOME=”/var/lib/mysql”)

tranlogoptions altlogdest /var/lib/mysql/mysql-bin.index

sourcedb test@localhost:3306,userid root,password oracle

exttrail ./dirdat/e2

dynamicresolution

gettruncates

table test.test2;

启动extract 进程

仍然失败，以下为ogg日志：

[root@ogg ogg_ms]# tail ggserr.log

重新删除extract进程组，重新添加

extract进程，启动成功！

查看日志：

-bash-4.1$ tail  ggserr.log

Oracle GoldenGate 之--异构平台同步（Mysql到Oracle）相关推荐

1. pm961 mysql_Oracle GoldenGate学习之--异构平台同步（Mysql到Oracle）

   Oracle GoldenGate学习之--异构平台同步(Mysql到Oracle) 如图所示:源端采用Mysql库,目标端采用Oracle库 一.OGG安装配置(源端) 1.OGG下载 https: ...

2. 异构平台同步（Mysql到Oracle）

   Oracle GoldenGate学习之--异构平台同步(MySQL到Oracle) 如图所示:源端采用Mysql库,目标端采用Oracle库 一.OGG安装配置(源端) 1.OGG下载 https: ...

3. Talend open studio数据导入、导出、同步Mysql、oracle、sqlserver简单案例

   推荐大家一个BI工具:talend open studio.我也是刚接触,懂得不多,感觉比较神奇就想大家推荐一下... 由于公司项目,接触了一下BI工具talend,感觉功能很强大, 可以同步多种数据 ...

4. Oracle Goldengate在HP平台裸设备文件系统OGG-01028处理

   某电信运营商3G系统与4G系统建立号码核对系统,因为两个系统的号码状态不一致.源端使用Oracle Goldengate软件,目标端使用Kafka自写CUE程序进行解析源端传输过去的Trail文件.目 ...

5. oracle裸设备文件复制,Oracle Goldengate在HP平台裸设备文件系统OGG-01028处理

   某电信运营商3G系统与4G系统建立号码核对系统,因为两个系统的号码状态不一致.源端使用Oracle Goldengate软件,目标端使用Kafka自写CUE程序进行解析源端传输过去的Trail文件.目 ...

6. oracle goldengate学习笔记,【学习笔记】Oracle goldengate monitor使用笔记

   天萃荷净 Oracle研究中心学习笔记:分享一篇关于Oracle数据库goldengate monitor的使用笔记. 本站文章除注明转载外,均为本站原创: 转载自love wife & lo ...

7. 异构平台同步（mysql--oracle)

   https://www.cnblogs.com/andy6/p/6159060.html

8. 关于mysql和oracle错误的有_关于MySQL与Oracle的区别

   0 查询分组时的区别 Oracle数据库中使用Group By分组时 select 后面的列必须是分组的列(group by(列))或者是用了聚合函数的lie 但是 MySQL中 不需要如此 随便分组 ...

9. oracle 邻接模型,【原创】MySQL 模拟Oracle邻接模型树形处理

   数据库对层次结构的处理模型有好多种,可以根据自己的需求来设计模型,当然最简单的也是最容易设计的模型就是所谓的邻接模型.在这方面,其他数据库比如Oracle提 数据库对层次结构的处理模型有好多种,可以根 ...

最新文章

1. java nio 断开连接_浅尝Java NIO与Tomcat连接调优
2. get_live2d获取不到500_有人手机收不到验证码？警方打掉一“薅羊毛”产业链，全国已有570多万台手机被控制……...
3. 线性表ArrayList和LinkedList源码详解。
4. 新手入门之j2me学习方法总结--摘录篇
5. Redis配置文件常用配置详解
6. php printf 0.2f,php printf()
7. 工业交换机为什么需要进行高低温检测？
8. JFrog Container Registry 搭建Docker镜像仓库 (tar.gz 版本)
9. Exception: SQLSTATE[22001]
10. 浅谈Dynamic 关键字系列之三（下）:ExpandoObject，DynamicObject，DynamicMetaObject
11. 20200908：链表类题目集合上
12. 最长数组对 Maximum Length of Pair Chain
13. Bailian4144 畜栏保留问题【贪心】
14. 欺骗神经网络_可以欺骗神经网络吗？
15. 如何做一个阿里云物联网安卓原生APP
16. STM32 SPI 主模式下配置(神州三号开发板spi.c解析上)
17. Macmini 2012Late硬盘异响和Mac下设置apm
18. win10总是更新失败
19. shardingsphere源码分析（四）-- 改写引擎
20. 足以代替Apache的Nginx

热门文章

1. mysql Access denied for user root@localhost错误处理备忘
2. GCC编译选项 -OX[转]
3. 第二周作业-影评、靶机和攻击机的安装与配置、kali的配置、DNS解析
4. android小知识之意图（intent）
5. 服务端命令(dockerd)
6. ubuntu如何修改php文件夹权限,Linux命令chmod：修改文件或文件夹权限
7. vue 接口数据排序_Vue 使用 axios 请求 mock 模拟接口的数据
8. Vim 的高级用法配置
9. C++实现虚拟内存页面置换算法（FIFO， OPT， LRU）
10. P1060 开心的金明（01背包）