1.停止crs

[root@node1 ~]# /u01/app/grid/11.2.0/bin/crsctl stop crs -f

[root@node2 ~]# /u01/app/grid/11.2.0/bin/crsctl stop crs -f

停不掉的情况下可以禁用开机启动,然后重启机器

/u01/app/grid/11.2.0.4/bin/crsctl disable has

2.删除crs

节点1

[root@node1 admin]# /u01/app/grid/11.2.0/crs/install/rootcrs.pl -deconfig -force

最后一个节点

[root@node2 ]# /u01/app/grid/11.2.0/crs/install/rootcrs.pl -deconfig -force -lastnode

3.执行root.sh

先在节点1上执行

[root@node1 admin]# /u01/app/grid/11.2.0/root.sh

等待节点1执行完成后继续在节点2上执行

[root@node2 admin]# /u01/app/grid/11.2.0/root.sh

4.配置ons

[grid@node1 install]$ /u01/app/grid/11.2.0/crs/install/onsconfig add_config node1:6251 node2:6251

The ONS configuration is created successfully

Stopping ONS resource 'ora.node1.ons'

Attempting to stop `ora.ons` on member `node1`

Stop of `ora.ons` on member `node1` succeeded.

The resource ora.node1.ons stopped successfully for restart

Attempting to start `ora.ons` on member `node1`

Start of `ora.ons` on member `node1` succeeded.

The resource ora.node1.ons restarted successfully

Stopping ONS resource 'ora.node2.ons'

Attempting to stop `ora.ons` on member `node2`

Stop of `ora.ons` on member `node2` succeeded.

The resource ora.node2.ons stopped successfully for restart

Attempting to start `ora.ons` on member `node2`

Start of `ora.ons` on member `node2` succeeded.

The resource ora.node2.ons restarted successfully

5.配置网络接口

[grid@node1 install]$ oifcfg iflist

eth0  192.168.56.0

eth1  172.16.10.0

[grid@node1 install]$ oifcfg setif -global eth0/192.168.56.0:public

[grid@node1 install]$ oifcfg setif -global eth1/172.16.10.0:cluster_interconnect

6.使用netca配置监听器

分别在节点1和节点2上将之前的监听文件转移到临时目录

[grid@node1 11.2.0]$ mv /u01/app/grid/11.2.0/network/admin/listener.ora /tmp/listener.ora.original_node1

[grid@node2 11.2.0]$ mv /u01/app/grid/11.2.0/network/admin/listener.ora /tmp/listener.ora.original_node1

在其中一个节点上使用netca添加监听器,添加完成后可以看到监听器资源已经加入到ocr.

添加完后,可以发现监听器资源已经启动

[grid@node1 11.2.0]$ crs_stat -t

Name           Type           Target    State     Host

------------------------------------------------------------

ora.CRS.dg     ora....up.type ONLINE    ONLINE    node1

ora....ER.lsnr ora....er.type ONLINE    ONLINE    node1

ora....N1.lsnr ora....er.type ONLINE    ONLINE    node1

ora.asm        ora.asm.type   ONLINE    ONLINE    node1

ora.eons       ora.eons.type  ONLINE    ONLINE    node1

ora.gsd        ora.gsd.type   OFFLINE   OFFLINE

ora....network ora....rk.type ONLINE    ONLINE    node1

ora....SM1.asm application    ONLINE    ONLINE    node1

ora....E1.lsnr application    ONLINE    ONLINE    node1

ora.node1.gsd  application    OFFLINE   OFFLINE

ora.node1.ons  application    ONLINE    ONLINE    node1

ora.node1.vip  ora....t1.type ONLINE    ONLINE    node1

ora....SM2.asm application    ONLINE    ONLINE    node2

ora....E2.lsnr application    ONLINE    ONLINE    node2

ora.node2.gsd  application    OFFLINE   OFFLINE

ora.node2.ons  application    ONLINE    ONLINE    node2

ora.node2.vip  ora....t1.type ONLINE    ONLINE    node2

ora.oc4j       ora.oc4j.type  OFFLINE   OFFLINE

ora.ons        ora.ons.type   ONLINE    ONLINE    node1

ora.scan1.vip  ora....ip.type ONLINE    ONLINE    node1

7.将资源添加到ocr(grid用户下执行).

添加asm实例(注意大小写),操作只在一个节点上进行.

[grid@node1 11.2.0]$srvctl add asm -i +ASM1 -n node1 -o /u01/product/oracle/11.2.0/db_1

[grid@node1 11.2.0]$srvctl add asm -i +ASM2 -n node2 -o /u01/product/oracle/11.2.0/db_1

添加数据库(oracle用户下执行)

[oracle@node1 ~]$ srvctl add database -d racdb -o /u01/product/oracle/11.2.0/db_1

[oracle@node1 ~]$

添加实例(oracle用户下执行)

[oracle@node1 ~]$ srvctl add instance -d racdb -i racdb1 -n node1

[oracle@node1 ~]$ srvctl add instance -d racdb -i racdb2 -n node2

添加之前数据库的服务(oracle用户下执行)

[oracle@node1 ~]$ srvctl add service -d racdb -s kettle -r racdb1 -a racdb2 -P BASIC

8.启动数据库(grid用户)

[grid@node1 11.2.0]$ srvctl start asm -n node1

[grid@node1 11.2.0]$ srvctl start asm -n node2

[grid@node1 11.2.0]$ srvctl start database -d racdb

[grid@node1 11.2.0]$ srvctl start service -d racdb

启动数据库的时候报错误

[grid@node1 11.2.0]$ srvctl start database -d racdb

PRCR-1079 : Failed to start resource ora.racdb.db

ORA-01034: ORACLE not available

ORA-27101: shared memory realm does not exist

Linux-x86_64 Error: 2: No such file or directory

Process ID: 0

Session ID: 0 Serial number: 0

ORA-01034: ORACLE not available

ORA-27101: shared memory realm does not exist

Linux-x86_64 Error: 2: No such file or directory

Process ID: 0

Session ID: 0 Serial number: 0

ORA-01078: failure in processing system parameters

ORA-01078: failure in processing system parameters

CRS-2674: Start of 'ora.racdb.db' on 'node2' failed

CRS-2674: Start of 'ora.racdb.db' on 'node1' failed

ORA-01034: ORACLE not available

ORA-27101: shared memory realm does not exist

Linux-x86_64 Error: 2: No such file or directory

Process ID: 0

Session ID: 0 Serial number: 0

ORA-01034: ORACLE not available

ORA-27101: shared memory realm does not exist

Linux-x86_64 Error: 2: No such file or directory

Process ID: 0

Session ID: 0 Serial number: 0

CRS-2632: There are no more servers to try to place resource 'ora.racdb.db' on that would satisfy its placement policy

在每个节点下进入asm实例查看,asm磁盘情况

SQL> select name,state from v$asm_diskgroup;

NAME                           STATE

------------------------------ -----------

CRS                            MOUNTED

DATA                           DISMOUNTED

REC                            DISMOUNTED

SQL> alter diskgroup DATA mount;

Diskgroup altered.

SQL> alter diskgroup REC mount;

Diskgroup altered.

将状态是DISMOUNTED的手工mount起来后,继续启动数据库.

启动完上面的命令后,查看资源情况

[grid@node1 11.2.0]$ crs_stat -t

Name           Type           Target    State     Host

------------------------------------------------------------

ora.CRS.dg     ora....up.type ONLINE    ONLINE    node1

ora.DATA.dg    ora....up.type ONLINE    ONLINE    node1

ora....ER.lsnr ora....er.type ONLINE    ONLINE    node1

ora....N1.lsnr ora....er.type ONLINE    ONLINE    node1

ora.REC.dg     ora....up.type ONLINE    ONLINE    node1

ora.asm        ora.asm.type   ONLINE    ONLINE    node1

ora.eons       ora.eons.type  ONLINE    ONLINE    node1

ora.gsd        ora.gsd.type   OFFLINE   OFFLINE

ora....network ora....rk.type ONLINE    ONLINE    node1

ora....SM1.asm application    ONLINE    ONLINE    node1

ora....E1.lsnr application    ONLINE    ONLINE    node1

ora.node1.gsd  application    OFFLINE   OFFLINE

ora.node1.ons  application    ONLINE    ONLINE    node1

ora.node1.vip  ora....t1.type ONLINE    ONLINE    node1

ora....SM2.asm application    ONLINE    ONLINE    node2

ora....E2.lsnr application    ONLINE    ONLINE    node2

ora.node2.gsd  application    OFFLINE   OFFLINE

ora.node2.ons  application    ONLINE    ONLINE    node2

ora.node2.vip  ora....t1.type ONLINE    ONLINE    node2

ora.oc4j       ora.oc4j.type  OFFLINE   OFFLINE

ora.ons        ora.ons.type   ONLINE    ONLINE    node1

ora.racdb.db   ora....se.type ONLINE    ONLINE    node1

ora....tle.svc ora....ce.type ONLINE    ONLINE    node2

ora.scan1.vip  ora....ip.type ONLINE    ONLINE    node1

到这里crs已经重建完成,这里自己还有个疑问,我已经清空了CRS磁盘组,在重建过程中为什么不需要重新创建该磁盘组.

-- The End --