最近,一同事为一2节点的ORACLE RAC 11.2.0.4集群ASM加盘,没有注意到ASM的sga设置过小,加盘reblance时导致集群重启。详细描述如下:

​1、问题描述

​ORACLE RAC 11.2.0.4集群ASM加盘,没有注意到ASM的sga设置过小,加盘reblance时导致集群重启。

​2、问题分析

​2.1 首先,接到运维监控告警,某某平台发生严重告警

​2.2 登陆相关平台查看数据库和集群ASM日志,发现节点1集群发生重启,相关报错日志如下:

Wed Dec 26 17:20:29 2018

ARB0 started with pid=43, OS id=22557

NOTE: assigning ARB0 to group 2/0x6b4139d2 (ORADATA) with 1 parallel I/O

NOTE: Attempting voting file refresh on diskgroup ORADATA

Wed Dec 26 17:22:37 2018

Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_arb0_22557.trc  (incident=208353):

ORA-04031: unable to allocate 7072 bytes of shared memory ("shared pool","unknown object","sga heap(1,1)","ges resource ")

Incident details in: /u01/app/grid/diag/asm/+asm/+ASM1/incident/incdir_208353/+ASM1_arb0_22557_i208353.trc

Use ADRCI or Support Workbench to package the incident.

See Note 411.1 at My Oracle Support for error and packaging details.

Wed Dec 26 17:22:39 2018

Dumping diagnostic data in directory=[cdmp_20181226172239], requested by (instance=1, osid=22557 (ARB0)), summary=[incident=208353].

Wed Dec 26 17:22:46 2018

Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_m000_22771.trc  (incident=208345):

ORA-04031: unable to allocate 12312 bytes of shared memory ("shared pool","unknown object","KKSSP^1232","kglseshtTable")

Incident details in: /u01/app/grid/diag/asm/+asm/+ASM1/incident/incdir_208345/+ASM1_m000_22771_i208345.trc

Use ADRCI or Support Workbench to package the incident.

See Note 411.1 at My Oracle Support for error and packaging details.

Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_m000_22771.trc:

ORA-04031: unable to allocate 12312 bytes of shared memory ("shared pool","unknown object","KKSSP^1232","kglseshtTable")

​2.3 数据库运维人员注意到,此前的主要操作主要就是给磁盘组加盘,观察ASM告警日志,相关操作记录如下:

Wed Dec 26 17:20:16 2018

SQL> ALTER DISKGROUP ORADATA ADD  DISK '/dev/rdisk/VD-DATA21' SIZE 182272M ,

'/dev/rdisk/VD-DATA22' SIZE 182272M /* ASMCA */

NOTE: GroupBlock outside rolling migration privileged region

NOTE: Assigning number (2,20) to disk (/dev/rdisk/VD-DATA21)

NOTE: Assigning number (2,21) to disk (/dev/rdisk/VD-DATA22)

NOTE: requesting all-instance membership refresh for group=2

NOTE: initializing header on grp 2 disk ORADATA_0020

NOTE: initializing header on grp 2 disk ORADATA_0021

NOTE: requesting all-instance disk validation for group=2

Wed Dec 26 17:20:19 2018

NOTE: skipping rediscovery for group 2/0x6b4139d2 (ORADATA) on local instance.

NOTE: requesting all-instance disk validation for group=2

NOTE: skipping rediscovery for group 2/0x6b4139d2 (ORADATA) on local instance.

NOTE: initiating PST update: grp = 2

Wed Dec 26 17:20:25 2018

GMON updating group 2 at 7 for pid 42, osid 22238

NOTE: PST update grp = 2 completed successfully

NOTE: membership refresh pending for group 2/0x6b4139d2 (ORADATA)

GMON querying group 2 at 8 for pid 18, osid 5128

NOTE: cache opening disk 20 of grp 2: ORADATA_0020 path:/dev/rdisk/VD-DATA21

NOTE: cache opening disk 21 of grp 2: ORADATA_0021 path:/dev/rdisk/VD-DATA22

Wed Dec 26 17:20:29 2018

NOTE: Attempting voting file refresh on diskgroup ORADATA

GMON querying group 2 at 9 for pid 18, osid 5128

SUCCESS: refreshed membership for 2/0x6b4139d2 (ORADATA)

Wed Dec 26 17:20:29 2018

SUCCESS: ALTER DISKGROUP ORADATA ADD  DISK '/dev/rdisk/VD-DATA21' SIZE 182272M ,

'/dev/rdisk/VD-DATA22' SIZE 182272M /* ASMCA */

NOTE: starting rebalance of group 2/0x6b4139d2 (ORADATA) at power 1

Starting background process ARB0

Wed Dec 26 17:20:29 2018

ARB0 started with pid=43, OS id=22557

NOTE: assigning ARB0 to group 2/0x6b4139d2 (ORADATA) with 1 parallel I/O

NOTE: Attempting voting file refresh on diskgroup ORADATA

​2.4 到此,基本上可以确定是ASM加盘,ASM在进行reblance的时候,由于ASM的SGA设置过小导致的集群重启

​3、问题处理

​调整相关集群的ASM的SGA大小到2G,重新启动集群,ASM开始正常的reblance:

Wed Dec 26 17:56:32 2018

NOTE: client SYXPTDB1:SYXPTDB registered, osid 1074, mbr 0x1

Wed Dec 26 18:35:33 2018

ALTER SYSTEM SET memory_max_target='2G' SCOPE=SPFILE SID='*';

ALTER SYSTEM SET memory_target='2G' SCOPE=SPFILE SID='*';

ALTER SYSTEM SET sga_max_size='2G' SCOPE=SPFILE SID='*';

Wed Dec 26 20:50:11 2018

NOTE: GroupBlock outside rolling migration privileged region

NOTE: requesting all-instance membership refresh for group=2

Wed Dec 26 20:50:14 2018

NOTE: membership refresh pending for group 2/0x1edaa5d7 (ORADATA)

Wed Dec 26 20:50:17 2018

GMON querying group 2 at 7 for pid 18, osid 26306

SUCCESS: refreshed membership for 2/0x1edaa5d7 (ORADATA)

NOTE: Attempting voting file refresh on diskgroup ORADATA

​到此问题处理完成!

ORACLE RAC 11.2.0.4 ASM加盘导致集群重启之ASM sga设置过小相关推荐

  1. oracle 11.2.0.3.4 psu 14275605 下载,Oracle RAC 11.2.0.3.2 升级 11.2.0.3.4

    Oracle RAC 11.2.0.3.2升级11.2.0.3.4 安装环境操作系统:RHEL6.264bitOracle Database版本:11.2.0.3.2Oracle Grid版本:11. ...

  2. Oracle RAC 11.2.0.3 节点CRS无法启动报:no network hb 故障解决方法

    软件版本: oracle rac 11.2.0.3,补丁打到最新11.2.0.3.5 故障现象:Oracle双节点组成RAC,RAC软件安装在节点1上:运行一段时间后,节点2日志报"网络通信 ...

  3. Oracle RAC 11.2.0.4打PSU

     环境: OS CentOS 6.6 64bit Grid software 11.2.0.4.0  Oracle software 11.2.0.4.0 方式:完全手动方式patch 1.停监听 ...

  4. RHEL 7 安装oracle rac 11.2.0.4执行root.sh报错ohasd failed to start

    报错信息: [root@rac1 ~]# /u01/app/oraInventory/orainstRoot.sh  Changing permissions of /u01/app/oraInven ...

  5. oracle rac 11.2.0.4 镜像copy迁移数据到新存储

    最劲朋友关于将一个25T的数据迁移到新的存储,做了如下实验 把数据库迁移到新的存储 从 data磁盘组 迁移到 FRA 磁盘组 //创建业务表空间 SQL> create tablespace ...

  6. ORACLE RAC 11.2.0.4 for RHEL6.8 集群CRS异常导致集群命令无法使用

      >   >     >     >   >           > > > >

  7. Oracle 安装 RAC 11.2.0.4 centos7.4 -udev磁盘绑定/执行root脚本报错

    在centos 7.4上安装oracle rac 11.2.0.4 报错及相关解决 $ cat /etc/redhat-release CentOS Linux release 7.4.1708 (C ...

  8. Oracle RAC 10.2.0.5升级到11.2.0.4遇到的问题

        最近有这个需求所以提前在家里的测试环境做了相关的测试,将Oracle RAC 10.2.0.5 for Linux升级到Oracle RAC 11.2.0.4,不对物理结构做任何变更,直接升级 ...

  9. aix系统下oracle之ora-00471,Oracle RAC 9.2.0.7 (AIX53,HA52)三台主机实例全down的问题

    硬件环境: IBM p570: 2台:IBM p550: 1台 系统环境: AIX 5.3-04 HACMP 5.2 Oracle RAC 9.2.0.7 故障描述: 在这个群集中,两台570是生产系 ...

最新文章

  1. Python ModuleNotFoundError: No module named ‘xlrd‘
  2. python爬虫抓取信息_python爬虫爬取网上药品信息并且存入数据库
  3. 定时自动按键软件_[按键精灵手机版教程]QUI界面也可以如此炫酷
  4. JS题目总结:原型链/new/json/MVC/Promise
  5. Vmware workstation 网络连接类型
  6. python join()函数
  7. 轻松为Windows系统快速配置多个网关
  8. Wget CVE-2014-4877:FTP 符号链接任意文件系统访问
  9. Taro+react开发(93):判断是否是H5端
  10. 刷题刷题 ——网易CPP
  11. 禅道xampp文件夹无法删除_无法删除文件解决方案
  12. linux rm后文件放哪里,怎样将Linux rm号令删除的文件放进渣滓箱
  13. ubuntu20 系统 Apache+花生壳(内网穿透)服务项目上线
  14. 嵌入式linux快速入门
  15. 没有心的男人 2012-02-08 21:11:06
  16. qemu-guest-agent调研
  17. 使用R语言实现的城市空气质量分析模型
  18. ARM售价超400亿美元?软银与英伟达有望达成史上最大半导体交易-1
  19. 网络空间安全未来就业前景和就业方向,看着六点
  20. 【终于可以好好利用自己的技能和知识来享受生活了】

热门文章

  1. Spring REST是什么?
  2. 2018VR行业前瞻:“新科技 新商业·2017全球虚拟现实产业创新者峰会”正式举办...
  3. 计算机二级试题怎么下载
  4. 获取最新消息快速通道
  5. 终于找到blender渲染总是崩溃的原因了
  6. vue 得到当月的天数getDate()方法
  7. Google面试题:人和自行车匹配
  8. ## 2020年度学期计划
  9. 锐捷无线ap服务器怎么绑定mac,锐捷无线ap配置命令教程
  10. js页面将数据内容以文件形式下载