CRS-0804:PROC-26: Error while accessing the physical storage

错误现象：oracle11.2.0.4rac+linux7.7打20191015gi psu补丁后失败，导致crs启动失败，报错如下：
[grid@rac1 rac1]$ tail -f alertrac1.log
2020-07-07 16:27:02.696:
[mdnsd(3096)]CRS-5602:mDNS service stopping by request.
2020-07-07 16:27:17.049:
[cssd(3176)]CRS-1603:CSSD on node rac1 shutdown by user.
2020-07-07 16:27:17.153:
[ohasd(2965)]CRS-2767:Resource state recovery not attempted for 'ora.cssdmonitor' as its target state is OFFLINE
2020-07-07 16:27:17.153:
[ohasd(2965)]CRS-2769:Unable to failover resource 'ora.cssdmonitor'.
2020-07-07 16:27:19.404:
[gpnpd(3107)]CRS-2329:GPNPD on node rac1 shutdown.
2020-07-07 16:27:41.446:
[ohasd(4623)]CRS-2112:The OLR service started on node rac1.
2020-07-07 16:27:41.451:
[ohasd(4623)]CRS-1301:Oracle High Availability Service started on node rac1.
2020-07-07 16:27:41.451:
[ohasd(4623)]CRS-8017:location: /etc/oracle/lastgasp has 2 reboot advisory log files, 0 were announced and 0 errors occurred
2020-07-07 16:27:44.646:
[/oracle/app/11.2.0/grid/bin/orarootagent.bin(4674)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
2020-07-07 16:27:48.991:
[gpnpd(4767)]CRS-2328:GPNPD started on node rac1.
2020-07-07 16:27:51.288:
[cssd(4836)]CRS-1713:CSSD daemon is started in clustered mode
2020-07-07 16:27:53.155:
[ohasd(4623)]CRS-2767:Resource state recovery not attempted for 'ora.diskmon' as its target state is OFFLINE
2020-07-07 16:27:53.155:
[ohasd(4623)]CRS-2769:Unable to failover resource 'ora.diskmon'.
2020-07-07 16:28:12.854:
[cssd(4836)]CRS-1707:Lease acquisition for node rac1 number 1 completed
2020-07-07 16:28:14.081:
[cssd(4836)]CRS-1605:CSSD voting file is online: /dev/asm-crs2; details in /oracle/app/11.2.0/grid/log/rac1/cssd/ocssd.log.
2020-07-07 16:28:14.083:
[cssd(4836)]CRS-1605:CSSD voting file is online: /dev/asm-crs3; details in /oracle/app/11.2.0/grid/log/rac1/cssd/ocssd.log.
2020-07-07 16:28:14.085:
[cssd(4836)]CRS-1605:CSSD voting file is online: /dev/asm-crs1; details in /oracle/app/11.2.0/grid/log/rac1/cssd/ocssd.log.
2020-07-07 16:28:17.413:
[cssd(4836)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 .
2020-07-07 16:28:19.541:
[ctssd(5003)]CRS-2401:The Cluster Time Synchronization Service started on host rac1.
2020-07-07 16:28:19.541:
[ctssd(5003)]CRS-2407:The new Cluster Time Synchronization Service reference node is host rac2.
2020-07-07 16:28:21.306:
[ohasd(4623)]CRS-2767:Resource state recovery not attempted for 'ora.diskmon' as its target state is OFFLINE
2020-07-07 16:28:21.306:
[ohasd(4623)]CRS-2769:Unable to failover resource 'ora.diskmon'.
2020-07-07 16:28:35.156:
[crsd(5144)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /oracle/app/11.2.0/grid/log/rac1/crsd/crsd.log.
2020-07-07 16:28:35.162:
[crsd(5144)]CRS-0804:Cluster Ready Service aborted due to Oracle Cluster Registry error [PROC-26: Error while accessing the physical storage
ORA-01034: ORACLE not available
ORA-27123: unable to attach to shared memory segment
Linux-x86_64 Error: 13: Permission denied
Additional information: 26
Additional information: 360450
]. Details at (:CRSD00111:) in /oracle/app/11.2.0/grid/log/rac1/crsd/crsd.log.
2020-07-07 16:28:35.905:
[ohasd(4623)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac1'.
2020-07-07 16:28:37.167:
[crsd(5160)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /oracle/app/11.2.0/grid/log/rac1/crsd/crsd.log.
2020-07-07 16:28:37.172:
[crsd(5160)]CRS-0804:Cluster Ready Service aborted due to Oracle Cluster Registry error [PROC-26: Error while accessing the physical storage
ORA-01034: ORACLE not available
ORA-27123: unable to attach to shared memory segment
Linux-x86_64 Error: 13: Permission denied
Additional information: 26
Additional information: 360450
]. Details at (:CRSD00111:) in /oracle/app/11.2.0/grid/log/rac1/crsd/crsd.log.
2020-07-07 16:28:37.918:
[ohasd(4623)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac1'.
2020-07-07 16:28:39.185:
[crsd(5177)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /oracle/app/11.2.0/grid/log/rac1/crsd/crsd.log.
2020-07-07 16:28:39.190:
[crsd(5177)]CRS-0804:Cluster Ready Service aborted due to Oracle Cluster Registry error [PROC-26: Error while accessing the physical storage
ORA-01034: ORACLE not available
ORA-27123: unable to attach to shared memory segment
Linux-x86_64 Error: 13: Permission denied
Additional information: 26
Additional information: 360450
]. Details at (:CRSD00111:) in /oracle/app/11.2.0/grid/log/rac1/crsd/crsd.log.
2020-07-07 16:28:39.933:
[ohasd(4623)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac1'.
2020-07-07 16:28:41.197:
[crsd(5193)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /oracle/app/11.2.0/grid/log/rac1/crsd/crsd.log.
2020-07-07 16:28:41.203:
[crsd(5193)]CRS-0804:Cluster Ready Service aborted due to Oracle Cluster Registry error [PROC-26: Error while accessing the physical storage
ORA-01034: ORACLE not available
ORA-27123: unable to attach to shared memory segment
Linux-x86_64 Error: 13: Permission denied
Additional information: 26
Additional information: 360450
]. Details at (:CRSD00111:) in /oracle/app/11.2.0/grid/log/rac1/crsd/crsd.log.
2020-07-07 16:28:41.946:
[ohasd(4623)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac1'.
2020-07-07 16:28:43.205:
[crsd(5210)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /oracle/app/11.2.0/grid/log/rac1/crsd/crsd.log.
2020-07-07 16:28:43.210:
[crsd(5210)]CRS-0804:Cluster Ready Service aborted due to Oracle Cluster Registry error [PROC-26: Error while accessing the physical storage
ORA-01034: ORACLE not available
ORA-27123: unable to attach to shared memory segment
Linux-x86_64 Error: 13: Permission denied
Additional information: 26
Additional information: 360450
]. Details at (:CRSD00111:) in /oracle/app/11.2.0/grid/log/rac1/crsd/crsd.log.
2020-07-07 16:28:43.956:
[ohasd(4623)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac1'.
2020-07-07 16:28:45.220:
[crsd(5227)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /oracle/app/11.2.0/grid/log/rac1/crsd/crsd.log.
2020-07-07 16:28:45.226:
[crsd(5227)]CRS-0804:Cluster Ready Service aborted due to Oracle Cluster Registry error [PROC-26: Error while accessing the physical storage
ORA-01034: ORACLE not available
ORA-27123: unable to attach to shared memory segment
Linux-x86_64 Error: 13: Permission denied

解决：
asm密码文件从节点2的$ORACLE_HOME/dbs/orapw+ASM2拷贝到节点1重命名为orapw+ASM1
检查对比密码文件：
[grid@rac1 ~]$ cd $ORACLE_HOME/dbs
[grid@rac1 dbs]$ ll
total 32
-rw-r----- 1 grid oinstall 1536 Jul 5 22:26 1
-rw-r----- 1 grid oinstall 1536 Jul 7 16:25 2
-rw-r----- 1 grid oinstall 1536 Jul 7 16:56 a1
-rw-rw---- 1 grid oinstall 2706 Jul 7 18:20 ab_+ASM1.dat
-rw-rw---- 1 grid oinstall 1544 Jul 7 18:20 hc_+ASM1.dat
-rw-r--r-- 1 grid oinstall 2851 May 15 2009 init.ora
-rw-r----- 1 grid oinstall 1536 Jul 7 16:56 orapw+ASM
-rw-r----- 1 grid oinstall 2048 Jul 7 18:28 orapw+ASM1
[grid@rac1 dbs]$ strings orapw+ASM1
]\[Z
ORACLE Remote Password file
INTERNAL
87C5F4BF47942D0E
4CCF4A082AD3F312
ASMSNMP
[grid@rac1 dbs]$ ssh rac2
Last login: Tue Jul 7 18:28:05 2020 from rac1
[grid@rac2 ~]$ cd $ORACLE_HOME/dbs
[grid@rac2 dbs]$ strings orapw+ASM1
strings: 'orapw+ASM1': No such file
[grid@rac2 dbs]$ strings orapw+ASM2
]\[Z
ORACLE Remote Password file
INTERNAL
87C5F4BF47942D0E
4CCF4A082AD3F312
({i%
ASMSNMP
F09DC973C6E03E3A
[grid@rac2 dbs]$ exit
logout
Connection to rac2 closed.
[grid@rac1 dbs]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.4.0 Production on Tue Jul 7 18:34:14 2020

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL> set line 160
SQL> select * from v$pwfile_users;

USERNAME SYSDBA SYSOPER SYSASM
------------------------------------------------------------ ---------- ---------- ----------
SYS TRUE TRUE FALSE
ASMSNMP TRUE FALSE FALSE

然后报错如下：
[ohasd(4151)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac1'.
2020-07-07 18:08:09.832:
[crsd(4904)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /oracle/app/11.2.0/grid/log/rac1/crsd/crsd.log.
2020-07-07 18:08:09.836:
[crsd(4904)]CRS-0804:Cluster Ready Service aborted due to Oracle Cluster Registry error [PROC-26: Error while accessing the physical storage
ORA-01017: invalid username/password; logon denied
]. Details at (:CRSD00111:) in /oracle/app/11.2.0/grid/log/rac1/crsd/crsd.log.
2020-07-07 18:08:09.940:
[ohasd(4151)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac1'.
2020-07-07 18:08:09.940:
[ohasd(4151)]CRS-2771:Maximum restart attempts reached for resource 'ora.crsd'; will not restart.
2020-07-07 18:08:09.940:
[ohasd(4151)]CRS-2769:Unable to failover resource 'ora.crsd'.
2020-07-07 18:10:11.700:
[client(5202)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /oracle/app/11.2.0/grid/log/rac1/client/crsctl_root.log.
2020-07-07 18:10:34.156:
[client(5997)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /oracle/app/11.2.0/grid/log/rac1/client/crsctl_root.log.
解决办法：
修改文件权限和属主解决
需重启crs

[root@rac1 ~]# crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4529: Cluster Synchronization Services is online
CRS-4534: Cannot communicate with Event Manager
[root@rac1 ~]# ll $ORACLE_HOME/bin/oracle
ls: cannot access /bin/oracle: No such file or directory
[root@rac1 ~]# su - grid
Last login: Tue Jul 7 16:30:17 CST 2020 on pts/0
[grid@rac1 ~]$ ll $ORACLE_HOME/bin/oracle
-rwxr-x--x 1 root oinstall 209840344 Jul 5 13:24 /oracle/app/11.2.0/grid/bin/oracle
[grid@rac1 ~]$ exit
logout
[root@rac1 ~]# su - oracle
Last login: Tue Jul 7 15:52:39 CST 2020 on pts/0
[oracle@rac1 ~]$ ll $ORACLE_HOME/bin/oracle
-rwsr-s--x 1 oracle asmadmin 239501488 Jul 7 09:54 /oracle/app/oracle/product/11.2.0/dbhome_1/bin/oracle
[oracle@rac1 ~]$ exit
logout
[root@rac1 ~]# su - grid
Last login: Tue Jul 7 16:32:40 CST 2020 on pts/0
[grid@rac1 ~]$
[grid@rac1 ~]$
[grid@rac1 ~]$ chmod 6751 /oracle/app/11.2.0/grid/bin/oracle
chmod: changing permissions of ‘/oracle/app/11.2.0/grid/bin/oracle’: Operation not permitted
[grid@rac1 ~]$ exit
logout
[root@rac1 ~]# chmod 6751 /oracle/app/11.2.0/grid/bin/oracle
[root@rac1 ~]# su - grid
Last login: Tue Jul 7 16:34:34 CST 2020 on pts/0
[grid@rac1 ~]$ ll $ORACLE_HOME/bin/oracle
-rwsr-s--x 1 root oinstall 209840344 Jul 5 13:24 /oracle/app/11.2.0/grid/bin/oracle
[grid@rac1 ~]$ exit
logout
[root@rac1 grid]# chown grid:oinstall /oracle/app/11.2.0/grid/bin/oracle
[root@rac1 grid]# ll /oracle/app/11.2.0/grid/bin/oracle
-rwxr-x--x 1 grid oinstall 209840344 Jul 5 13:24 /oracle/app/11.2.0/grid/bin/oracle
[root@rac1 grid]# su - grid
Last login: Tue Jul 7 18:11:40 CST 2020 on pts/0
[grid@rac1 ~]$ chmod 6751 /oracle/app/11.2.0/grid/bin/oracle
[grid@rac1 ~]$ ll $ORACLE_HOME/bin/oracle
-rwsr-s--x 1 grid oinstall 209840344 Jul 5 13:24 /oracle/app/11.2.0/grid/bin/oracle

[root@rac1 ~]# crsctl stop crs -f
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
CRS-2673: Attempting to stop 'ora.crf' on 'rac1'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac1'
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'
CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
[root@rac1 ~]# crsctl start crs
CRS-4123: Oracle High Availability Services has been started.

CRS-0804:PROC-26: Error while accessing the physical storage相关推荐

解决error while accessing a target resource. resource is perhaps not available or a wrong access was
问题描述: MDK Keil工程下载和调试时,Commond窗口提示: error while accessing a target resource. resource is perhaps not ...
provider: SQL Network Interfaces , error: 26 - Error Locating Server / Instance
在 ASP.NET 中使用了角色管理机制(System.Web.Security.Roles )连接数据库时出现了如下错误: 在与 SQL Server 建立连接时出现与网络相关的或特定于实例的错误. ...
170318 11:44:26 [ERROR] Can't start server: can't create PID file: No space left on device
数据库挂了.打开远程,进了系统,service mysqld stop 失败.service mysqld start等了好大一会,提示Timeout error occurred trying to ...
SQL Network Interfaces, error: 26 – Error Locating Server/Instance Specified
原文链接:https://blogs.msdn.microsoft.com/sql_protocols/2007/05/13/sql-network-interfaces-error-26-error ...
provider: SQL Network Interfaces, error: 26 - Error Locating Server/Instance Specified
https://blog.sqlauthority.com/2009/05/21/sql-server-fix-error-provider-named-pipes-provider-error ...
Unknown failure: Error: java.lang.IllegalStateException: No storage with enough free space； res=-1
报错信息解决方案模拟器存储空间不足,换个模拟器或者删APP腾空间
由于CRS磁盘dismount造成的CRS进程无法启动问题
环境:11.2.0.3 rac primary+rac standby 生产库rac standby的node1节点CRS自动关闭问题 --EM报警 Message=Clusterware has p ...
Oracle RAC CRS-0184 --Cannot communicate with the CRS daemon
Oracle 11gR2 下RAC 安装后,启动CRS. 错误如下: [root@rac1 bin]# ./crsctl check crs CRS-4638: Oracle High Availab ...
CRS磁盘force dismount引起的RAC节点宕机故障
墨墨导读:本文来自墨天轮"猫瞳映月"投稿,作者主页https://www.modb.pro/u/12330,主要详述CRS磁盘force dismount引起的RAC节点宕机故障处 ...

CRS-0804:PROC-26: Error while accessing the physical storage

CRS-0804:PROC-26: Error while accessing the physical storage相关推荐

最新文章

热门文章