OS:

ORACLE LINUX 5.7

DB:

11.2.0.3

RAC：YES

故障：

1、两节点RAC，节点分别为linuxdb1、linuxdb2，其中节点linuxdb2服务器出现故障，无法启动

2、只启动节点linuxdb1即可，然后供测试部门使用

3、crsctl无法启动报错:CRS-1714:Unable to discover any voting files

#crsctl start cluster -n linuxdb1

CRS-2672: Attempting to start 'ora.cssd' on 'linuxdb1'

CRS-2672: Attempting to start 'ora.diskmon' on 'linuxdb1'

CRS-2676: Start of 'ora.diskmon' on 'linuxdb1' succeeded

CRS-2674: Start of 'ora.cssd' on 'linuxdb1' failed

CRS-2679: Attempting to clean 'ora.cssd' on 'linuxdb1'

CRS-2681: Clean of 'ora.cssd' on 'linuxdb1' succeeded

CRS-4000: Command Start failed, or completed with errors.

查看日志：

[cssd(1934)]CRS-1714:Unable to discover any voting files, retrying

discovery in 15 seconds; Details at (:CSSNM00070:) in

/u01/app/11.2.0/grid/log/linuxdb1/cssd/ocssd.log

2014-02-12 07:57:03.698

[/u01/app/11.2.0/grid/bin/cssdagent(1920)]CRS-5818:Aborted command

'start' for resource 'ora.cssd'. Details at (:CRSAGF00113:)

{0:52:6} in

/u01/app/11.2.0/grid/log/linuxdb1/agent/ohasd/oracssdagent_root/oracssdagent_root.log.

2014-02-12 07:57:03.699

[cssd(1934)]CRS-1656:The CSS daemon is terminating due to a fatal

error; Details at (:CSSSC00012:) in

/u01/app/11.2.0/grid/log/linuxdb1/cssd/ocssd.log

2014-02-12 07:57:03.699

[cssd(1934)]CRS-1603:CSSD on node linuxdb1 shutdown by user.

2014-02-12 07:57:05.492

[cssd(1934)]CRS-1714:Unable to discover any voting files, retrying

discovery in 15 seconds; Details at (:CSSNM00070:) in

/u01/app/11.2.0/grid/log/linuxdb1/cssd/ocssd.log

2014-02-12 07:57:09.753

[ohasd(6518)]CRS-2765:Resource 'ora.cssdmonitor' has failed on

server 'linuxdb1'.

2014-02-12 07:57:21.551

[cssd(2113)]CRS-1713:CSSD daemon is started in clustered mode

2014-02-12 07:57:21.676

[cssd(2113)]CRS-1714:Unable to discover any voting files, retrying

discovery in 15 seconds; Details at (:CSSNM00070:) in

/u01/app/11.2.0/grid/log/linuxdb1/cssd/ocssd.log

2014-02-12 07:57:36.694

[cssd(2113)]CRS-1714:Unable to discover any voting files, retrying

discovery in 15 seconds; Details at (:CSSNM00070:) in

/u01/app/11.2.0/grid/log/linuxdb1/cssd/ocssd.log

2014-02-12 07:57:51.713

[cssd(2113)]CRS-1714:Unable to discover any voting files, retrying

discovery in 15 seconds; Details at (:CSSNM00070:) in

/u01/app/11.2.0/grid/log/linuxdb1/cssd/ocssd.log

2014-02-12 07:58:06.732

[cssd(2113)]CRS-1714:Unable to discover any voting files, retrying

discovery in 15 seconds; Details at (:CSSNM00070:) in

/u01/app/11.2.0/grid/log/linuxdb1/cssd/ocssd.log

查看多路径和asmlib状态：

/etc/init.d/oracleasm listdisks一切正常

查看磁盘信息：

#fdisk -l

Disk /dev/sdb: 2199.0

GB, 2199023255552 bytes

255 heads, 63 sectors/track, 267349 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sdb1 1 267350 2147483647+ ee EFI GPT

WARNING: GPT (GUID Partition Table) detected on '/dev/sdc'! The

util fdisk doesn't support GPT. Use GNU Parted.

WARNING: The size of this disk is 2.2 TB (2199023255552

bytes).

DOS partition table format can not be used on drives for

volumes

larger than 2.2 TB (2199023255040 bytes). Use parted(1) and

GUID

partition table format (GPT).

Disk /dev/sdc: 2199.0

GB, 2199023255552 bytes

255 heads, 63 sectors/track, 267349 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sdc1 1 267350 2147483647+ ee EFI GPT

WARNING: GPT (GUID Partition Table) detected on '/dev/sdd'! The

util fdisk doesn't support GPT. Use GNU Parted.

WARNING: The size of this disk is 2.2 TB (2199023255552

bytes).

DOS partition table format can not be used on drives for

volumes

larger than 2.2 TB (2199023255040 bytes). Use parted(1) and

GUID

partition table format (GPT).

Disk /dev/sdd: 2199.0

GB, 2199023255552 bytes

255 heads, 63 sectors/track, 267349 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sdd1 1 267350 2147483647+ ee EFI GPT

WARNING: GPT (GUID Partition Table) detected on '/dev/sde'! The

util fdisk doesn't support GPT. Use GNU Parted.

WARNING: The size of this disk is 2.2 TB (2199023255552

bytes).

DOS partition table format can not be used on drives for

volumes

larger than 2.2 TB (2199023255040 bytes). Use parted(1) and

GUID

partition table format (GPT).

Disk /dev/sde: 2199.0

GB, 2199023255552 bytes

255 heads, 63 sectors/track, 267349 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sde1 1 267350 2147483647+ ee EFI GPT

查看oracleasm信息：

# This is a configuration file for automatic loading of the

Oracle

# Automatic Storage Management library kernel driver. It is

generated

# By running /etc/init.d/oracleasm configure. Please use that

method

# to modify this file

#

# ORACLEASM_ENABELED: 'true' means to load the driver on

boot.

ORACLEASM_ENABLED=true

# ORACLEASM_UID: Default user owning the /dev/oracleasm mount

point.

ORACLEASM_UID=grid

# ORACLEASM_GID: Default group owning the /dev/oracleasm mount

point.

ORACLEASM_GID=asmadmin

# ORACLEASM_SCANBOOT: 'true' means scan for ASM disks on

boot.

ORACLEASM_SCANBOOT=true

# ORACLEASM_SCANORDER: Matching patterns to order disk

scanning

ORACLEASM_SCANORDER="multipath sd"

# ORACLEASM_SCANEXCLUDE: Matching patterns to exclude disks from

scan

ORACLEASM_SCANEXCLUDE="sdf sdg

sdh sdi"

* fdisk -l 的信息与oracleasm的磁盘信息不符

fdisk -l的磁盘为sdb sdc sdd sde

将ORACLEASM_SCANEXCLUDE="sdf sdg

sdh sdi" -> ORACLEASM_SCANEXCLUDE="sdb sdc sdd sde"

重启crs，OK

检查状态：

$ srvctl status asm

$ srvctl status instance -d devdb -i devdb1

$ srvctl status database -d devdb

节点linuxdb1连接数据库一切正常。