Oracle 10g RAC 故障之--CRS启动失败(一)

2014-11-24 17:21:34 · 作者: · 浏览: 0

系统环境:


OS: Linux EL5


CRS: CRS 10.2.0.1


1、crs 启动失败


[root@node2 ~]# crsctl check crs
Failure 1 contacting CSS daemon
Cannot communicate with CRS
Cannot communicate with EVM


2、查看系统日志


[root@node2 ~]# tail /var/log/messages


Nov 2 09:45:07 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.2928.


Nov 2 09:46:07 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.2962.


Nov 2 09:46:07 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.3172.


Nov 2 09:46:07 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.2928.


Nov 2 09:47:07 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.2962.


Nov 2 09:47:07 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.2928.


Nov 2 09:47:07 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.3172.


Nov 2 09:48:07 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.2962.


Nov 2 09:48:07 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.2928.


Nov 2 09:48:07 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.3172.



[root@node2 ~]# cat /tmp/crsctl.3172


OCR initialization failed accessing OCR device: PROC-26: Error while accessing the physical storage Operating System error [Permission denied] [13]


[root@node2 ~]#




3、ocr 对应的裸设备权限出错


[root@node2 ~]# ls -l /dev/raw


total 0


crw------- 1 root root 162, 1 Nov 2 09:41 raw1


crw------- 1 root root 162, 2 Nov 2 09:41 raw2


[root@node2 ~]#


4、修改raw 权限配置文件,系统启动时自动应用权限




[root@node2 ~]# cat /etc/udev/rules.d/65-raw-permissions.rules


# Set permissions of raw bindings to Oracle Clusterware devices


KERNEL=="raw1", OWNER="oracle", GROUP="dba", MODE="660"


KERNEL=="raw2", OWNER="oracle", GROUP="dba", MODE="660"


[root@node2 ~]#




5、重新启动udev 服务


[root@node1 rules.d]# start_udev


Starting udev: [ OK ]


[root@node1 rules.d]# ls -l /dev/raw


total 0


crw-rw---- 1 oracle dba 162, 1 Nov 2 09:55 raw1


crw-rw---- 1 oracle dba 162, 2 Nov 2 09:55 raw2


[root@node1 rules.d]#




6、重新启动crs ,系统正常


[root@node2 ~]# crsctl stop crs


Stopping resources.


Successfully stopped CRS resources


Stopping CSSD.


Shutting down CSS daemon.


Shutdown request successfully issued.


[root@node2 ~]# crsctl start crs


Attempting to start CRS stack


The CRS stack will be started shortly




[root@node2 ~]# tail /var/log/messages


Nov 2 09:52:07 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.2928.


Nov 2 09:52:08 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.3172.


Nov 2 09:53:08 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.2962.


Nov 2 09:53:08 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.3172.


Nov 2 09:53:08 node2 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.2928.


Nov 2 09:54:10 node2 logger: Cluster Ready Services completed waiting on dependencies.


Nov 2 09:54:10 node2 last message repeated 2 times


Nov 2 09:55:10 node2 logger: Running CRSD with TZ =


Nov 2 09:56:01 node2 logger: Oracle CSSD graceful shutdown


Nov 2 09:56:32 node2 logger: Cluster Ready Services completed waiting on dependencies.




[root@node2 ~]# crsctl