2014-05-21 14:14:51.693
[cssd(8520)]CRS-1617:The information required to do node kill for node rac2 is incomplete; details at (:CSSNM00004:) in /u01/app/11.2/product/crs_1/log/rac2/cssd/ocssd.log
2014-05-21 14:14:51.696
[cssd(8520)]CRS-1605:CSSD voting file is online: ORCL:ASMLB_OCR03; details in /u01/app/11.2/product/crs_1/log/rac2/cssd/ocssd.log.
2014-05-21 14:14:51.700
[cssd(8520)]CRS-1605:CSSD voting file is online: ORCL:ASMLB_OCR02; details in /u01/app/11.2/product/crs_1/log/rac2/cssd/ocssd.log.
2014-05-21 14:14:51.704
[cssd(8520)]CRS-1605:CSSD voting file is online: ORCL:ASMLB_OCR01; details in /u01/app/11.2/product/crs_1/log/rac2/cssd/ocssd.log.
2014-05-21 14:14:56.235
[cssd(8520)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac2 rac2 .
2014-05-21 14:14:58.695
[ctssd(8722)]CRS-2403:The Cluster Time Synchronization Service on host rac2 is in observer mode.
2014-05-21 14:14:58.973
[ctssd(8722)]CRS-2407:The new Cluster Time Synchronization Service reference node is host rac2.
2014-05-21 14:14:58.974
[ctssd(8722)]CRS-2401:The Cluster Time Synchronization Service started on host rac2.
[client(8758)]CRS-10001:21-May-14 14:14 ACFS-9391: Checking for existing ADVM/ACFS installation.
[client(8763)]CRS-10001:21-May-14 14:14 ACFS-9392: Validating ADVM/ACFS installation files for operating system.
[client(8765)]CRS-10001:21-May-14 14:14 ACFS-9393: Verifying ASM Administrator setup.
[client(8768)]CRS-10001:21-May-14 14:14 ACFS-9308: Loading installed ADVM/ACFS drivers.
[client(8771)]CRS-10001:21-May-14 14:14 ACFS-9154: Loading 'oracleoks.ko' driver.
[client(8812)]CRS-10001:21-May-14 14:15 ACFS-9154: Loading 'oracleadvm.ko' driver.
[client(8854)]CRS-10001:21-May-14 14:15 ACFS-9154: Loading 'oracleacfs.ko' driver.
[client(8966)]CRS-10001:21-May-14 14:15 ACFS-9327: Verifying ADVM/ACFS devices.
[client(8971)]CRS-10001:21-May-14 14:15 ACFS-9156: Detecting control device '/dev/asm/.asm_ctl_spec'.
[client(8975)]CRS-10001:21-May-14 14:15 ACFS-9156: Detecting control device '/dev/ofsctl'.
[client(8981)]CRS-10001:21-May-14 14:15 ACFS-9322: completed
2014-05-21 14:26:29.083
[/u01/app/11.2/product/crs_1/bin/orarootagent.bin(14037)]CRS-5018:(:CLSN00037:) Removed unused HAIP route: 169.254.95.0 / 255.255.255.0 / 0.0.0.0 / usb0
[cssd(14105)]CRS-1612:Network communication with node rac2 (1) missing for 50% of timeout interval. Removal of this node from cluster in 14.010 seconds
2014-05-21 14:28:40.898
[cssd(14105)]CRS-1662:Member kill requested by node rac2 for member number 1, group DB+ASM
2014-05-21 14:28:42.637
[/u01/app/11.2/product/crs_1/bin/oraagent.bin(13997)]CRS-5019:All OCR locations are on ASM disk groups [OCRDG],
and none of these disk groups are mounted. Details are at "(:CLSN00100:)"
in "/u01/app/11.2/product/crs_1/log/rac2/agent/ohasd/oraagent_grid/oraagent_grid.log".
2014-05-21 14:28:42.637
[/u01/app/11.2/product/crs_1/bin/oraagent.bin(13997)]CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)"
in "/u01/app/11.2/product/crs_1/log/rac2/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-05-21 14:28:42.919
[/u01/app/11.2/product/crs_1/bin/oraagent.bin(13997)]CRS-5019:
All OCR locations are on ASM disk groups [OCRDG], and none of these disk groups are m