FAILEDTOREADMORRORSIDE1(二)
ng messages.
We are still trying to get information from customer to understand how that
session is being killed(not sure could be from database end --or application
end).
Customer confirmed the following :
---------------
1.) Are they in-house scripts scheduled in database/os which are going to
kill the inactive sessions at database/os level
-- There are not any scripts scheduled to kill sessions. When this error
starts happening, we kill the process manually.
2.) Is this happening only during specific intervals.
-- I cannot see a pattern as to when it is happening. It seems random.
3.) Please confirm - the ASM instance is functional (one can connect to it,
run queries on the various v$asm% views, like: v$asm_diskgroup, v$asm_disk)
-- Yes, ASM is functional during the error. All other sessions continue to
run without errors.
---------------
WORKAROUND:
-----------
As long as that session/process is killed, the error messages stops.
RELATED BUGS:
-------------
bug.10051315 and bug.10055063
REPRODUCIBILITY:
----------------
Its random.
TEST CASE:
----------
NA
STACK TRACE:
------------
Function List (to Full stack) (to Summary stack)
ksedsts <- ksdxfstk <- ksdxcb <- sspuser <- f0
<- sdbgrfucf_close_file <- sdbgrfcf_close_file <- dbgrlWriteTextOnly
<- dbgrlWriteAlertDetail_int <- dbgrlWriteAlertDetail
<- dbgrlWriteAlertText <- dbkrlWriteAlertText <- dbkrlPril <- ksdfmw
<- ksdwrt
<- kfioCompleteIO <- kfioWaitIO <- kfioRequestPriv <- kfioRequest
<- ksfd_kfioRequest
<- ksfd_osmio <- ksfd_io <- ksfdread <- kcfrbd1 <- kcbzib
<- kcbgcur <- kturRollbackToSavepoint <- ktcrsp1 <- ksures <-
ksuxds
<- kssdel <- kssdch <- ksudlp <- opidcl <- opidrv
<- sou2o <- opimai_real <- ssthrdmain <- main
SUPPORTING INFORMATION:
-----------------------
Customer’s Management name: Al Fischer
Customer's Management 24x7 contact number: +1-616-648-6244
Customer’s Management email: al.fischer@amway.com
Primary Customer Email address: eric.lai
Secondary Contact Name: George Zhang
Secondary Contact Email: (EMAIL ADDRESS) george.zhang@alticor.com
24 HOUR CONTACT INFORMATION FOR P1 BUGS:
----------------------------------------
DIAL-IN INFORMATION:
--------------------
IMPACT DATE:
------------
" system at risk of crashing as alert logging is filling up; causing forms to
hang at Call Center"
*** 12/22/10 03:57 am ***
*** 12/22/10 04:20 am ***
*** 12/22/10 04:21 am ***
*** 12/22/10 04:21 am *** (CHG: Sta->
16)
*** 12/22/10 04:33 am ***
*** 12/22/10 05:35 am ***
*** 12/22/10 06:08 am ***
*** 12/22/10 06:09 am ***
*** 12/22/10 06:10 am ***
*** 12/22/10 08:06 am ***
*** 12/22/10 11:25 am ***
*** 12/22/10 11:25 am ***
*** 12/22/10 01:47 pm *** (CHG: Sta->10)
*** 12/22/10 01:47 pm ***
*** 12/22/10 07:46 pm ***
*** 12/22/10 07:58 pm ***
File versions form GI & RDBMS homes.
Below is the info from GI_HOME.
[usax02w] $ ar -t -v -X32_64 $GI_HOME/lib/libserver11.a kfd.o
rw-rw-rw- 10000/1026 393236 Nov 15 13:29 2010 kfd.o
[usax02w] $ ar -t -v -X32_64 $GI_HOME/lib/libserver11.a kfdp.o
rw-rw-rw- 10000/1026 271741 Nov 15 13:29 2010 kfdp.o
[usax02w] $ ar -t -v -X32_64 $GI_HOME/lib/libserver11.a kfkio.o
rw-rw-rw- 10000/1026 103575 Nov 15 13:29 2010 kfkio.o
[usax02w] $ ar -t -v -X32_64 $GI_HOME/lib/libserver11.a kfksubs.o
rw-rw-rw- 10000/1026 166215 Nov 15 13:29 2010 kfksubs.o
Below is the info from RDBMS_HOME
[usax02w] $ echo $ORACLE_HOME
/u01/apps/oracle/product/11.2.0/db_1
[usax02w] $ ar -t -v -X32_64 $ORACLE_HOME/lib/libserver11.a kfd.o
rw-rw-rw- 10000/1026 393236 Nov 15 13:29 2010 kfd.o
[usax02w] $ ar -t -v -X32_64 $ORACLE_HOME/lib/libserver11.a kfdp.o
rw-rw-rw- 10000/1026 271741 Nov 15 13:29 2010 kfdp.o
[usax02w] $ ar -t -v -X32_64 $ORACLE_HOME/lib/libserver11.a kfkio.o
rw-rw-rw- 10000/1026 103575 Nov 15 13:29 2010 kfkio.o
[usax02w] $ ar -t -v -X32_64 $ORACLE_HOME/lib/libserver11.a kfksubs.o
rw-rw-rw- 10000/1026 166215 Nov 15 13:29 2010 kfksubs.o
Regards,
Prathap
*** 12/22/10 08:01 pm *** (CHG: Sta->16)
*** 12/22/10 08:25 pm ***
*** 12/23/10 01:48 am ***
*** 12/23/10 02:46 am ***
*** 12/23/10 06:25 am *** (CHG: Sta->11)
*** 12/23/10 06:25 am ***
*** 12/23/10 06:26 am ***
*** 12/23/10 06:26 am ***
*** 12/24/10 01:43 am ***
*** 12/24/10 01:43 am ***
*** 12/27/10 11:33 am ***
*** 12/27/10 11:45 am ***
*** 12/27/10 11:51 am ***
*** 12/27/10 12:22 pm *** ESCALATED
*** 12/27/10 12:22 pm ***
*** 12/27/10 12:29 pm ***
*** 12/28/10 12:42 am *** (CHG: Sta->30)
*** 12/28/10 12:42 am ***
*** 12/28/10 05:00 am *** (CHG: S