Author |
Message
|
lyntongrice |
Posted: Wed Oct 12, 2011 9:16 am Post subject: zcpCreateMessage - "AMQ6125: An internal WebSphere MQ e |
|
|
Acolyte
Joined: 26 Sep 2010 Posts: 70
|
Hi there,
I have a C program running on Solaris SPARC 8 and I received the following very AD HOC error that I have never seen before.
We run Websphere MQ 6 on the box....
This is what the FFS said:
Code: |
WebSphere MQ First Failure Symptom Report |
| ========================================= |
| |
| Date/Time :- Wednesday October 12 11:44:28 GMT 2011 |
| Host Name :- dczcrm04 (SunOS 5.8) |
| PIDS :- 5724H7203 |
| LVLS :- 6.0.2.3 |
| Product Long Name :- WebSphere MQ for Solaris (SPARC platform) |
| Vendor :- IBM |
| Probe Id :- ZC004062 |
| Application Name :- MQM |
| Component :- zcpCreateMessage |
| SCCS Info :- lib/zc/amqzcpb0.c, 1.70.1.5 |
| Line Number :- 894 |
| Build Date :- Feb 4 2008 |
| CMVC level :- p600-203-080204 |
| Build Type :- IKAP - (Production) |
| UserID :- 00001007 (smq) |
| Program Name :- test |
| Addressing mode :- 64-bit |
| Process :- 11111 |
| Thread :- 1 |
| QueueManager :- QM01 |
| ConnId(1) IPCC :- 260 |
| Last HQC :- 1.0.0-12440 |
| Last HSHMEMB :- 0.0.0-0 |
| Major Errorcode :- OK |
| Minor Errorcode :- OK |
| Probe Type :- INCORROUT |
| Probe Severity :- 4 |
| Probe Description :- AMQ6125: An internal WebSphere MQ error has occurred. |
| FDCSequenceNumber :- 0 | |
Just to give you an idea what the "test" program does...it simple reads messages from a queue and posts them to another application.....and has been working 100% on other system like Linux and Solaris SPARC 10...with no issues.....
Does anyone have any idea what could have caused this? I have see other errors similar to this (http://www-01.ibm.com/support/docview.wss?uid=swg1IZ72115) for Linux systems and am just curious is we need to apply a patch or something?
Thanks for the help
Lynton |
|
Back to top |
|
 |
mqjeff |
Posted: Wed Oct 12, 2011 9:33 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008 Posts: 17447
|
Did the application receive an MQRC coincident with the throwing of the FDC?
Did the MQ error log indicate additional information related to the throwing of the FDC? |
|
Back to top |
|
 |
lyntongrice |
Posted: Wed Oct 12, 2011 9:49 am Post subject: |
|
|
Acolyte
Joined: 26 Sep 2010 Posts: 70
|
Hi there,
Thanks for the quick response, all I saw what that the running application in the console stopped running, and I was alerted from the MQ admin that the following error had occurred. I will try get more details from him tomorrow on this as I have no access to the box....
But any ideas off the top of your head?
Thanks again
Lynton |
|
Back to top |
|
 |
mqjeff |
Posted: Wed Oct 12, 2011 9:59 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008 Posts: 17447
|
lyntongrice wrote: |
any ideas off the top of your head? |
Not for that probe id with that component.
What's the top of the stack trace? |
|
Back to top |
|
 |
lyntongrice |
Posted: Wed Oct 12, 2011 10:01 am Post subject: |
|
|
Acolyte
Joined: 26 Sep 2010 Posts: 70
|
I will need to get you that detail tomorrow.....and will post it to this thread then.....thnx again l-) |
|
Back to top |
|
 |
mvic |
Posted: Wed Oct 12, 2011 4:19 pm Post subject: Re: zcpCreateMessage - "AMQ6125: An internal WebSphere |
|
|
 Jedi
Joined: 09 Mar 2004 Posts: 2080
|
Well, you could try getting to 6.0.2.9 at least, so as to get a fix for IC62566.
Better still, go to 6.0.2.11 just to benefit from the maximum fixes.
Better still, go to 7.0.1.6. |
|
Back to top |
|
 |
lyntongrice |
Posted: Thu Oct 13, 2011 3:17 am Post subject: |
|
|
Acolyte
Joined: 26 Sep 2010 Posts: 70
|
Hi there,
I now have some more of the stack trace....any ideas what could have caused the issue?
Here is the error report again to put all into perspective....and the application starts a transaction, GETs a message from the queue and then either rollsback or commits the transaction.....
Code: |
WebSphere MQ First Failure Symptom Report |
| ========================================= |
| |
| Date/Time :- Wednesday October 12 11:44:28 GMT 2011 |
| Host Name :- dczcrm04 (SunOS 5.8) |
| PIDS :- 5724H7203 |
| LVLS :- 6.0.2.3 |
| Product Long Name :- WebSphere MQ for Solaris (SPARC platform) |
| Vendor :- IBM |
| Probe Id :- ZC004062 |
| Application Name :- MQM |
| Component :- zcpCreateMessage |
| SCCS Info :- lib/zc/amqzcpb0.c, 1.70.1.5 |
| Line Number :- 894 |
| Build Date :- Feb 4 2008 |
| CMVC level :- p600-203-080204 |
| Build Type :- IKAP - (Production) |
| UserID :- 00001007 (smq) |
| Program Name :- test |
| Addressing mode :- 64-bit |
| Process :- 11111 |
| Thread :- 1 |
| QueueManager :- QM01 |
| ConnId(1) IPCC :- 260 |
| Last HQC :- 1.0.0-12440 |
| Last HSHMEMB :- 0.0.0-0 |
| Major Errorcode :- OK |
| Minor Errorcode :- OK |
| Probe Type :- INCORROUT |
| Probe Severity :- 4 |
| Probe Description :- AMQ6125: An internal WebSphere MQ error has occurred. |
| FDCSequenceNumber :- 0 |
MQM Function Stack
MQBACK
zstMQBACK
ziiMQBACK
ziiCreateIPCCMessage
zcpCreateMessage
xcsFFST
MQM Trace History
-------} xcsReleaseThreadMutexSem rc=OK
-------{ xstAttachSharedMemSet
--------{ xstConnectExtent
---------{ xllSpinLockRequest
---------} xllSpinLockRequest rc=OK
---------{ xllSpinLockRelease
---------} xllSpinLockRelease rc=OK
---------{ xcsRequestThreadMutexSem
---------} xcsRequestThreadMutexSem rc=OK
---------{ xcsReleaseThreadMutexSem
---------} xcsReleaseThreadMutexSem rc=OK
--------} xstConnectExtent rc=OK
--------{ xcsGetMem
--------} xcsGetMem rc=OK
--------{ xcsGetMem
--------} xcsGetMem rc=OK
-------} xstAttachSharedMemSet rc=OK
-------{ xcsReleaseThreadMutexSem
-------} xcsReleaseThreadMutexSem rc=OK
------} xcsConnectSharedMemSet rc=OK
------{ xcsRegisterDestructor
------} xcsRegisterDestructor rc=OK
-----} zcpAttachPipe rc=OK
----} ziiConnectToAgent rc=OK
----{ ziiStartAllPlugServices
-----{ xcsConnectSharedMemSet
------{ xllSpinLockRequest
------} xllSpinLockRequest rc=OK
------{ xllSpinLockRelease
------} xllSpinLockRelease rc=OK
------{ xcsRequestThreadMutexSem
------} xcsRequestThreadMutexSem rc=OK
------{ xcsRequestThreadMutexSem
------} xcsRequestThreadMutexSem rc=OK
------{ xcsReleaseThreadMutexSem
------} xcsReleaseThreadMutexSem rc=OK
------{ xstConnectSubSet
-------{ xcsGetMem
-------} xcsGetMem rc=OK
-------{ xcsGetMem
-------} xcsGetMem rc=OK
-------{ xcsRequestThreadMutexSem
-------} xcsRequestThreadMutexSem rc=OK
-------{ xcsReleaseThreadMutexSem
-------} xcsReleaseThreadMutexSem rc=OK
-------{ xcsRequestThreadMutexSem
-------} xcsRequestThreadMutexSem rc=OK
-------{ xcsReleaseThreadMutexSem
-------} xcsReleaseThreadMutexSem rc=OK
------} xstConnectSubSet rc=OK
------{ xcsReleaseThreadMutexSem
------} xcsReleaseThreadMutexSem rc=OK
-----} xcsConnectSharedMemSet rc=OK
----} ziiStartAllPlugServices rc=OK
----{ ziiCreateIPCCMessage
-----{ zcpCreateMessage
-----} zcpCreateMessage rc=OK
----} ziiCreateIPCCMessage rc=OK
----{ ziiSendReceiveAgent
-----{ zcpSendOnPipe
------{ xcsResetEventSem
------} xcsResetEventSem rc=OK
------{ xcsPostEventSem
------} xcsPostEventSem rc=OK
-----} zcpSendOnPipe rc=OK
-----{ zcpReceiveOnPipe
------{ xcsWaitEventSem
------} xcsWaitEventSem rc=OK
-----} zcpReceiveOnPipe rc=OK
----} ziiSendReceiveAgent rc=OK
----{ zcpDeleteMessage
----} zcpDeleteMessage rc=OK
---} ziiMQCONN rc=OK
---{ zutDisconnectConfig
----{ xcsFreeMem
----} xcsFreeMem rc=OK
---} zutDisconnectConfig rc=OK
--} zstMQConnect rc=OK
-} zstMQCONNX rc=OK
} MQCONNX rc=OK
{ MQCONNX
-{ zstMQCONNX
--{ xcsInitialize
---{ xcsRequestThreadMutexSem
---} xcsRequestThreadMutexSem rc=OK
---{ xcsReleaseThreadMutexSem
---} xcsReleaseThreadMutexSem rc=OK
--} xcsInitialize rc=OK
--{ zstMQConnect
---{ zstMQConnect_CheckParameters
---} zstMQConnect_CheckParameters rc=OK
---{ zutBlankPad
---} zutBlankPad rc=OK
---{ zutLockLocalThreads
----{ xcsRequestThreadMutexSem
----} xcsRequestThreadMutexSem rc=OK
---} zutLockLocalThreads rc=OK
---{ zutIsItBlank
---} zutIsItBlank rc=OK
---{ zutCheckQMName
----{ zutCheckValidName
----} zutCheckValidName rc=OK
---} zutCheckQMName rc=OK
---{ zutCvtMQName2Str
---} zutCvtMQName2Str rc=OK
---{ zstGetPCDbyTID
---} zstGetPCDbyTID rc=OK
---{ zutUnlockLocalThreads
----{ xcsReleaseThreadMutexSem
----} xcsReleaseThreadMutexSem rc=OK
---} zutUnlockLocalThreads rc=OK
--} zstMQConnect rc=lrcW_ALREADY_CONNECTED
-} zstMQCONNX rc=lrcW_ALREADY_CONNECTED
} MQCONNX rc=lrcW_ALREADY_CONNECTED
{ MQOPEN
-{ zstMQOPEN
--{ zstVerifyPCD
--} zstVerifyPCD rc=OK
--{ zstCheckODAddressability
---{ xcsCheckPointer
---} xcsCheckPointer rc=OK
--} zstCheckODAddressability rc=OK
--{ ziiMQOPEN
---{ ziiCreateIPCCMessage
----{ zcpCreateMessage
----} zcpCreateMessage rc=OK
---} ziiCreateIPCCMessage rc=OK
---{ ziiSendReceiveAgent
----{ zcpSendOnPipe
-----{ xcsResetEventSem
-----} xcsResetEventSem rc=OK
-----{ xcsPostEventSem
-----} xcsPostEventSem rc=OK
----} zcpSendOnPipe rc=OK
----{ zcpReceiveOnPipe
-----{ xcsWaitEventSem
-----} xcsWaitEventSem rc=OK
----} zcpReceiveOnPipe rc=OK
---} ziiSendReceiveAgent rc=OK
---{ zcpDeleteMessage
---} zcpDeleteMessage rc=OK
--} ziiMQOPEN rc=OK
-} zstMQOPEN rc=OK
} MQOPEN rc=OK
{ MQBEGIN
-{ zstMQBEGIN
--{ zstVerifyPCD
--} zstVerifyPCD rc=OK
--{ zstSetMQModel
--} zstSetMQModel rc=OK
--{ xcsCheckPointer
--} xcsCheckPointer rc=OK
--{ ziiMQBEGIN
---{ ztmBeginInitialise
---} ztmBeginInitialise rc=zrcM_W_NO_RESOURCE_MGRS
---{ ziiCreateIPCCMessage
----{ zcpCreateMessage
----} zcpCreateMessage rc=OK
---} ziiCreateIPCCMessage rc=OK
---{ ziiSendReceiveAgent
----{ zcpSendOnPipe
-----{ xcsResetEventSem
-----} xcsResetEventSem rc=OK
-----{ xcsPostEventSem
-----} xcsPostEventSem rc=OK
----} zcpSendOnPipe rc=OK
----{ zcpReceiveOnPipe
-----{ xcsWaitEventSem
-----} xcsWaitEventSem rc=OK
----} zcpReceiveOnPipe rc=OK
---} ziiSendReceiveAgent rc=lrcW_NO_EXTERNAL_PARTICIPANTS
---{ zcpDeleteMessage
---} zcpDeleteMessage rc=OK
---{ ztmAssociateParticipants
---} ztmAssociateParticipants rc=zrcM_W_NO_RESOURCE_MGRS
--} ziiMQBEGIN rc=zrcM_W_NO_RESOURCE_MGRS
-} zstMQBEGIN rc=lrcW_NO_EXTERNAL_PARTICIPANTS
} MQBEGIN rc=lrcW_NO_EXTERNAL_PARTICIPANTS
{ MQGET
-{ zstMQGET
--{ zstVerifyPCD
--} zstVerifyPCD rc=OK
--{ zstMQGET_CheckParms
--} zstMQGET_CheckParms rc=OK
--{ ziiMQGET
---{ ziiCreateIPCCMessage
----{ zcpCreateMessage
----} zcpCreateMessage rc=OK
---} ziiCreateIPCCMessage rc=OK
---{ ziiSendReceiveAgent
----{ zcpSendOnPipe
-----{ xcsResetEventSem
-----} xcsResetEventSem rc=OK
-----{ xcsPostEventSem
-----} xcsPostEventSem rc=OK
----} zcpSendOnPipe rc=OK
----{ zcpReceiveOnPipe
-----{ xcsWaitEventSem
-----} xcsWaitEventSem rc=OK
----} zcpReceiveOnPipe rc=OK
---} ziiSendReceiveAgent rc=arcW_TRUNCATED_MSG_FAILED
---{ zcpDeleteMessage
---} zcpDeleteMessage rc=OK
--} ziiMQGET rc=OK
-} zstMQGET rc=arcW_TRUNCATED_MSG_FAILED
} MQGET rc=arcW_TRUNCATED_MSG_FAILED
{ MQGET
-{ zstMQGET
--{ zstVerifyPCD
--} zstVerifyPCD rc=OK
--{ zstMQGET_CheckParms
--} zstMQGET_CheckParms rc=OK
--{ ziiMQGET
---{ ziiCreateIPCCMessage
----{ zcpCreateMessage
----} zcpCreateMessage rc=OK
---} ziiCreateIPCCMessage rc=OK
---{ ziiSendReceiveAgent
----{ zcpSendOnPipe
-----{ xcsResetEventSem
-----} xcsResetEventSem rc=OK
-----{ xcsPostEventSem
-----} xcsPostEventSem rc=OK
----} zcpSendOnPipe rc=OK
----{ zcpReceiveOnPipe
-----{ xcsWaitEventSem
-----} xcsWaitEventSem rc=OK
----} zcpReceiveOnPipe rc=OK
---} ziiSendReceiveAgent rc=OK
---{ zcpDeleteMessage
---} zcpDeleteMessage rc=OK
--} ziiMQGET rc=OK
--{ vpiConvertData
--} vpiConvertData rc=OK
-} zstMQGET rc=OK
} MQGET rc=OK
{ MQBACK
-{ zstMQBACK
--{ zstVerifyPCD
--} zstVerifyPCD rc=OK
--{ ztmDissociateParticipants
--} ztmDissociateParticipants rc=zrcM_W_NO_RESOURCE_MGRS
--{ ziiMQBACK
---{ ziiCreateIPCCMessage
----{ zcpCreateMessage
-----{ xcsBuildDumpPtr
------{ xcsGetMem
------} xcsGetMem rc=OK
-----} xcsBuildDumpPtr rc=OK
-----{ xcsFFST |
|
Back to top |
|
 |
mqjeff |
Posted: Thu Oct 13, 2011 5:14 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008 Posts: 17447
|
So it failed while trying to back out a message...
Does it also fail when you try to commit?
An issue with the file system maybe?
Anything in the AMQERR log that sheds more light? Or just a report of an FDC thrown? |
|
Back to top |
|
 |
mvic |
Posted: Thu Oct 13, 2011 5:54 am Post subject: |
|
|
 Jedi
Joined: 09 Mar 2004 Posts: 2080
|
lyntongrice wrote: |
any ideas what could have caused the issue? |
I had an idea - I posted it in my previous post on this thread. |
|
Back to top |
|
 |
bruce2359 |
Posted: Thu Oct 13, 2011 5:58 am Post subject: |
|
|
 Poobah
Joined: 05 Jan 2008 Posts: 9472 Location: US: west coast, almost. Otherwise, enroute.
|
Has this qmgr been running (production) without error until recently? If so, what has changed? _________________ I like deadlines. I like to wave as they pass by.
ב''ה
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live. |
|
Back to top |
|
 |
lyntongrice |
Posted: Thu Oct 13, 2011 8:53 am Post subject: |
|
|
Acolyte
Joined: 26 Sep 2010 Posts: 70
|
Hi there,
The commit works file.....and in fact we sent 30000 messages over the C code today with no issues at all...
No other real error stuff in the AMQ err....
Perhaps we just need a higher version to be installed...
The queue manager has been running for ages...very strange...
Thanks anyway  |
|
Back to top |
|
 |
|