| |
|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
  |
|
| MQ 6.0.2.5 Solaris Sparc Probe ID AQ200020 |
« View previous topic :: View next topic » |
| Author |
Message
|
| LouML |
 Posted: Tue Jan 13, 2009 5:48 am Post subject: MQ 6.0.2.5 Solaris Sparc Probe ID AQ200020 |
 |
|
Partisan
Joined: 10 Nov 2005
Posts: 305
Location: Jersey City, NJ / Bethpage, NY
|
We've been running MQ 6.0.2.5 on a Solaris 5.9 Sparc machine since November and things were fine until last week, when we started to see the FDC with probe Id AQ200020 (see below).
The queue manager seems to be running fine and so far there are no signs of any problems. These FDC's started sround Tues-Wed or so. The server did crash last Friday but Unix support has not determined that the crash was in any way related to MQ.
Opened a PMR and was told that I'm the first person to call about this probe Id. It's been forwarded to level 3 support with trace files.
Has anyone here seen this? If not, I'll keep you all posted when I hear back from IBM.
| Code: |
+-----------------------------------------------------------------------------+
| |
| WebSphere MQ First Failure Symptom Report |
| ========================================= |
| |
| Date/Time :- Monday January 12 11:24:16 EST 2009 |
| Host Name :- prodmq (SunOS 5.9) |
| PIDS :- 5724H7203 |
| LVLS :- 6.0.2.5 |
| Product Long Name :- WebSphere MQ for Solaris (SPARC platform) |
| Vendor :- IBM |
| Probe Id :- AQ200020 |
| Application Name :- MQM |
| Component :- aqhReadOldestMessage |
| SCCS Info :- lib/lqm/amqaqhoa.c, 1.94.1.6 |
| Line Number :- 1863 |
| Build Date :- Sep 24 2008 |
| CMVC level :- p600-205-080922 |
| Build Type :- IKAP - (Production) |
| UserID :- 00001600 (mqm) |
| Program Name :- amqzlaa0_nd |
| Addressing mode :- 64-bit |
| Process :- 521 |
| Thread :- 6 |
| QueueManager :- QM!MQPROD!01 |
| ConnId(1) IPCC :- 20 |
| ConnId(2) QM :- 28 |
| Last HQC :- 2.3.3-4740344 |
| Last HSHMEMB :- 1.2.2-92744 |
| Major Errorcode :- STOP |
| Minor Errorcode :- OK |
| Probe Type :- HALT6109 |
| Probe Severity :- 1 |
| Probe Description :- AMQ6109: An internal WebSphere MQ error has occurred. |
| FDCSequenceNumber :- 1188 |
| |
+-----------------------------------------------------------------------------+
MQM Function Stack
zlaMainThread
zlaProcessMessage
zlaProcessSPIRequest
zlaSPIInquireQueueStatus
zsqSPIInquireQueueStatus
kqiInquireQueueStatus
apiFindOldestMessage
aqmFindOldestMessage
aqhReadOldestMessage
xcsFFST
MQM Trace History
----------} xcsRequestMutexSem rc=OK
---------} apiLockExclusive rc=OK
---------{ kqiRemoveFromWaiterChain
---------} kqiRemoveFromWaiterChain rc=OK
---------{ kpiUpdateMonQStats
---------} kpiUpdateMonQStats rc=OK
---------{ apiUnlockExclusive
----------{ xcsReleaseMutexSem
----------} xcsReleaseMutexSem rc=OK
---------} apiUnlockExclusive rc=OK
---------{ xcsPostEventSem
---------} xcsPostEventSem rc=OK
--------} kqiTickleEarly rc=OK
-------} kqiPutMsgSegments rc=OK
-------{ kqiPostPutMsg
-------} kqiPostPutMsg rc=OK
-------{ kqiUpdatePutGroupSegState
-------} kqiUpdatePutGroupSegState rc=OK
------} kqiPutIt rc=OK
-----} kpiMQPUT rc=OK
-----{ zsqUpdateApplMsgDesc
-----} zsqUpdateApplMsgDesc rc=OK
----} zsqMQPUT rc=OK
---} zlaMQPUT rc=OK
---{ zcpDeleteMessage
---} zcpDeleteMessage rc=OK
---{ zcpSendOnPipe
----{ xcsResetEventSem
----} xcsResetEventSem rc=OK
----{ xcsPostEventSem
----} xcsPostEventSem rc=OK
---} zcpSendOnPipe rc=OK
--} zlaProcessMQIRequest rc=OK
-} zlaProcessMessage rc=OK
-{ zcpReceiveOnPipe
--{ xcsWaitEventSem
--} xcsWaitEventSem rc=OK
-} zcpReceiveOnPipe rc=OK
-{ zlaCheckStatus
-} zlaCheckStatus rc=OK
-{ zlaProcessMessage
--{ zlaProcessSPIRequest
---{ zlaSPIInquireQueueStatus
----{ zcpCreateMessage
----} zcpCreateMessage rc=OK
----{ zsqSPIInquireQueueStatus
-----{ zsqVerifyPCD
-----} zsqVerifyPCD rc=OK
-----{ kqiInquireQueueStatus
------{ apiEnquireObject
-------{ aouLockObjectCatalogue
--------{ xcsRequestMutexSem
--------} xcsRequestMutexSem rc=OK
-------} aouLockObjectCatalogue rc=OK
-------{ aocEnquireObject
--------{ aouLocateEntry
---------{ aotLocateEntryByName
----------{ aouHash
----------} aouHash rc=OK
---------} aotLocateEntryByName rc=OK
--------} aouLocateEntry rc=OK
--------{ aouUnlockObjectCatalogue
---------{ xcsReleaseMutexSem
---------} xcsReleaseMutexSem rc=OK
--------} aouUnlockObjectCatalogue rc=OK
--------{ xcsRequestMutexSem
--------} xcsRequestMutexSem rc=OK
-------} aocEnquireObject rc=OK
------} apiEnquireObject rc=OK
------{ apiFindOldestMessage
-------{ aqmFindOldestMessage
--------{ aqhReadOldestMessage
--------} aqhReadOldestMessage rc=OK
--------{ aqmCloseQueue
---------{ aqpClose
----------{ adhClose
-----------{ aduLocateFileCtl
-----------} aduLocateFileCtl rc=arcE_OBJECT_MISSING
----------} adhClose rc=OK
---------} aqpClose rc=OK
--------} aqmCloseQueue rc=OK
-------} aqmFindOldestMessage rc=OK
------} apiFindOldestMessage rc=OK
------{ apiUnlockQHandle
-------{ xcsReleaseMutexSem
-------} xcsReleaseMutexSem rc=OK
------} apiUnlockQHandle rc=OK
-----} kqiInquireQueueStatus rc=OK
----} zsqSPIInquireQueueStatus rc=OK
---} zlaSPIInquireQueueStatus rc=OK
---{ zcpDeleteMessage
---} zcpDeleteMessage rc=OK
---{ zcpSendOnPipe
----{ xcsResetEventSem
----} xcsResetEventSem rc=OK
----{ xcsPostEventSem
----} xcsPostEventSem rc=OK
---} zcpSendOnPipe rc=OK
--} zlaProcessSPIRequest rc=OK
-} zlaProcessMessage rc=OK
-{ zcpReceiveOnPipe
--{ xcsWaitEventSem
--} xcsWaitEventSem rc=OK
-} zcpReceiveOnPipe rc=OK
-{ zlaCheckStatus
-} zlaCheckStatus rc=OK
-{ zlaProcessMessage
--{ zlaProcessMQIRequest
---{ zlaMQPUT
----{ zcpCreateMessage
----} zcpCreateMessage rc=OK
----{ zsqMQPUT
-----{ zsqVerifyQueueObj
------{ zsqVerifyObj
------} zsqVerifyObj rc=OK
-----} zsqVerifyQueueObj rc=OK
-----{ zsqVerMsgDescForPut
-----} zsqVerMsgDescForPut rc=OK
-----{ zsqVerOptForPutPut1
------{ zsqVerifyQueueObj
-------{ zsqVerifyObj
-------} zsqVerifyObj rc=OK
------} zsqVerifyQueueObj rc=OK
-----} zsqVerOptForPutPut1 rc=OK
-----{ zsqSetKernelPutParams
-----} zsqSetKernelPutParams rc=OK
-----{ kpiMQPUT
------{ kqiPutIt
-------{ kqiVerOptForPut
-------} kqiVerOptForPut rc=OK
-------{ kqiInitForPutPutList
--------{ xcsQueryMTimeFn
--------} xcsQueryMTimeFn rc=OK
--------{ kqiSetContext
---------{ xcsInqEstablishedPutDateTime
---------} xcsInqEstablishedPutDateTime rc=OK
--------} kqiSetContext rc=OK
-------} kqiInitForPutPutList rc=OK
-------{ kqiVerMsgForPutPutList
-------} kqiVerMsgForPutPutList rc=OK
-------{ kqiSetMsgID
--------{ xcsGetUniqueTag
--------} xcsGetUniqueTag rc=OK
Data: 0x49698c24 0x2017cc1b
-------} kqiSetMsgID rc=OK
-------{ kqiQPathCheckAndSet
-------} kqiQPathCheckAndSet rc=OK
-------{ kqiValidatePutGroupSegInfo
-------} kqiValidatePutGroupSegInfo rc=OK
-------{ kqiPutMsgSegments
--------{ kqiTickleEarly
---------{ apiLockExclusive
----------{ xcsRequestMutexSem
----------} xcsRequestMutexSem rc=OK
---------} apiLockExclusive rc=OK
---------{ kqiRemoveFromWaiterChain
---------} kqiRemoveFromWaiterChain rc=OK
---------{ kpiUpdateMonQStats
---------} kpiUpdateMonQStats rc=OK
---------{ apiUnlockExclusive
----------{ xcsReleaseMutexSem
----------} xcsReleaseMutexSem rc=OK
---------} apiUnlockExclusive rc=OK
---------{ xcsPostEventSem
---------} xcsPostEventSem rc=OK
--------} kqiTickleEarly rc=OK
-------} kqiPutMsgSegments rc=OK
-------{ kqiPostPutMsg
-------} kqiPostPutMsg rc=OK
-------{ kqiUpdatePutGroupSegState
-------} kqiUpdatePutGroupSegState rc=OK
------} kqiPutIt rc=OK
-----} kpiMQPUT rc=OK
-----{ zsqUpdateApplMsgDesc
-----} zsqUpdateApplMsgDesc rc=OK
----} zsqMQPUT rc=OK
---} zlaMQPUT rc=OK
---{ zcpDeleteMessage
---} zcpDeleteMessage rc=OK
---{ zcpSendOnPipe
----{ xcsResetEventSem
----} xcsResetEventSem rc=OK
----{ xcsPostEventSem
----} xcsPostEventSem rc=OK
---} zcpSendOnPipe rc=OK
--} zlaProcessMQIRequest rc=OK
-} zlaProcessMessage rc=OK
-{ zcpReceiveOnPipe
--{ xcsWaitEventSem
--} xcsWaitEventSem rc=OK
-} zcpReceiveOnPipe rc=OK
-{ zlaCheckStatus
-} zlaCheckStatus rc=OK
-{ zlaProcessMessage
--{ zlaProcessSPIRequest
---{ zlaSPIInquireQueueStatus
----{ zcpCreateMessage
----} zcpCreateMessage rc=OK
----{ zsqSPIInquireQueueStatus
-----{ zsqVerifyPCD
-----} zsqVerifyPCD rc=OK
-----{ kqiInquireQueueStatus
------{ apiEnquireObject
-------{ aouLockObjectCatalogue
--------{ xcsRequestMutexSem
--------} xcsRequestMutexSem rc=OK
-------} aouLockObjectCatalogue rc=OK
-------{ aocEnquireObject
--------{ aouLocateEntry
---------{ aotLocateEntryByName
----------{ aouHash
----------} aouHash rc=OK
---------} aotLocateEntryByName rc=OK
--------} aouLocateEntry rc=OK
--------{ aouUnlockObjectCatalogue
---------{ xcsReleaseMutexSem
---------} xcsReleaseMutexSem rc=OK
--------} aouUnlockObjectCatalogue rc=OK
--------{ xcsRequestMutexSem
--------} xcsRequestMutexSem rc=OK
-------} aocEnquireObject rc=OK
------} apiEnquireObject rc=OK
------{ apiFindOldestMessage
-------{ aqmFindOldestMessage
--------{ aqhReadOldestMessage
---------{ aqpReadData
----------{ aqpOpen
-----------{ adhOpen
------------{ aduLocateFileCtl
------------} aduLocateFileCtl rc=arcE_OBJECT_MISSING
------------{ aduAllocFileCtl
------------} aduAllocFileCtl rc=OK
------------{ aduBuildOSName
------------} aduBuildOSName rc=OK
------------{ adiOpenFile
------------} adiOpenFile rc=OK
-----------} adhOpen rc=OK
----------} aqpOpen rc=OK
----------{ adhRead
-----------{ adiReadFile
-----------} adiReadFile rc=OK
----------} adhRead rc=OK
---------} aqpReadData rc=OK
---------{ xcsBuildDumpPtr
----------{ xcsGetMem
----------} xcsGetMem rc=OK
---------} xcsBuildDumpPtr rc=OK
---------{ xcsFFST
ffffffff7943e230 FFFFFFFF 7943E198 ....yC
ffffffff7943e240 00000000 00000000 00000001 0016ECE8 ..............
ffffffff7943e250 FFFFFFFF 7A414290 FFFFFFFF ....zAB....
Process Control Block
10015aba0 58494850 00000B08 00000209 00000000 XIHP............
10015abb0 00000FEE 00000000 00000001 00166570 .............ep
10015abc0 00000001 005670C0 00000000 00000000 .....Vp........
10015abd0 00000000 00000000 00000001 00000001 ................
10015abe0 00000000 00000000 FFFFFFFF 7C600000 ............|`..
10015abf0 00000000 00000000 00000000 00000000 ................
10015ac00 to 10015afe0 suppressed, 63 lines same as above
10015aff0 00000000 FFFFFFFF FFFFFFFF 00000000 ................
10015b000 00000000 00000000 000004A5 FFFFFFFE ..............
10015b010 00000001 00000000 00000000 00000000 ................
10015b020 00000018 00000000 FFFFFFFF 7DF60140 ............}..@
10015b030 00000000 00000000 00000000 00000000 ................
10015b040 00000018 00000000 FFFFFFFF 7DF60140 ............}..@
10015b050 00000000 00000000 00000000 00000000 ................
10015b060 00000018 00000000 FFFFFFFF 7DF60140 ............}..@
10015b070 00000000 00000000 00000000 00000000 ................
10015b080 to 10015b090 suppressed, 2 lines same as above
10015b0a0 00000018 00000000 FFFFFFFF 7DF60140 ............}..@
10015b0b0 00000000 00000000 00000000 00000000 ................
10015b0c0 00000018 00000000 FFFFFFFF 7DF60140 ............}..@
10015b0d0 00000000 00000000 00000000 00000000 ................
10015b0e0 00000000 00000001 00000000 00000000 ................
10015b0f0 00000000 09B56000 00000000 00000000 .....`.........
10015b100 00000000 00000000 00000000 00000000 ................
10015b110 to 10015b120 suppressed, 2 lines same as above
10015b130 00000000 09B56000 00000000 00000000 .....`.........
10015b140 00000000 00000000 00000000 00000000 ................
10015b150 to 10015b160 suppressed, 2 lines same as above
10015b170 00000000 09B56000 00000000 00000000 .....`.........
10015b180 00000000 00000000 00000000 00000000 ................
10015b190 00000000 09B56000 00000000 00000000 .....`.........
10015b1a0 00000000 00000000 00000000 00000000 ................
10015b1b0 00000002 00000000 00000001 0015E7B8 ..............
10015b1c0 00000000 00000000 00000001 00000000 ................
10015b1d0 00000001 0015B870 00000001 0015B8B0 ......p......
10015b1e0 00000000 00000000 00000000 00004356 ..............CV
10015b1f0 00000000 00000000 00000000 00000001 ................
10015b200 00000001 00000000 00000000 00000000 ................
10015b210 00000000 00000000 00000000 00000000 ................
10015b220 to 10015b230 suppressed, 2 lines same as above
10015b240 00000000 00000000 00000001 0015B830 ..............0
10015b250 00000000 00000000 00000000 00000000 ................
10015b260 to 10015b680 suppressed, 67 lines same as above
10015b690 00000000 00000640 00000640 00000000 .......@...@....
10015b6a0 00000000 00000000 ........
Common Services Control Block
10015e800 58494820 00000960 00000001 00000042 XIH ...`.......B
10015e810 00000000 00000000 6D716D00 00000000 ........mqm.....
10015e820 00000000 00000000 00000640 00000001 ...........@....
10015e830 00000333 00000000 00000000 00000000 ...3............
10015e840 00000001 00167498 00005984 00000000 ......t..Y
....
10015e850 00000000 00000000 00000000 00000000 ................
10015e860 00000001 0015FB10 000000C4 00000000 ..............
10015e870 00000001 0015FC00 0000003C 00000000 ..........<....
10015e880 00000001 0015FAA8 00000000 00000000 ..............
10015e890 00000003 2F766172 2F6D716D 00000000 ..../var/mqm....
10015e8a0 00000000 00000000 00000000 00000000 ................
10015e8b0 to 10015f0c0 suppressed, 130 lines same as above
10015f0d0 00000001 00162418 00000001 0015F188 ......$.......
10015f0e0 00000000 00000000 00000000 00000000 ................
10015f0f0 to 10015f140 suppressed, 6 lines same as above
10015f150 00000000 00000000 00000001 00167498 ..............t
Thread Control Block
10016dd60 58494854 00000F00 00000006 00000000 XIHT............
10016dd70 00000001 00171210 00000001 0016CE50 ..............P
10016dd80 00000000 00000000 00000000 00000000 ................
10016dd90 to 10016dde0 suppressed, 6 lines same as above
10016ddf0 00000000 00000000 00000001 00000000 ................
10016de00 00000001 00000003 00000001 00000000 ................
10016de10 00000000 00000000 FFFFFFFF 7943B781 ............yC
10016de20 FFFFFFFF 7DFE0180 FFFFFFFF 7943B8B1 ....}.....yC
10016de30 FFFFFFFF 7DF6F3D4 00000000 00000000 ....}.........
10016de40 00000000 00000000 00000000 00000000 ................
10016de50 to 10016de60 suppressed, 2 lines same as above
10016de70 00000000 00000000 FFFFFFFF 7943EA61 ............yCa
10016de80 00000001 0000C514 FFFFFFFF 7943EFE1 ...........yC
10016de90 FFFFFFFF 7DF9CE20 00000000 00000000 ....} ........
10016dea0 00000000 00000000 00000000 00000000 ................
10016deb0 00000000 00000000 FFFFFFFF 7D8C01F0 ............}.
10016dec0 00000000 00000000 00000000 00000000 ................
10016ded0 00000000 00000004 FFFFFFFF 7943D741 ............yCA
10016dee0 FFFFFFFF 7ED014F0 FFFFFFFF 7943DA41 ....~.....yCA
10016def0 FFFFFFFF 7ED306F8 00000052 00000000 ....~....R....
10016df00 00000000 33363934 46393933 46464531 ....3694F993FFE1
10016df10 36363736 00000000 00000000 33363934 6676........3694
10016df20 46393933 46464531 FFFFFFFF 7943E433 F993FFE1....yC3
10016df30 00000000 00000000 00000000 00000000 ................
10016df40 to 10016e1c0 suppressed, 41 lines same as above
10016e1d0 00000015 0000001D 00000000 00000000 ................
10016e1e0 00000000 00000000 00000000 00000000 ................
10016e1f0 00000000 00000000 00000001 00000000 ................
10016e200 00000000 49698C24 2017CC1B 00000006 ....Ii$ ......
10016e210 00000001 0015BBB0 00000000 00000000 ..............
10016e220 00000000 00000000 7E27F857 00003FF0 ........~'W..?
10016e230 00000000 00000000 00000000 00000000 ................
10016e240 00000000 00000000 00000000 00000000 ................
10016e250 00000001 00000000 00000000 00000000 ................
10016e260 FFFFFFFF 7AC02948 FFFFFFFF 7B802C88 ....z)H....{,
10016e270 00000000 00000000 00000000 00000000 ................
10016e280 00000000 00000000 00000000 00000000 ................
10016e290 496B6EB0 00023876 00000000 00000000 Ikn..8v........
10016e2a0 00000000 00000000 00000000 00000000 ................
10016e2b0 00000000 00000000 00000000 00000000 ................
10016e2c0 00000000 00000000 00000004 00000001 ................
10016e2d0 00000000 00000000 FFFFFFFF 7E1A7CC8 ............~.|
10016e2e0 00000001 00162418 00000001 0015F188 ......$.......
10016e2f0 00000000 00000000 00000000 00000000 ................
10016e300 00000000 00000000 00000000 00000000 ................
10016e310 00000000 00000001 00000002 00000000 ................
10016e320 00000000 00000000 00000000 00000000 ................
10016e330 to 10016e380 suppressed, 6 lines same as above
10016e390 20000000 00000000 000664A0 40000000 .........d@...
10016e3a0 00000000 00070B20 00000000 00000000 ....... ........
10016e3b0 00000000 00000000 00000000 00000000 ................
10016e3c0 to 10016e3d0 suppressed, 2 lines same as above
10016e3e0 FFFFFFFF 7AC664A0 FFFFFFFF 7B870B20 ....zd....{.
10016e3f0 00000000 00000000 00000000 00000000 ................
10016e400 00000000 00000000 00000000 00000000 ................
10016e410 00000000 00000014 0000001C 00000000 ................
10016e420 00000000 00000000 00000000 00000000 ................
10016e430 to 10016e440 suppressed, 2 lines same as above
10016e450 00000001 001721A8 00000001 00170E98 ......!.......
10016e460 00000000 00000000 00000000 00000000 ................
10016e470 to 10016e4b0 suppressed, 5 lines same as above
10016e4c0 00000000 00000000 00000000 514D214A ............QM!M
10016e4d0 45444931 50213031 00000000 00000000 QPROD!01........
10016e4e0 00000000 00000000 00000000 00000000 ................
10016e4f0 to 10016e580 suppressed, 10 lines same as above
10016e590 00000000 00000000 00000001 00943658 .............6X
10016e5a0 00000000 00000000 00000000 00000000 ................
10016e5b0 to 10016e5e0 suppressed, 4 lines same as above
10016e5f0 F000742B F0007406 F0007408 F0007456 .t+.t..t..tV
10016e600 F000814E F00034C8 F0000CCC F00010C7 .N.4....
10016e610 F00010C8 F0005C03 F0005C15 F0005C17 ...\..\..\.
10016e620 F0005C06 F0005C17 F00010B3 F0000CB5 .\.`#.`#....
10016e640 00000000 00000000 00000000 00000000 ................
10016e650 to 10016e6a0 suppressed, 6 lines same as above
10016e6b0 00000000 00000000 F0005C22 00005C22 .........\"..\"
10016e6c0 00006807 F0007433 00007433 F0007406 ..h..t3..t3.t.
10016e6d0 F0007407 F000740F F0006804 00006804 .t..t..h...h.
10016e6e0 F0008005 F0008011 F0008010 00008010 .........
10016e6f0 00008011 F0008014 00008014 F000801A ..........
10016e700 F0008011 F0008010 00008010 00008011 ..........
10016e710 0000801A F000801B 0000801B F000340D .........4.
10016e720 F0003449 F000343F 0000343F F0003486 .4I.4?..4?.4
10016e730 F0005DA5 00005DA5 F000344A F0005D63 .]..].4J.]c
10016e740 00005D63 0000344A 00003486 F000348E ..]c..4J..4.4
10016e750 0000348E F000344B F0005C12 00005C12 ..4.4K.\...\.
10016e760 0000B808 49698C24 2017CC1B 0000344B ...Ii$ ....4K
10016e770 F0003447 00003447 F0003493 00003493 .4G..4G.4..4
10016e780 F0003496 F00034AA F0000CC1 F0005C1B .4.4...\.
10016e790 00005C1B 00000CC1 F00034DF 000034DF ..\.....4..4
10016e7a0 F0003517 00003517 F0000CC2 F0005C1C .5...5....\.
10016e7b0 00005C1C 00000CC2 F0005C20 00005C20 ..\.....\ ..\
10016e7c0 000034AA 00003496 F0003488 00003488 ..4..4.4..4
10016e7d0 F0003495 00003495 00003449 0000340D .4..4..4I..4.
10016e7e0 F000801C 0000801C 00008005 0000740F ..........t.
10016e7f0 F0006805 00006805 F0006806 F0005C21 .h...h..h..\!
10016e800 00005C21 F0005C20 00005C20 00006806 ..\!.\ ..\ ..h.
10016e810 00007407 00007406 F0006807 F0005C22 ..t...t..h..\"
10016e820 00005C22 00006807 F0007433 00007433 ..\"..h..t3..t3
10016e830 F0007406 F0007408 F0007456 F0006804 .t..t..tV.h.
10016e840 00006804 F000814E F000800D 0000800D ..h..N.....
10016e850 F00034C8 F0000C0B F0000CAD F0005C1B .4......\.
10016e860 00005C1B 00000CAD F0000C45 F0000CB3 ..\......E..
10016e870 F0000C83 F0000CB5 00000CB5 00000C83 ..........
10016e880 00000CB3 F0000CAE F0005C1C 00005C1C ......\...\.
10016e890 00000CAE F0005C1B 00005C1B 00000C45 ....\...\....E
10016e8a0 00000C0B F0000CCC F00010C7 F00010C8 ..........
10016e8b0 F00010A8 F00010AB F0000404 F000042A .........*
10016e8c0 7412042A F000042B 0000042B F0000430 t..*..+...+..0
10016e8d0 00000430 F000041C 0000041C 00000404 ...0...........
10016e8e0 000010AB F0000408 F000041E 0000041E .............
10016e8f0 00000408 000010A8 F0005C02 F0005C05 ........\..\.
10016e900 00005C05 00005C02 F0005C03 F0005D7D ..\...\..\..]}
10016e910 F0005C73 F00060F6 000060F6 00005C73 .\s.`...`...\s
10016e920 F0005DA2 00005DA2 F0005DCC 61935DCC .]..].]a]
10016e930 F0005DCD F0005DCC 61935DCC 61935DCD .].]a]a]
10016e940 F0005D59 00005D59 F0005C16 F0005C05 .]Y..]Y.\..\.
10016e950 00005C05 F0005C4C F0005C2B 00005C2B ..\..\L.\+..\+
10016e960 F0005C17 00005C17 00005C4C F0005D92 .\...\...\L.]
10016e970 0000B804 00000013 00005D92 F0005D93 .........].]
10016e980 00005D93 F0005C06 00005C06 00005C16 ..].\...\...\.
10016e990 00005D7D F0005D7D F0005C73 F00060F6 ..]}.]}.\s.`.
10016e9a0 000060F6 00005C73 F0005DA2 00005DA2 ..`...\s.]..]
10016e9b0 F0005DCC 61935DCC F0005DCD F0005DCC .]a].].]
10016e9c0 61935DCC 61935DCD F0005D59 00005D59 a]a].]Y..]Y
10016e9d0 F0005C16 F0005C05 00005C05 F0005C4C .\..\...\..\L
10016e9e0 F0005C2B 00005C2B F0005C17 00005C17 .\+..\+.\...\.
10016e9f0 00005C4C F0005D92 0000B804 00000013 ..\L.].......
10016ea00 00005D92 F0005D93 00005D93 F0005C06 ..].]..].\.
10016ea10 00005C06 00005C16 00005D7D F0005C4C ..\...\...]}.\L
10016ea20 F0005C2B 00005C2B F0005C17 00005C17 .\+..\+.\...\.
10016ea30 00005C4C F00060B3 000060B3 F0005DCB ..\L.`..`.]
10016ea40 00005DCB F00060F6 000060F6 F0005C13 ..].`...`..\.
10016ea50 00005C13 F0005C13 00005C13 F0005C13 ..\..\...\..\.
10016ea60 00005C13 F0005DA2 00005DA2 F0005D65 ..\..]..].]e
10016ea70 00005D65 F0005C15 00005C15 F0005C15 ..]e.\...\..\.
10016ea80 00005C15 F0005C15 00005C15 00005C20 ..\..\...\...\
10016ea90 00006806 00007408 00007406 F0006807 ..h...t...t..h.
10016eaa0 00000000 00000000 00000000 00000000 ................
10016eab0 00000000 000000F5 00000000 0000001E ...............
10016eac0 00000000 00000000 00000000 00000000 ................
10016ead0 00000000 00000000 00000000 00000000 ................
10016eae0 00000000 00000000 6C69622F 6C716D2F ........lib/lqm/
10016eaf0 616D7161 71686F61 2E630000 00000000 amqaqhoa.c......
10016eb00 00000000 00000000 00000000 00000000 ................
10016eb10 00000000 00000000 00000000 00000000 ................
10016eb20 312E3934 2E312E36 00000000 00000747 1.94.1.6.......G
10016eb30 00000000 00000000 00000001 00173A38 ..............:8
10016eb40 00000000 00000000 FFFFFFFF 79007278 ............y.rx
10016eb50 00000001 0016EC88 00000001 001630B8 ............0
10016eb60 00000001 00170398 00000000 00000000 ...............
10016eb70 00000000 00000000 00000000 00000000 ................
10016eb80 00000000 00000000 FFFFFFFF 7C203098 ............| 0
10016eb90 00000000 00000000 00000000 00000000 ................
10016eba0 00000001 00000000 FFFFFFFF 7ECDAFE0 ............~
10016ebb0 00000001 00000000 FFFFFFFF 7E558294 ............~U
10016ebc0 00000000 00000000 00000000 00000000 ................
10016ebd0 00000001 00000000 FFFFFFFF 7EE6DFE0 ............~
10016ebe0 00000001 00000000 FFFFFFFF 7ED9E8C8 ............~
10016ebf0 00000000 00000000 00000000 00000000 ................
10016ec00 00000001 00000000 00000001 00010CD0 ...............
10016ec10 00000000 00000000 00000000 00000000 ................
10016ec20 00000001 00000000 FFFFFFFF 7EF562B0 ............~b
10016ec30 00000000 00000000 00000000 00000000 ................
10016ec40 40000003 00000003 004854F8 20000002 @........HT ...
10016ec50 00000002 00016A48 00000000 00000000 ......jH........
Suspend/Resume Area (SRA) for Subpool 1
ffffffff7ac02940 786C7354 00000209 xlsT....
ffffffff7ac02950 00000006 00000008 00000014 20000000 ............ ...
ffffffff7ac02960 00000000 00002150 20000000 00000000 ......!P .......
ffffffff7ac02970 00002948 00000000 00000000 00000000 ..)H............
ffffffff7ac02980 00000000 00000000 00000000 00000000 ................
ffffffff7ac02990 00000000 00014356 00000000 00000000 ......CV........
Suspend/Resume Area (SRA) for Subpool 2
ffffffff7b802c80 786C7354 00000209 xlsT....
ffffffff7b802c90 00000006 00000008 0000001C 40000000 ............@...
ffffffff7b802ca0 00000000 00002150 40000000 00000000 ......!P@.......
ffffffff7b802cb0 00002C88 00000000 00000000 00000000 ..,............
ffffffff7b802cc0 00000000 00000000 00000000 00000000 ................
ffffffff7b802cd0 00000000 00014356 00000000 00000000 ......CV........
pCtl->CS.threadConnectCount[1] = 1
pCtl->CS.threadConnectedSubpools[1] = 100162418
100162410 514D214A 45444931 QM!MQPRO
100162420 50213031 00000000 00000000 00000000 D!01............
100162430 00000000 00000000 00000000 00000000 ................
100162440 00000000 00000000 00000000 00000000 ................
100162450 00000000 00000000 2F406970 63630000 ......../@ipcc..
100162460 00000000 00000000 00000001 00000001 ................
100162470 00004101 2F766172 2F6D716D 00000000 ..A./var/mqm....
100162480 00000000 00000000 00000000 00000000 ................
100162490 to 100162860 suppressed, 62 lines same as above
100162870 00000000 00000000 00000011 00000000 ................
100162880 FFFFFFFF 7AC00D70 00000000 00000000 ....z.p........
100162890 00000001 0015B9B0 00000001 001710D8 .............
1001628a0 00000001 0015B9F0 00000001 00162908 ............).
1001628b0 00000000 00000000 00000000 00000000 ................
1001628c0 00000000 00000000 ........
pconnSubpool[1].connExtentList = 100162908
100162900 00000020 00000000 ... ....
100162910 00000000 00000310 00000000 00000000 ................
100162920 FFFFFFFF 7AC00000 00000003 00000000 ....z..........
100162930 00000001 00000000 FFFFFFFF 7A800000 ............z..
100162940 00000005 00000000 00000002 00000000 ................
100162950 FFFFFFFF 78800000 00000006 00000000 ....x..........
100162960 00000003 00000000 FFFFFFFF 7AC00000 ............z..
100162970 FFFFFFFF 00000000 00000004 00000000 ................
100162980 FFFFFFFF 7C100000 00000011 00000000 ....|...........
100162990 FFFFFFFF 00000000 00000000 00000000 ................
1001629a0 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
1001629b0 00000000 00000000 FFFFFFFF 00000000 ................
1001629c0 FFFFFFFF 00000000 00000000 00000000 ................
1001629d0 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
1001629e0 00000000 00000000 FFFFFFFF 00000000 ................
1001629f0 FFFFFFFF 00000000 00000000 00000000 ................
100162a00 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
100162a10 00000000 00000000 FFFFFFFF 00000000 ................
100162a20 FFFFFFFF 00000000 00000000 00000000 ................
100162a30 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
100162a40 00000000 00000000 FFFFFFFF 00000000 ................
100162a50 FFFFFFFF 00000000 00000000 00000000 ................
100162a60 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
100162a70 00000000 00000000 FFFFFFFF 00000000 ................
100162a80 FFFFFFFF 00000000 00000000 00000000 ................
100162a90 FFFFFFFF 00000000 FFFFFFFF 00010018 ................
100162aa0 00000000 00000000 FFFFFFFF 00000230 ...............0
100162ab0 FFFFFFFF 00000C20 00000000 00000000 ....... ........
100162ac0 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
100162ad0 00000000 00000000 FFFFFFFF 00162B08 ..............+.
100162ae0 FFFFFFFF 00000000 00000000 00000000 ................
100162af0 FFFFFFFF 00000000 FFFFFFFF 00162D48 ..............-H
100162b00 00000000 00000000 FFFFFFFF 75657565 ............ueue
100162b10 FFFFFFFF 67657273 00000000 00000000 ....gers........
100162b20 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
100162b30 00000000 00000000 FFFFFFFF 00000000 ................
100162b40 FFFFFFFF 00000000 00000000 00000000 ................
100162b50 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
100162b60 00000000 00000000 FFFFFFFF 00000000 ................
100162b70 FFFFFFFF 00000000 00000000 00000000 ................
100162b80 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
100162b90 00000000 00000000 FFFFFFFF 00000000 ................
100162ba0 FFFFFFFF 00000000 00000000 00000000 ................
100162bb0 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
100162bc0 00000000 00000000 FFFFFFFF 00000000 ................
100162bd0 FFFFFFFF 00000000 00000000 00000000 ................
100162be0 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
100162bf0 00000000 00000000 FFFFFFFF 00000000 ................
100162c00 FFFFFFFF 00000000 00000000 00000000 ................
100162c10 FFFFFFFF 00000000 ........
pCtl->CS.threadConnectCount[2] = 2
pCtl->CS.threadConnectedSubpools[2] = 10015f188
10015f180 514D214A 45444931 QM!MQPRO
10015f190 50213031 00000000 00000000 00000000 D!01............
10015f1a0 00000000 00000000 00000000 00000000 ................
10015f1b0 to 10015f1c0 suppressed, 2 lines same as above
10015f1d0 00000000 00000000 00000002 00000001 ................
10015f1e0 00004202 2F766172 2F6D716D 00000000 ..B./var/mqm....
10015f1f0 00000000 00000000 00000000 00000000 ................
10015f200 to 10015f5d0 suppressed, 62 lines same as above
10015f5e0 00000000 00000000 00000021 00000000 ...........!....
10015f5f0 FFFFFFFF 7B800D70 00000000 00000000 ....{.p........
10015f600 00000001 0015B8F0 00000001 00170E28 .............(
10015f610 00000001 0015B930 00000001 0015F678 ......0.......x
10015f620 00000000 00000000 00000000 00000000 ................
10015f630 00000000 00000000 ........
pconnSubpool[2].connExtentList = 10015f678
10015f670 00000020 00000000 ... ....
10015f680 00000000 00000310 00000000 00000000 ................
10015f690 FFFFFFFF 7B800000 00000001 00000000 ....{..........
10015f6a0 00000001 00000000 FFFFFFFF 7C200000 ............| ..
10015f6b0 00000002 00000000 FFFFFFFF 00000000 ................
10015f6c0 00000000 00000000 FFFFFFFF 00000000 ................
10015f6d0 00000003 00000000 FFFFFFFF 78C00000 ............x..
10015f6e0 00000009 00000000 00000004 00000000 ................
10015f6f0 FFFFFFFF 79200000 0000000A 00000000 ....y ..........
10015f700 00000005 00000000 FFFFFFFF 7A400000 ............z@..
10015f710 0000000B 00000000 00000006 00000000 ................
10015f720 FFFFFFFF 79800000 0000000C 00000000 ....y..........
10015f730 00000007 0015D760 FFFFFFFF 7A200000 ......`....z ..
10015f740 0000000D 00000003 00000008 00000000 ................
10015f750 FFFFFFFF 79700000 0000000E 00000000 ....yp..........
10015f760 00000008 00000000 FFFFFFFF 79500000 ............yP..
10015f770 0000000F 0015D760 FFFFFFFF 00000000 ......`........
10015f780 00000000 00000000 FFFFFFFF 00000000 ................
10015f790 FFFFFFFF 00010018 00000000 00000000 ................
10015f7a0 FFFFFFFF 00000230 FFFFFFFF 0015F7D8 .......0......
10015f7b0 00000000 00000000 FFFFFFFF 00000000 ................
10015f7c0 FFFFFFFF 0000002A 00000000 00000000 .......*........
10015f7d0 FFFFFFFF 00000000 FFFFFFFF 654D616E ............eMan
10015f7e0 00000000 00000000 FFFFFFFF 2A2A2A2A ............****
10015f7f0 FFFFFFFF 2A2A2A2A 00000000 00000000 ....****........
10015f800 FFFFFFFF 2A2A2A2A FFFFFFFF 2A2A2A2A ....****....****
10015f810 00000000 00000000 FFFFFFFF 2A230000 ............*#..
10015f820 FFFFFFFF 00000000 00000000 00000000 ................
10015f830 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
10015f840 00000000 00000000 FFFFFFFF 00000000 ................
10015f850 FFFFFFFF 00000000 00000000 00000000 ................
10015f860 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
10015f870 00000000 00000000 FFFFFFFF 00000000 ................
10015f880 FFFFFFFF 00000000 00000000 00000000 ................
10015f890 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
10015f8a0 00000000 00000000 FFFFFFFF 00000000 ................
10015f8b0 FFFFFFFF 00000000 00000000 00000000 ................
10015f8c0 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
10015f8d0 00000000 00000000 FFFFFFFF 00000000 ................
10015f8e0 FFFFFFFF 00000000 00000000 00000000 ................
10015f8f0 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
10015f900 00000000 00000000 FFFFFFFF 00000000 ................
10015f910 FFFFFFFF 00000000 00000000 00000000 ................
10015f920 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
10015f930 00000000 00000000 FFFFFFFF 00000000 ................
10015f940 FFFFFFFF 00000000 00000000 00000000 ................
10015f950 FFFFFFFF 00000000 FFFFFFFF 00000000 ................
10015f960 00000000 00000000 FFFFFFFF 00000000 ................
10015f970 FFFFFFFF 00000000 00000000 00000000 ................
10015f980 FFFFFFFF 00000000 ........
pCtl->CS.threadConnectCount[3] = 0
pCtl->CS.threadConnectedSubpools[3] = 0
pCtl->CS.threadConnectCount[4] = 0
pCtl->CS.threadConnectedSubpools[4] = 0
pCtl->CS.threadConnectCount[5] = 0
pCtl->CS.threadConnectedSubpools[5] = 0
pCtl->CS.threadConnectCount[6] = 0
pCtl->CS.threadConnectedSubpools[6] = 0
Component Dumps (Thread 00000006)
------< "main()" >-----
labpSessionAnchor: ffffffff7c2006b0
AgentConnectionData{
ResourceState: zlaSTATE_PROCESS_CREATED|zlaSTATE_AGENT_CONNECTED
pidApplication: 523
tidApplication: 1
tidAgent: 6
ulApplicationState: 0X0
hsmbACD: 2.1.1.12440
hsmbACDNext: 2.1.1.12024
ulMessageType: 6032
chMessageType: ZWIS
ACDInstance: 0
ApplicationFlags: 1
PrivilegeOptions: 0X24000080
Sequence: 0
uid: 0
ConnectionId: 414D5143 514D2E4A 45444931 502E3031 49698C24 20000401
}
AgentConnectionData
ffffffff7c203090 5A584143 00000000 ZXAC....
ffffffff7c2030a0 00000000 00000003 00100110 0000020B ................
ffffffff7c2030b0 00000001 40000001 00000001 00003098 ....@.........0
ffffffff7c2030c0 40000001 00000001 00002EF8 00000006 @..............
ffffffff7c2030d0 00001790 5A574953 00000000 00000001 ...ZWIS........
ffffffff7c2030e0 00000001 24000080 5A435031 20000002 ....$..ZCP1 ...
ffffffff7c2030f0 00000002 00000520 20000002 00000002 ....... .......
ffffffff7c203100 00007760 00000000 FFFFFFFF 78807760 ..w`........xw`
ffffffff7c203110 00000000 00000000 00000000 00000000 ................
ffffffff7c203120 to ffffffff7c203150 suppressed, 4 lines same as above
ffffffff7c203160 00000000 20000000 00000000 000026D8 .... .........&
ffffffff7c203170 00000000 00000000 40000000 00000000 ........@.......
ffffffff7c203180 00000D70 00000000 FFFFFFFF 79C5DDF8 ...p........y
ffffffff7c203190 40000006 00000006 0045DDF8 00000007 @........E....
ffffffff7c2031a0 00000001 00173A38 00000001 00170CA8 ......:8.......
ffffffff7c2031b0 20000000 00000000 00000D70 00000000 ..........p....
ffffffff7c2031c0 00000001 0016DD60 00000000 00000000 ......`........
ffffffff7c2031d0 00000000 00000000 00000000 00000000 ................
ffffffff7c2031e0 00000000 00000000 00000000 414D5143 ............AMQC
ffffffff7c2031f0 514D2E4A 45444931 502E3031 49698C24 QM.JEDI1P.01Ii$
ffffffff7c203200 20000401 00000000 00000000 00000000 ...............
----------< K "Kernel" >----------
KAB
{
StartTime: 2009-01-11 01:05:20.775
ConnectionCount: 102
ConnectionId: 00000001 00000000
Options: 1
TickleHash: 229859
Mutex.RequestCount 337392
Mutex.WaitCount 10
Mutex.DepthHWM 4
CloseLock.RequestCount 24483
{
StatisticsToggle 1
lastErrorCode 0
CollectionCount 137
lastCollectionTime 2009-01-12 11:20:26.755
CollectionTimeShort 700
CollectionTimeLong 575
QStatLockHash 65
hObjListLock.RequestCount 3780
{
IntervalStart 2009-01-12 11:05:26.747
hStatLockPut[0].RequestCount 134513
hStatLockPut1[0].RequestCount 185
hStatLockGet[0].RequestCount 138237
hStatLockPutGet[0].RequestCount 120273
connCount 11436
connHighwater 110
discCount[0] 11376
discCount[1] 61
openCount[1] 1011
openCount[5] 816
closeCount[1] 1010
closeCount[5] 816
putCount[ 0] 3854
putBytes[ 0] 5594641
putCount[ 1] 3606
putBytes[ 1] 3891528
put1Count[ 0] 3
put1Bytes[ 0] 30024
putGetCount[ 0] 2088
putGetBytes[ 0] 876184
getCount[ 0] 4134
getBytes[ 0] 5810400
getCount[ 1] 3610
getBytes[ 1] 3892685
getFails 10301
brwCount[ 1] 366
brwBytes[ 1] 63534
brwFails 1701
cmtCount 13764
bckCount 768
inqCount[0] 14246
inqCount[1] 9838
inqFails[1] 4
inqCount[5] 1233
inqFails[5] 702
inqCount[6] 1908
}QMGRSTATS[0]
{
IntervalStart 2009-01-12 11:20:26.755
hStatLockPut[1].RequestCount 127570
hStatLockPut1[1].RequestCount 192
hStatLockGet[1].RequestCount 131034
hStatLockPutGet[1].RequestCount 109586
connCount 2927
connHighwater 106
discCount[0] 2913
discCount[1] 15
openCount[1] 260
openCount[5] 247
closeCount[1] 260
closeCount[5] 247
putCount[ 0] 556
putBytes[ 0] 729541
putCount[ 1] 1013
putBytes[ 1] 1448971
put1Count[ 0] 2
put1Bytes[ 0] 24844
putGetCount[ 0] 332
putGetBytes[ 0] 117918
getCount[ 0] 616
getBytes[ 0] 769933
getCount[ 1] 679
getBytes[ 1] 1098271
getFails 2183
brwCount[ 1] 106
brwBytes[ 1] 15953
brwFails 443
cmtCount 3904
bckCount 249
inqCount[0] 3626
inqCount[1] 2121
inqCount[5] 349
inqFails[5] 210
inqCount[6] 396
}QMGRSTATS[1]
{
connCount 147932
connHighwater 109
discCount[0] 147575
discCount[1] 251
openCount[1] 23311
openFails[1] 1
openCount[2] 1
openCount[5] 11380
closeCount[1] 23213
closeCount[2] 1
closeCount[5] 11320
putCount[ 0] 224739
putBytes[ 0] 362502117
putCount[ 1] 28315
putBytes[ 1] 33612804
put1Count[ 0] 372
put1Bytes[ 0] 1429156
putGetCount[ 0] 227439
putGetBytes[ 0] 89794242
getCount[ 0] 227251
getBytes[ 0] 365400016
getCount[ 1] 28311
getBytes[ 1] 33611647
getFails 901723
brwCount[ 1] 4198
brwBytes[ 1] 717925
brwFails 40737
cmtCount 171609
bckCount 8857
inqCount[0] 192436
inqCount[1] 294392
inqFails[1] 289
inqCount[5] 21995
inqFails[5] 7608
inqCount[6] 59556
setCount[1] 17
}QMGRSTATS[2]
}StatCB
}
KernelTuningParms
{
}
Conn.ConnectionId: 49698C24 20000401
Conn.ConnSeqNo: 00000000 00000003
Conn.ApplPid: 523
Conn.ApplTid: 1
Conn.AgentPid: 521
Conn.AgentTid: 6
Conn.connectTime: 2009-01-11 01:05:25.596
Conn.ConnectOptions: 100
Conn.PrivilegeOptions: 24000080
Conn.MaxMsgLength: 4194304
Conn.AuthToken: 1231654944
Conn.ApplName: amqpcsea
Conn.ApplType: 6
Conn.AccountingToken: 04313630 30000000 00000000 00000000
Conn. 00000000 00000000 00000000 00000006
Conn.UserContext.UserId mqm
Conn.ObjectListName: pcmInquireQNames
Conn.ObjectListCount: 256
Conn.ObjectListType: 1
Conn.UOWSequence: 1
Waiter.Self: 2.3.3.4693568
Waiter.Active FALSE
Waiter.Options: MQGMO_WAIT|MQGMO_FAIL_IF_QUIESCING|MQGMO_ACCEPT_TRUNCATED_MSG|MQGMO_CONVERT
Waiter.SetTime: 2009-01-12 11:24:16.109
Waiter.WaiterFlags kqiWaiterQEmpty
Waiter.DataLength 96
Waiter.TickleBufferIdx 8
-----< AO "Object Catalogue" >-----
SessionAnchor
{
Flags: 0X20F
SessionId 49698C20
Location: /var/mqm/qmgrs/QM!MQPROD!01
ObjCatRecoveryFlags: None
OCCB.StrucId AOCB
hmtxObjCat.RequestCount 822952
hmtxObjCat.WaitCount 31
hmtxObjCat.DepthHWM 2
hmtxObjCatX.RequestCount 697
hmtxObjCatX.WaitCount 2
hmtxObjCatX.DepthHWM 1
ActivityQ[0].hmtx.RequestCount 1
ActivityQ[0].hmtxC.RequestCount 1
MaxReserveBytes 2097152
ATM.StartedFlag: 0X1
ATM.NextTranNum: 0.31572
ATM.RMidGenerator: 362579
ATM.CRecLSN: 0.0.0.0
ATM.CRecFlags: atmRECFLAG_NONE
ATM.TRecFlags: atmRECFLAG_NONE
TCBDepth 1
hmtxTranTable.RequestCount 53809
hmtxTranTable.WaitCount 20
hmtxTranTable.DepthHWM 1
hmtxRMid.RequestCount 164906
hmtxNextTranNum.RequestCount 31570
hmtxTranCursor.RequestCount 86
hmtxTxnCache.RequestCount 155
{
Tranid 2.7.7.481176
}adtTRANCURSOR
}
alipGData
{
ALM.Flags: altGFHLGSTARTED
ALM.ChkPtTime 2009-01-12 11:20:09.713
ALM.ChkPtTimeLong 617273
ALM.ChkPtTimeShort 1057559
ALM.WaitTimeLong 37392846
ALM.WaitTimeShort 304783436
ALM.ChkPtOwner 501
ALM.ChkPtOpCount 4977
ALM.ChkPtOpMax 10000
ALM.ChkPtOpMin 100
ALM.ChkPtByteCount 3213580
ALM.ChkPtByteLimit 9437184
ALM.ChkPtCompleteIndex 82
ALM.hmtxData.RequestCount 184
ALM.CrashRecRestartLSN 0.95.6416.22591
}
aiiThread->StructID: "AIIT"
AgentFlags: 7
apipThread
{
LockFlags 1
QLockCount 1
ThreadFlags 0
atm.pLDatatm.pLData
{
RMState : 0X1FFFFFFF
RMid : 32783
Association : 0
TranDataState : 0
}
}
aqi.pLData.Init 1
aqi.pLData.InTran 0
aqi.pLData.Logged 0
-----< H "Logger" >-----
Global Data
{
InitCount: 108
StateFlags: 1
LogThresholdPercentage: 80
LogThreshold: 16686800
LogPacePercentage: 90
LogPacePerFile: 3754530
LogPaceTotal: 18772650
AnchorMutex.RequestCount: 8450
AnchorMutex.WaitCount: 3
AnchorMutex.DepthHWM: 3
}
dbcb
{
{
counter1: 30865
counter2: 30865
logactive: 3
loginactive: 2
logsize 1024
baselsn: 0.95.7616.0
nextlsn: 0.95.7688.12510
lowtranlsn: 0.95.7638.61978
minbufflsn: 0.95.7638.61546
headlsn: 0.95.7638.61546
taillsn: 0.95.7688.12509
hflag1 NONE
HeadExtentID: 0
LastEID: 1231546376
LogID: 1063890943
FirstArchNum: -1
LastArchNum: -1
nextArcFile: -1
FileCount: 3
filenum [0,1,2]
LastCId: 0
softmax: 4194304
}logfhdr
{
counter1: 30865
counter2: 30865
logactive: 3
loginactive: 2
logsize 1024
baselsn: 0.95.7616.0
nextlsn: 0.95.7680.1281
lowtranlsn: 0.95.7638.61978
minbufflsn: 0.95.7638.61546
headlsn: 0.95.7638.61546
taillsn: 0.95.7680.1280
hflag1 NONE
HeadExtentID: 0
LastEID: 1231546376
LogID: 1063890943
FirstArchNum: -1
LastArchNum: -1
nextArcFile: -1
FileCount: 3
filenum [0,1,2]
LastCId: 0
softmax: 4194304
}logfhdr_hardened
logstate: MQLP_OK
flag1: NEW_LOG_LOGIC|WRITE_LOW|READ_LOW
flag2: SPACE_RESTRICT
partialFlags: 3
tailPingPongCount: 2
NextAppendBuf: 28
logBufSz; 128
softmax: 100
logprimary: 3
logsecond: 2
LastBufferLsn: 0.95.7688.12275
lastdisklsn: 0.95.7688.12509
LastRecLsn: 0.95.7688.12509
TailIndex: 1
TailPage: 131
TotalLogSpace: 12523538
LogBytesInUse: 4710298
LogBytesInUseHWM: 4711066
LogReserveCushion 250552
logFull: FALSE
NextFormatExtNum: 0
DeletePendingLow: 0
DeletePendingHigh: 0
currentIOLsn: 0.95.7688.12509
WriteToLsn: 0.95.7688.12509
totalIOCount[1]: 34627
totalIOCount[2]: 8234
totalIOCount[3]: 3094
totalIOCount[4]: 8
WriteSizeShort : 5035
WriteSizeLong : 4796
WriteSizeMax : 94208
WriteTimeShort : 6431
WriteTimeShortMax: 24767
WriteTimeLong : 6064
WriteTimeLongMax : 24767
WriteTimeMax : 176344
pingPongCount[0]: 8131
pingPongCount[1]: 1
pingPongCount[2]: 3728
pingPongCount[3]: 2894
pingPongCount[4]: 27
pingPongCount[5]: 3347
pingPongCount[6]: 3
pingPongCount[7]: 817
pingPongCount[8]: 1
pingPongCount[9]: 1401
mqlp_dbcb_sem.RequestCount: 557357
LastDiskLsnSem.RequestCount: 301113
LastDiskLsnSem.WaitCount: 1
LastDiskLsnSem.DepthHWM: 1
ReadBufSem.RequestCount: 6
AppendSem.RequestCount: 100329
AppendSem.WaitCount: 24
AppendSem.DepthHWM: 2
gasn_latch.RequestCount: 135639
gasn_request_qhead: 0.0.0.0
gasn_request_qtail: 0.0.0.0
transsem.RequestCount: 168
FormatRequestHistory [0,0,0,0,0,0,0,0,
0,0,0,0,0,0,0,0
]
FormatResponseHistory [(0,0),(0,0),(0,0),(0,0),(0,0),(0,0),(0,0),(0,0),
(0,0),(0,0),(0,0),(0,0),(0,0),(0,0),(0,0),(0,0)
]
}
-------< R "Remote - LQM" >-------
InSignalHandler:0
HighDetail: 0
ThreadState: 0
Component: 4
Function: 200
Work Control Block
{
Storage 0
StorageUsed 0
StorageHighWater 0
Options 0x0
QueueManager
User
bKillPending FALSE
AuthToken 0
PoolThreads 0
rmid 0
xid 2034484112
DebugOptions 00000001
Raw rrxWORK struct
100170390 5257524B 00000000 RWRK....
1001703a0 00000000 00000000 00000000 00000000 ................
1001703b0 00000000 00000000 00000000 00000000 ................
1001703c0 00000001 0016DD60 20202020 20202020 ......`
1001703d0 20202020 20202020 20202020 20202020
1001703e0 20202020 20202020 20202020 20202020
1001703f0 20202020 20202020 00000000 00000000 ........
100170400 00000000 00000000 00000000 00000000 ................
100170410 to 100170830 suppressed, 67 lines same as above
100170840 00000000 00000000 FFFFFFFF A0000000 ...............
100170850 00000000 00000000 00000000 00000000 ................
100170860 00000000 00000000 00000000 00000000 ................
100170870 00000000 00000000 00000000 FFFFFFFF ................
100170880 FFFFFFFF FFFFFFFF FFFFFFFF 00000000 ................
100170890 FFFFFFFF 00000001 FFFFFFFF FFFFFFFF ................
1001708a0 FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF ................
1001708b0 to 1001708c0 suppressed, 2 lines same as above
1001708d0 FFFFFFFF 00000000 00000000 00000000 ................
1001708e0 00000000 00000000 00000000 00000000 ................
1001708f0 00000001 00000000 00000000 00000000 ................
100170900 00000000 00000000 00000000 00000000 ................
100170910 to 1001709c0 suppressed, 12 lines same as above
1001709d0 00000000 00000000 ........
}
Config Control Block
{
Init FALSE
Options 0x0
MaxChannels -1
MaxActiveChannels -1
MaxTries -1
MaxTriesIntvl -1
MaxActiveChannelsInUse FALSE
ChinitDiscInt -1
CanConvert TRUE
MaxInitiators -1
XOptions -1
AdoptType -1
AdoptCheck -1
AdoptTimeout -1
QueueCacheSize -1
CommsTraceBufferSize -1
PipeLineDelay -1
RequesterTimeout -1
Priority -1
ClientIdle -1
NpmBatchInt -1
OptThreads -1
MaxThreads -1
OptProcesses -1
MaxProcesses -1
Options 0
Raw cccCONFIG struct
100170870 00000000 00000000 FFFFFFFF ............
100170880 FFFFFFFF FFFFFFFF FFFFFFFF 00000000 ................
100170890 FFFFFFFF 00000001 FFFFFFFF FFFFFFFF ................
1001708a0 FFFFFFFF FFFFFFFF FFFFFFFF FFFFFFFF ................
1001708b0 to 1001708c0 suppressed, 2 lines same as above
1001708d0 FFFFFFFF ....
}
------< ZS "Application Interface(zsq)" >-----
CliQMAnchor
ffffffff7f0dc460 5A535141 00000000 00000001 00173028 ZSQA..........0(
connHandleIndex
100173020 00000001 00000100 ........
100173030 00000017 0000000E 00000000 00000000 ................
100173040 00000001 00173888 00000001 00173918 ......8......9.
100173050 00000001 001739A8 00000001 00173A38 ......9......:8
100173060 00000001 00173AC8 00000001 00186438 ......:......d8
100173070 00000001 0017EA88 00000001 00184F88 ............O
100173080 00000001 0018AA58 00000001 0018EE68 ......X......h
100173090 00000001 00191BC8 00000001 00194928 .............I(
1001730a0 00000001 0056C2E8 00000000 00000000 .....V........
1001730b0 00000000 00000000 00000001 00945578 .............Ux
1001730c0 00000001 00947C58 00000000 00000000 .....|X........
1001730d0 00000000 00000000 00000000 00000000 ................
1001730e0 to 100173830 suppressed, 118 lines same as above
zsqPCD
100173a30 5A535143 00000003 ZSQC....
100173a40 00000000 00000000 00000001 00943518 .............5.
100173a50 40000003 00000003 00407278 00000001 @........@rx....
100173a60 00000002 00000100 24000080 00000000 ........$......
100173a70 00000001 0017C448 00000001 0016DD60 ......H......`
100173a80 00000008 00000000 ........
------------------------------------- |
_________________
Yeah, well, you know, that's just, like, your opinion, man. - The Dude |
|
| Back to top |
|
 |
| mqjeff |
| Posted: Tue Jan 13, 2009 6:23 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
Did the filesystem get munged somehow?
This is not so pretty:
| Quote: |
------------{ aduLocateFileCtl
------------} aduLocateFileCtl rc=arcE_OBJECT_MISSING |
Mind you, I have no idea what function aduLocateFileCtl does, but. |
|
| Back to top |
|
|
| LouML |
| Posted: Tue Jan 13, 2009 6:27 am Post subject: |
|
|
Partisan
Joined: 10 Nov 2005
Posts: 305
Location: Jersey City, NJ / Bethpage, NY
|
Yeah, I saw that, but everything seems to be working well besides these FDC's so it can't be munged that bad.
I was considering a re-install of MQ but this is a Production machine, so it'd have to wait until the weekend. I would have done it this past weekend, but I was hoping that the weekly server reboot would have taken care of the problem. Not so.
_________________
Yeah, well, you know, that's just, like, your opinion, man. - The Dude |
|
| Back to top |
|
|
| LouML |
| Posted: Tue Jan 13, 2009 7:31 am Post subject: |
|
|
Partisan
Joined: 10 Nov 2005
Posts: 305
Location: Jersey City, NJ / Bethpage, NY
|
The part that also concerns me is
| Code: |
| Component :- aqhReadOldestMessage |
I'm trying to think back to when I believe they started and it may have been around the time that an Initiation Queue filled up and the overflow messages went to the DLQ.
As the Initiation queue drained, I replayed the DLQ messages back to the Initiation queue.
_________________
Yeah, well, you know, that's just, like, your opinion, man. - The Dude |
|
| Back to top |
|
|
| mqjeff |
| Posted: Tue Jan 13, 2009 8:24 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
| A channel INITQ? or an app INITQ? |
|
| Back to top |
|
|
| LouML |
| Posted: Tue Jan 13, 2009 8:29 am Post subject: |
|
|
Partisan
Joined: 10 Nov 2005
Posts: 305
Location: Jersey City, NJ / Bethpage, NY
|
App initq
_________________
Yeah, well, you know, that's just, like, your opinion, man. - The Dude |
|
| Back to top |
|
|
| LouML |
| Posted: Wed Jan 14, 2009 6:11 am Post subject: CLOSED |
|
|
Partisan
Joined: 10 Nov 2005
Posts: 305
Location: Jersey City, NJ / Bethpage, NY
|
Here is the latest.
Level 3 says that the Probe in the FDC shows that a failure occurred during an inquire queue status command submitted by the command server. As part of the information required, MQ attempts to determine the oldest message on the queue. This is done by iterating through the priority chains for persistent messages to see which message is the oldest. MQ contains an in-memory representation of the queue as various linked lists of messages. Each of these nodes then translates to a file position on disk where the queue file is located. The FDC was produced in this case
because MQ was not able to make any sense of a message header which it had read from disk based on the position referenced in its priority chains for that queue. Specifically, it was not able to relate the version number that should have been present in the bytes read from the disk with an actual version number for message headers that MQ recognises.
An examination of the message header which is dumped in the FDC suggests in fact that the whole header is corrupt. Either the position in the chain relating to the disk position is incorrect or the data itself in the queue file has become corrupt/overwritten. The queue in question is the SYSTEM.AUTH.DATA.QUEUE which is used by the OAM component of the queue manager. This queue is normally opened at queue manager startup by the OAM, held open for the duration of the queue manager running, and then closed at shutdown. From the trace provided, we are unable to see any reference to the OAM process. In fact, all indications suggest that the OAM process is not running and is in fact disabled. Have you intentionally chosen to disable the OAM? If so, was this as a result of problems with the OAM processing? Please provide background to the events leading up to the failure FDCs, specifically relating to the OAM process.
Furthermore, it appears as though a lot of the FDCs have not been provided. The FDC sequence number for one of the processes starts on above 3000. In addition to answers to the questions specified above, please supply the missing FDCs as well as a copy of queue file for the SYSTEM.AUTH.DATA.QUEUE for analysis.
---------------------------------------------------------------------------------------------------------
I replied with this:
Yes, OAM is disabled on this system. I'm a new admin here. The previous admin had OAM disabled.
When I took over here, all servers were running outdated versions of MQ (from 5.3.0.12 all the way back to 5.1 and 5.0). I just completed the MQ upgrade from 5.3.0.12 to 6.0.2.5 on this particular server in November. We are now current on all of our servers. Later this year, we're starting a security project in which I intend to enable OAM and further enhance the security of the MQ environment.
Unfortunately, the first FDC's I can find are the ones I sent you (1/9/09 10:55 seq #3494) Anything previous was accidentily deleted.
---------------------------------------------------------------------------------------------------------
Level 3 replied with this:
Thank you for the update and background on the situation. Level 3 has reviewed the information but without the previous FDCs, it will not be possible to determine the root cause of the corruption to the SYSTEM.AUTH.DATA.QUEUE. It seems plausible that the OAM may have been disabled by the previous system administrator as a result of errors with the queue.
They recommend deleting the authority queue in order to prevent further instances of this message. The OAM should recreate the queue upon queue manager startup once it has been re-enabled. This will also allow the OAM to be re-enabled at some point in the future. If the problem does re-occur, please capture all the FDCs for analysis.
We will also open an APAR to change the behavior of MQ so that the object is marked as damaged the first time the corruption is detected, thus avoiding repeated interactions and therefore repeated FDCs with this damaged queue.
I have opened APAR IZ41369 for this issue and it should be enhanced in the next release of MQ.
_________________
Yeah, well, you know, that's just, like, your opinion, man. - The Dude |
|
| Back to top |
|
|
| mqjeff |
| Posted: Wed Jan 14, 2009 6:29 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
How delightful!
This is why we have beer. |
|
| Back to top |
|
|
| Vitor |
| Posted: Wed Jan 14, 2009 6:33 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| mqjeff wrote: |
| This is why we have beer. |
One of the reasons..... 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
|
|
|
| |
|
Page 1 of 1 |
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
