|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
 |
|
AMQ6119...it seems applications get stuck connecting to QM |
« View previous topic :: View next topic » |
Author |
Message
|
Guava72 |
Posted: Sun Jun 06, 2004 1:08 am Post subject: AMQ6119...it seems applications get stuck connecting to QM |
|
|
 Apprentice
Joined: 06 Jun 2003 Posts: 46 Location: Champaign, IL
|
Hi, we're having trouble when our application tries to use its Queue Manager. We're using MQSeries 5.3 (base product, no CSD) on HP-UX 11i. Just today, we "migrated" the machine to a more powerful one, but I think something happened during the move...I checked the kernel parameters and they are at or above the IBM recommendations. Is there a way I can clean up the shared memory and semaphores? I'd like to shut everything down and "clean up", and try again...
Code: |
06/06/04 03:01:18
AMQ6119: An internal WebSphere MQ error has occurred ('13 - Permission denied' from bind.)
EXPLANATION:
MQ detected an unexpected error when calling the operating system. The MQ errorrecording routine has been called.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 669 --------------------------------------------------------
06/06/04 03:01:18
AMQ6184: An internal WebSphere MQ error has occurred on queue manager HPENV5.
EXPLANATION:
An error has been detected, and the WebSphere MQ error recording routine has
been called. The failing process is process 29590.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center. Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 703 --------------------------------------------------------
|
I killed that process (it was creating HUGE error log files!) but here is the top of the FDC file:
Code: |
+-----------------------------------------------------------------------------+
| |
| WebSphere MQ First Failure Symptom Report |
| ========================================= |
| |
| Date/Time :- Sunday June 06 02:20:27 CDT 2004 |
| Host Name :- cmih005 (HP-UX B.11.11) |
| PIDS :- 5724B4102 |
| LVLS :- 530 |
| Product Long Name :- WebSphere MQ for HP-UX |
| Vendor :- IBM |
| Probe Id :- XY029001 |
| Application Name :- MQM |
| Component :- xllOurSocket |
| Build Date :- Oct 21 2002 |
| CMVC level :- p000-L021011 |
| Build Type :- IKAP - (Production) |
| UserID :- 00000122 (utxoln5) |
| Program Name :- rmsUVadOrd |
| Process :- 00029590 |
| QueueManager :- HPENV5 |
| Major Errorcode :- xecF_E_UNEXPECTED_SYSTEM_RC |
| Minor Errorcode :- OK |
| Probe Type :- MSGAMQ6119 |
| Probe Severity :- 2 |
| Probe Description :- AMQ6119: An internal WebSphere MQ error has occurred |
| ('13 - Permission denied' from bind.) |
| FDCSequenceNumber :- 0 |
| Arith1 :- 13 d |
| Comment1 :- '13 - Permission denied' from bind. |
| |
| |
+-----------------------------------------------------------------------------+
MQM Function Stack
ziiMQCONN
ziiConnectToAgent
ziiStartAgent
zcpReceiveOnPipe
xcsWaitEventSem
xllWaitSocketEvent
xcsFFST
MQM Trace History
{ xppInitialiseDestructorRegistrations
} xppInitialiseDestructorRegistrations rc=OK
{ InitProcessInitialisation
-{ xcsLoadFunction
--{ xcsQueryValueForSubpool
--} xcsQueryValueForSubpool rc=OK
-} xcsLoadFunction rc=OK
} InitProcessInitialisation rc=OK
} xcsInitialize rc=OK
{ zstMQConnect
{ zutBlankPad
} zutBlankPad rc=OK
{ zutIsItBlank
} zutIsItBlank rc=OK
{ zutCheckQMName
-{ zutCheckValidName
-} zutCheckValidName rc=OK
} zutCheckQMName rc=OK
{ zutCvtMQName2Str
} zutCvtMQName2Str rc=OK
{ zstGetPCDbyTID
} zstGetPCDbyTID rc=OK
{ zstInitCS
-{ xcsInitialize
--{ InitPrivateServices
---{ xcsGetpwuid
---} xcsGetpwuid rc=OK
--} InitPrivateServices rc=OK
--{ xcsConnectSharedSubpool
---{ xcsAttachSharedSubpool
----{ xcsGetMem
----} xcsGetMem rc=OK
----{ xcsGetMem
----} xcsGetMem rc=OK
----{ xcsConnectSharedMemSet
-----{ xstAttachSharedMemSet
------{ xstConnectExtent
-------{ xstGetShmIdFromFile
-------} xstGetShmIdFromFile rc=OK
------} xstConnectExtent rc=OK
------{ xcsGetMem
------} xcsGetMem rc=OK
------{ xcsGetMem
------} xcsGetMem rc=OK
-----} xstAttachSharedMemSet rc=OK
----} xcsConnectSharedMemSet rc=OK
----{ xcsDestroySubpoolIfInvalid
-----{ xcsGetSetConnectCount
------{ xstGetExtentConnectCount
------} xstGetExtentConnectCount rc=OK
-----} xcsGetSetConnectCount rc=OK
----} xcsDestroySubpoolIfInvalid rc=OK
----{ xcsAllocateQuickCell
-----{ xllSpinLockRequest
-----} xllSpinLockRequest rc=OK
-----{ xllSpinLockRelease
-----} xllSpinLockRelease rc=OK
----} xcsAllocateQuickCell rc=OK
----{ xllSpinLockRequest
----} xllSpinLockRequest rc=OK
----{ xcsAttachSetExtents
----} xcsAttachSetExtents rc=OK
----{ xllSpinLockRelease
----} xllSpinLockRelease rc=OK
---} xcsAttachSharedSubpool rc=OK
--} xcsConnectSharedSubpool rc=OK
--{ xxxInitialize
---{ xcsSetlocale
---} xcsSetlocale rc=OK
---{ xcsGetMem
---} xcsGetMem rc=OK
--} xxxInitialize rc=OK
-} xcsInitialize rc=OK
} zstInitCS rc=OK
{ ztmInitialise
} ztmInitialise rc=OK
{ zstInsertPCD
-{ xcsGetMem
-} xcsGetMem rc=OK
-{ zstGetApplIds
--{ xcsQueryValueForSubpool
--} xcsQueryValueForSubpool rc=OK
--{ xcsQueryValueForSubpool
--} xcsQueryValueForSubpool rc=OK
--{ xcsQueryValueForSubpool
--} xcsQueryValueForSubpool rc=OK
--{ xcsQueryValueForSubpool
--} xcsQueryValueForSubpool rc=OK
--{ zstQueryThreadId
--} zstQueryThreadId rc=Unknown(1)
-} zstGetApplIds rc=OK
} zstInsertPCD rc=OK
{ xcsRegisterDestructor
} xcsRegisterDestructor rc=OK
{ ziiInitialise
} ziiInitialise rc=OK
{ ziiMQCONN
-{ ziiConnectToAgent
--{ zcpAttachPipe
---{ xcsConnectSharedMemSet
----{ xllSpinLockRequest
----} xllSpinLockRequest rc=OK
----{ xllSpinLockRelease
----} xllSpinLockRelease rc=OK
----{ xstAttachSharedMemSet
-----{ xstConnectExtent
------{ xllSpinLockRequest
------} xllSpinLockRequest rc=OK
------{ xllSpinLockRelease
------} xllSpinLockRelease rc=OK
-----} xstConnectExtent rc=OK
-----{ xcsGetMem
-----} xcsGetMem rc=OK
-----{ xcsGetMem
-----} xcsGetMem rc=OK
----} xstAttachSharedMemSet rc=OK
---} xcsConnectSharedMemSet rc=OK
---{ xcsRequestMutexSem
----{ xllRequestSocketMutex
-----{ xllSpinLockRequest
-----} xllSpinLockRequest rc=OK
-----{ xllSpinLockRelease
-----} xllSpinLockRelease rc=OK
----} xllRequestSocketMutex rc=OK
---} xcsRequestMutexSem rc=OK
---{ xcsRegisterDestructor
---} xcsRegisterDestructor rc=OK
--} zcpAttachPipe rc=OK
--{ ziiStartAgent
---{ ziiCreateIPCCMessage
----{ zcpCreateMessage
----} zcpCreateMessage rc=OK
---} ziiCreateIPCCMessage rc=OK
---{ zcpSendOnPipe
----{ xcsResetEventSem
-----{ xllResetSocketEvent
------{ xllSpinLockRequest
------} xllSpinLockRequest rc=OK
------{ xllSpinLockRelease
------} xllSpinLockRelease rc=OK
-----} xllResetSocketEvent rc=OK
----} xcsResetEventSem rc=OK
----{ xcsPostEventSem
-----{ xllPostSocketEvent
------{ xllSpinLockRequest
------} xllSpinLockRequest rc=OK
------{ xllRecoverSocketEvent
------} xllRecoverSocketEvent rc=OK
------{ xllSpinLockRelease
------} xllSpinLockRelease rc=OK
-----} xllPostSocketEvent rc=OK
----} xcsPostEventSem rc=OK
---} zcpSendOnPipe rc=OK
---{ zcpReceiveOnPipe
----{ xcsWaitEventSem
-----{ xllWaitSocketEvent
------{ xcsGetMem
------} xcsGetMem rc=OK
------{ xcsBuildDumpPtr
-------{ xcsGetMem
-------} xcsGetMem rc=OK
------} xcsBuildDumpPtr rc=OK
------{ xcsStrerror
------} xcsStrerror rc=OK
------{ xcsFFST
socket address passed to bind
6b91b820 00012F76 61722F6D 716D2F71 ../var/mqm/q
6b91b830 6D677273 2F485045 4E56352F 40697063 mgrs/HPENV5/@ipc
6b91b840 632F7373 656D2F73 6F636B65 742E3239 c/ssem/socket.29
6b91b850 3539302E 31000000 00000000 00000000 590.1...........
6b91b860 00000000 00000000 00000000 00000000 ................
6b91b870 00000000 00000000 00000000 00000000 ................
6b91b880 0000 ..
|
Any help would be appreciated. TIA |
|
Back to top |
|
 |
sc |
Posted: Sun Jun 06, 2004 6:07 pm Post subject: |
|
|
Novice
Joined: 06 Sep 2003 Posts: 16
|
Try ipcs to show the inter-process shared memory and semaphores.
On solaris, ipcsrm could be used do the cleanup based on identifiers. I think similar command exists on HPUX |
|
Back to top |
|
 |
Guava72 |
Posted: Mon Jun 07, 2004 12:35 am Post subject: [solved] |
|
|
 Apprentice
Joined: 06 Jun 2003 Posts: 46 Location: Champaign, IL
|
The problem was with directory permissions!
Our UNIX team had moved all of the filesystems over to a new machine, but the permissions got changed somehow...most of the directories under /var/mqm and /opt/mqm were missing group write permissions. So a few well-placed
statements solved the problem.
Also, there was one file (/var/mqm/conv/table/cssid.tbl) that on the "good" system was owned by mqm, but on the new system was owned by root. I asked them to change this as well so I don't know if it mattered. |
|
Back to top |
|
 |
Guava72 |
Posted: Mon Jun 14, 2004 9:01 pm Post subject: [SOLVED!] |
|
|
 Apprentice
Joined: 06 Jun 2003 Posts: 46 Location: Champaign, IL
|
Actually, the /var/mqm and /opt/mqm permissions were only part of the problem. The REAL problem was that some of the system objects of the QM were damaged. I stopped the QM, did a
and started the QM. Then I tested it using our application and it was successful and did not cause 2.1 GB FDC files to get generated! |
|
Back to top |
|
 |
|
|
 |
|
Page 1 of 1 |
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
|
|
|