ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » General IBM MQ Support » AMQ6119...it seems applications get stuck connecting to QM

Post new topic  Reply to topic
 AMQ6119...it seems applications get stuck connecting to QM « View previous topic :: View next topic » 
Author Message
Guava72
PostPosted: Sun Jun 06, 2004 1:08 am    Post subject: AMQ6119...it seems applications get stuck connecting to QM Reply with quote

Apprentice

Joined: 06 Jun 2003
Posts: 46
Location: Champaign, IL

Hi, we're having trouble when our application tries to use its Queue Manager. We're using MQSeries 5.3 (base product, no CSD) on HP-UX 11i. Just today, we "migrated" the machine to a more powerful one, but I think something happened during the move...I checked the kernel parameters and they are at or above the IBM recommendations. Is there a way I can clean up the shared memory and semaphores? I'd like to shut everything down and "clean up", and try again...

Code:

06/06/04  03:01:18
AMQ6119: An internal WebSphere MQ error has occurred ('13 - Permission denied' from bind.)

EXPLANATION:
MQ detected an unexpected error when calling the operating system. The MQ errorrecording routine has been called.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support center.  Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 669 --------------------------------------------------------
06/06/04  03:01:18
AMQ6184: An internal WebSphere MQ error has occurred on queue manager HPENV5.

EXPLANATION:
An error has been detected, and the WebSphere MQ error recording routine has
been called. The failing process is process 29590.
ACTION:
Use the standard facilities supplied with your system to record the problem
identifier, and to save the generated output files. Contact your IBM support
center.  Do not discard these files until the problem has been resolved.
----- amqxfdcx.c : 703 --------------------------------------------------------


I killed that process (it was creating HUGE error log files!) but here is the top of the FDC file:

Code:

+-----------------------------------------------------------------------------+
|                                                                             |
| WebSphere MQ First Failure Symptom Report                                   |
| =========================================                                   |
|                                                                             |
| Date/Time         :- Sunday June 06 02:20:27 CDT 2004                       |
| Host Name         :- cmih005 (HP-UX B.11.11)                                |
| PIDS              :- 5724B4102                                              |
| LVLS              :- 530                                                    |
| Product Long Name :- WebSphere MQ for HP-UX                                 |
| Vendor            :- IBM                                                    |
| Probe Id          :- XY029001                                               |
| Application Name  :- MQM                                                    |
| Component         :- xllOurSocket                                           |
| Build Date        :- Oct 21 2002                                            |
| CMVC level        :- p000-L021011                                           |
| Build Type        :- IKAP - (Production)                                    |
| UserID            :- 00000122 (utxoln5)                                     |
| Program Name      :- rmsUVadOrd                                             |
| Process           :- 00029590                                               |
| QueueManager      :- HPENV5                                                 |
| Major Errorcode   :- xecF_E_UNEXPECTED_SYSTEM_RC                            |
| Minor Errorcode   :- OK                                                     |
| Probe Type        :- MSGAMQ6119                                             |
| Probe Severity    :- 2                                                      |
| Probe Description :- AMQ6119: An internal WebSphere MQ error has occurred   |
|   ('13 - Permission denied' from bind.)                                     |
| FDCSequenceNumber :- 0                                                      |
| Arith1            :- 13 d                                                   |
| Comment1          :- '13 - Permission denied' from bind.                    |
|                                                                             |
|                                                                             |
+-----------------------------------------------------------------------------+

MQM Function Stack
ziiMQCONN
ziiConnectToAgent
ziiStartAgent
zcpReceiveOnPipe
xcsWaitEventSem
xllWaitSocketEvent
xcsFFST

MQM Trace History
{ xppInitialiseDestructorRegistrations
} xppInitialiseDestructorRegistrations rc=OK
{ InitProcessInitialisation
-{ xcsLoadFunction
--{ xcsQueryValueForSubpool
--} xcsQueryValueForSubpool rc=OK
-} xcsLoadFunction rc=OK
} InitProcessInitialisation rc=OK
} xcsInitialize rc=OK
{ zstMQConnect
{ zutBlankPad
} zutBlankPad rc=OK
{ zutIsItBlank
} zutIsItBlank rc=OK
{ zutCheckQMName
-{ zutCheckValidName
-} zutCheckValidName rc=OK
} zutCheckQMName rc=OK
{ zutCvtMQName2Str
} zutCvtMQName2Str rc=OK
{ zstGetPCDbyTID
} zstGetPCDbyTID rc=OK
{ zstInitCS
-{ xcsInitialize
--{ InitPrivateServices
---{ xcsGetpwuid
---} xcsGetpwuid rc=OK
--} InitPrivateServices rc=OK
--{ xcsConnectSharedSubpool
---{ xcsAttachSharedSubpool
----{ xcsGetMem
----} xcsGetMem rc=OK
----{ xcsGetMem
----} xcsGetMem rc=OK
----{ xcsConnectSharedMemSet
-----{ xstAttachSharedMemSet
------{ xstConnectExtent
-------{ xstGetShmIdFromFile
-------} xstGetShmIdFromFile rc=OK
------} xstConnectExtent rc=OK
------{ xcsGetMem
------} xcsGetMem rc=OK
------{ xcsGetMem
------} xcsGetMem rc=OK
-----} xstAttachSharedMemSet rc=OK
----} xcsConnectSharedMemSet rc=OK
----{ xcsDestroySubpoolIfInvalid
-----{ xcsGetSetConnectCount
------{ xstGetExtentConnectCount
------} xstGetExtentConnectCount rc=OK
-----} xcsGetSetConnectCount rc=OK
----} xcsDestroySubpoolIfInvalid rc=OK
----{ xcsAllocateQuickCell
-----{ xllSpinLockRequest
-----} xllSpinLockRequest rc=OK
-----{ xllSpinLockRelease
-----} xllSpinLockRelease rc=OK
----} xcsAllocateQuickCell rc=OK
----{ xllSpinLockRequest
----} xllSpinLockRequest rc=OK
----{ xcsAttachSetExtents
----} xcsAttachSetExtents rc=OK
----{ xllSpinLockRelease
----} xllSpinLockRelease rc=OK
---} xcsAttachSharedSubpool rc=OK
--} xcsConnectSharedSubpool rc=OK
--{ xxxInitialize
---{ xcsSetlocale
---} xcsSetlocale rc=OK
---{ xcsGetMem
---} xcsGetMem rc=OK
--} xxxInitialize rc=OK
-} xcsInitialize rc=OK
} zstInitCS rc=OK
{ ztmInitialise
} ztmInitialise rc=OK
{ zstInsertPCD
-{ xcsGetMem
-} xcsGetMem rc=OK
-{ zstGetApplIds
--{ xcsQueryValueForSubpool
--} xcsQueryValueForSubpool rc=OK
--{ xcsQueryValueForSubpool
--} xcsQueryValueForSubpool rc=OK
--{ xcsQueryValueForSubpool
--} xcsQueryValueForSubpool rc=OK
--{ xcsQueryValueForSubpool
--} xcsQueryValueForSubpool rc=OK
--{ zstQueryThreadId
--} zstQueryThreadId rc=Unknown(1)
-} zstGetApplIds rc=OK
} zstInsertPCD rc=OK
{ xcsRegisterDestructor
} xcsRegisterDestructor rc=OK
{ ziiInitialise
} ziiInitialise rc=OK
{ ziiMQCONN
-{ ziiConnectToAgent
--{ zcpAttachPipe
---{ xcsConnectSharedMemSet
----{ xllSpinLockRequest
----} xllSpinLockRequest rc=OK
----{ xllSpinLockRelease
----} xllSpinLockRelease rc=OK
----{ xstAttachSharedMemSet
-----{ xstConnectExtent
------{ xllSpinLockRequest
------} xllSpinLockRequest rc=OK
------{ xllSpinLockRelease
------} xllSpinLockRelease rc=OK
-----} xstConnectExtent rc=OK
-----{ xcsGetMem
-----} xcsGetMem rc=OK
-----{ xcsGetMem
-----} xcsGetMem rc=OK
----} xstAttachSharedMemSet rc=OK
---} xcsConnectSharedMemSet rc=OK
---{ xcsRequestMutexSem
----{ xllRequestSocketMutex
-----{ xllSpinLockRequest
-----} xllSpinLockRequest rc=OK
-----{ xllSpinLockRelease
-----} xllSpinLockRelease rc=OK
----} xllRequestSocketMutex rc=OK
---} xcsRequestMutexSem rc=OK
---{ xcsRegisterDestructor
---} xcsRegisterDestructor rc=OK
--} zcpAttachPipe rc=OK
--{ ziiStartAgent
---{ ziiCreateIPCCMessage
----{ zcpCreateMessage
----} zcpCreateMessage rc=OK
---} ziiCreateIPCCMessage rc=OK
---{ zcpSendOnPipe
----{ xcsResetEventSem
-----{ xllResetSocketEvent
------{ xllSpinLockRequest
------} xllSpinLockRequest rc=OK
------{ xllSpinLockRelease
------} xllSpinLockRelease rc=OK
-----} xllResetSocketEvent rc=OK
----} xcsResetEventSem rc=OK
----{ xcsPostEventSem
-----{ xllPostSocketEvent
------{ xllSpinLockRequest
------} xllSpinLockRequest rc=OK
------{ xllRecoverSocketEvent
------} xllRecoverSocketEvent rc=OK
------{ xllSpinLockRelease
------} xllSpinLockRelease rc=OK
-----} xllPostSocketEvent rc=OK
----} xcsPostEventSem rc=OK
---} zcpSendOnPipe rc=OK
---{ zcpReceiveOnPipe
----{ xcsWaitEventSem
-----{ xllWaitSocketEvent
------{ xcsGetMem
------} xcsGetMem rc=OK
------{ xcsBuildDumpPtr
-------{ xcsGetMem
-------} xcsGetMem rc=OK
------} xcsBuildDumpPtr rc=OK
------{ xcsStrerror
------} xcsStrerror rc=OK
------{ xcsFFST

socket address passed to bind
6b91b820             00012F76  61722F6D  716D2F71        ../var/mqm/q
6b91b830   6D677273  2F485045  4E56352F  40697063 mgrs/HPENV5/@ipc
6b91b840   632F7373  656D2F73  6F636B65  742E3239    c/ssem/socket.29
6b91b850   3539302E  31000000  00000000  00000000    590.1...........
6b91b860   00000000  00000000  00000000  00000000    ................
6b91b870   00000000  00000000  00000000  00000000    ................
6b91b880   0000                                      ..



Any help would be appreciated. TIA
Back to top
View user's profile Send private message Send e-mail
sc
PostPosted: Sun Jun 06, 2004 6:07 pm    Post subject: Reply with quote

Novice

Joined: 06 Sep 2003
Posts: 16

Try ipcs to show the inter-process shared memory and semaphores.

On solaris, ipcsrm could be used do the cleanup based on identifiers. I think similar command exists on HPUX
Back to top
View user's profile Send private message
Guava72
PostPosted: Mon Jun 07, 2004 12:35 am    Post subject: [solved] Reply with quote

Apprentice

Joined: 06 Jun 2003
Posts: 46
Location: Champaign, IL

The problem was with directory permissions!
Our UNIX team had moved all of the filesystems over to a new machine, but the permissions got changed somehow...most of the directories under /var/mqm and /opt/mqm were missing group write permissions. So a few well-placed
Code:

chmod -R g+w *

statements solved the problem.
Also, there was one file (/var/mqm/conv/table/cssid.tbl) that on the "good" system was owned by mqm, but on the new system was owned by root. I asked them to change this as well so I don't know if it mattered.
Back to top
View user's profile Send private message Send e-mail
Guava72
PostPosted: Mon Jun 14, 2004 9:01 pm    Post subject: [SOLVED!] Reply with quote

Apprentice

Joined: 06 Jun 2003
Posts: 46
Location: Champaign, IL

Actually, the /var/mqm and /opt/mqm permissions were only part of the problem. The REAL problem was that some of the system objects of the QM were damaged. I stopped the QM, did a

Code:

strmqm -c HPENV5


and started the QM. Then I tested it using our application and it was successful and did not cause 2.1 GB FDC files to get generated!
Back to top
View user's profile Send private message Send e-mail
Display posts from previous:   
Post new topic  Reply to topic Page 1 of 1

MQSeries.net Forum Index » General IBM MQ Support » AMQ6119...it seems applications get stuck connecting to QM
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.