| Author |
Message
|
| MQ_user1 |
 Posted: Mon Jun 14, 2010 11:34 pm Post subject: Queue manager down after installing fix pack 6.0.2.9 |
 |
|
Novice
Joined: 09 Jun 2010
Posts: 19
|
Hi Can anybody tell me the reason for queue manager going down after installing fix pack 6.0.2.9.
It is actually going down when external application tries to connect to this queue manager.
Q-manager error log below:
=================
06/14/10 22:16:40 - Process(876630.1) User(mqm) Program(runmqchi)
AMQ9510: Messages cannot be retrieved from a queue.
EXPLANATION:
The attempt to get messages from queue 'SYSTEM.CHANNEL.INITQ' on queue manager
'D15N01T' failed with reason code 2009.
ACTION:
If the reason code indicates a conversion problem, for example
MQRC_SOURCE_CCSID_ERROR, remove the message(s) from the queue. Otherwise,
ensure that the required queue is available and operational.
----- amqrimna.c : 957 --------------------------------------------------------
06/14/10 22:16:40 - Process(2330798.1) User(mqm) Program(amqzmgr0)
AMQ5023: The Channel Initiator has ended. ProcessId(876630).
EXPLANATION:
The Channel Initiator process has ended.
ACTION:
None.
-------------------------------------------------------------------------------
06/14/10 22:16:40 - Process(2330798.1) User(mqm) Program(amqzmgr0)
AMQ5025: The Command Server has ended. ProcessId(1335306).
EXPLANATION:
The Command Server process has ended.
ACTION:
None.
-------------------------------------------------------------------------------
06/14/10 22:16:50 - Process(1216670.1) User(mqm) Program(amqrrmfa)
AMQ9510: Messages cannot be retrieved from a queue.
EXPLANATION:
The attempt to get messages from queue 'SYSTEM.CLUSTER.REPOSITORY.QUEUE' on
queue manager 'D15N01T' failed with reason code 2009.
ACTION:
If the reason code indicates a conversion problem, for example
MQRC_SOURCE_CCSID_ERROR, remove the message(s) from the queue. Otherwise,
ensure that the required queue is available and operational.
----- amqrfica.c : 397 --------------------------------------------------------
06/14/10 22:16:50 - Process(1216670.1) User(mqm) Program(amqrrmfa)
AMQ9411: Repository manager ended normally.
EXPLANATION:
The repository manager ended normally.
ACTION:
None.
-------------------------------------------------------------------------------
06/14/10 22:17:39 - Process(2183402.5) User(mqm) Program(runmqlsr_nd)
AMQ9508: Program cannot connect to the queue manager.
EXPLANATION:
The connection attempt to queue manager 'D15N01T' failed with reason code 2059.
ACTION:
Ensure that the queue manager is available and operational.
----- amqrmsaa.c : 324 --------------------------------------------------------
06/14/10 22:17:39 - Process(2183402.5) User(mqm) Program(runmqlsr_nd)
AMQ9999: Channel program ended abnormally.
EXPLANATION:
Channel program 'D01N01T.TO.D15N01T' ended abnormally.
ACTION:
Look at previous error messages for channel program 'D01N01T.TO.D15N01T' in the
error files to determine the cause of the failure.
----- amqrmrsa.c : 487 --------------------------------------------------------
06/14/10 22:18:39 - Process(2183402.6) User(mqm) Program(runmqlsr_nd)
AMQ9508: Program cannot connect to the queue manager.
EXPLANATION:
The connection attempt to queue manager 'D15N01T' failed with reason code 2059.
ACTION:
Ensure that the queue manager is available and operational.
----- amqrmsaa.c : 324 --------------------------------------------------------
06/14/10 22:18:39 - Process(2183402.6) User(mqm) Program(runmqlsr_nd)
AMQ9999: Channel program ended abnormally.
EXPLANATION:
Channel program 'D01N01T.TO.D15N01T' ended abnormally.
ACTION:
Look at previous error messages for channel program 'D01N01T.TO.D15N01T' in the
error files to determine the cause of the failure.
----- amqrmrsa.c : 487 --------------------------------------------------------
06/14/10 22:19:39 - Process(2183402.7) User(mqm) Program(runmqlsr_nd)
AMQ9508: Program cannot connect to the queue manager.
EXPLANATION:
The connection attempt to queue manager 'D15N01T' failed with reason code 2059.
ACTION:
Ensure that the queue manager is available and operational.
----- amqrmsaa.c : 324 --------------------------------------------------------
and it has generated some FDC files as well.
Please can anyone respond to this ASAP?
Thanks
Anand |
|
| Back to top |
|
 |
| fjb_saper |
| Posted: Tue Jun 15, 2010 2:41 am Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
Looking at your errors I'd first check if the /var/mqm file system is mounted correctly and has the right ownership (mqm:mqm) and permissions rw-rw---
and rwxrwx--- for directories...
Have fun 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| ramires |
| Posted: Tue Jun 15, 2010 2:50 am Post subject: |
|
|
Knight
Joined: 24 Jun 2001
Posts: 523
Location: Portugal - Lisboa
|
| and FDC it's a very useful piece of information. Can you start the queue manager? Do you start it and it goes down right after? |
|
| Back to top |
|
|
| Vitor |
| Posted: Tue Jun 15, 2010 5:20 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
Is this on AIX? I saw something similar on some (not all) 6.0.2.8 upgrades.
I brought the queue manager down, ensured via ps -ef that all processes were stopped (which needed a bit of kill -9) and did a strmqm -c to recreate the system objects.
This worked in each of my cases and I offer it for what it's worth. Aside from that, the advice above is good advice (though I didn't get any FDCs).
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| MQ_user1 |
| Posted: Tue Jun 15, 2010 5:21 am Post subject: |
|
|
Novice
Joined: 09 Jun 2010
Posts: 19
|
I can start the queue manager but after some time its going down.
while it is running it can receive messages but wehn try to send messages its going down with the error mentioned earlier.
FDC log below when starting QMGR:
=========
WebSphere MQ First Failure Symptom Report |
| ========================================= |
| |
| Date/Time :- Tuesday June 15 14:18:33 BST 2010 |
| Host Name :- d15n01e0 (AIX 5.3) |
| PIDS :- 5724H7201 |
| LVLS :- 6.0.2.9 |
| Product Long Name :- WebSphere MQ for AIX |
| Vendor :- IBM |
| Probe Id :- RM220005 |
| Application Name :- MQM |
| Component :- rrmRepository |
| SCCS Info :- cmd/remote/amqrrmfa.c, 1.414.1.51 |
| Line Number :- 2895 |
| Build Date :- Mar 16 2010 |
| CMVC level :- p600-209-100316 |
| Build Type :- IKAP - (Production) |
| UserID :- 00000461 (mqm) |
| Program Name :- amqrrmfa |
| Addressing mode :- 64-bit |
| Process :- 1720340 |
| Thread :- 1 |
| QueueManager :- D15N01T |
| ConnId(1) IPCC :- 13 |
| ConnId(2) QM :- 13 |
| Last HQC :- 1.0.0-836248 |
| Last HSHMEMB :- 1.2.2-20984 |
| Major Errorcode :- rrcE_MQGET_FAILED |
| Minor Errorcode :- OK |
| Probe Type :- MSGAMQ9510 |
| Probe Severity :- 2 |
| Probe Description :- AMQ9510: Messages cannot be retrieved from a queue. |
| FDCSequenceNumber :- 0 |
| |
+-----------------------------------------------------------------------------+
MQM Function Stack
rrmRepository
xcsFFST
MQM Trace History
----{ rfxLINK
----} rfxLINK rc=OK
----{ rfxLINK
----} rfxLINK rc=OK
----{ rfxLINK
----} rfxLINK rc=OK
----{ rfxLINK
----} rfxLINK rc=OK
----{ rfxLINK
----} rfxLINK rc=OK
----{ rfxLINK
----} rfxLINK rc=OK
----{ rfxLINK
----} rfxLINK rc=OK
----{ rfxLINK
----} rfxLINK rc=OK
----{ rfxLINK
----} rfxLINK rc=OK
----{ rfxLINK
----} rfxLINK rc=OK
----{ rfxLINK
----} rfxLINK rc=OK
----{ rfxLINK
----} rfxLINK rc=OK
----{ rfxLINK
----} rfxLINK rc=OK
----{ xcsReleaseMutexSem
-----{ xlsReleaseMutex
-----} xlsReleaseMutex rc=OK
----} xcsReleaseMutexSem rc=OK
---} rfxCheckRegister rc=OK
---{ rfxEnumCLQMGRU
----{ xcsRequestMutexSem
----} xcsRequestMutexSem rc=OK
----{ rfxLINK
----} rfxLINK rc=OK
----{ xcsReleaseMutexSem
-----{ xlsReleaseMutex
-----} xlsReleaseMutex rc=OK
----} xcsReleaseMutexSem rc=OK
---} rfxEnumCLQMGRU rc=OK
---{ rrmCommit
----{ MQCMIT
-----{ zstMQCMIT
------{ zstVerifyPCD
------} zstVerifyPCD rc=OK
------{ ziiMQCMIT
-------{ ziiCreateIPCCMessage
--------{ zcpCreateMessage
--------} zcpCreateMessage rc=OK
-------} ziiCreateIPCCMessage rc=OK
-------{ ziiSendReceiveAgent
--------{ zcpSendOnPipe
---------{ xcsResetEventSem
---------} xcsResetEventSem rc=OK
---------{ xcsPostEventSem
----------{ xlsLockEvent
----------} xlsLockEvent rc=OK |
|
| Back to top |
|
|
| MQ_user1 |
| Posted: Tue Jun 15, 2010 6:51 am Post subject: |
|
|
Novice
Joined: 09 Jun 2010
Posts: 19
|
| Can anybody has update on this please? |
|
| Back to top |
|
|
| Vitor |
| Posted: Tue Jun 15, 2010 7:54 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| MQ_user1 wrote: |
| Can anybody has update on this please? |
No more than I already have. 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| ramires |
| Posted: Tue Jun 15, 2010 2:55 pm Post subject: |
|
|
Knight
Joined: 24 Jun 2001
Posts: 523
Location: Portugal - Lisboa
|
|
| Back to top |
|
|
| MQ_user1 |
| Posted: Thu Jun 17, 2010 5:05 am Post subject: |
|
|
Novice
Joined: 09 Jun 2010
Posts: 19
|
Finally It is resolved now....
Q Manager is starting.......when external application(adapter) is starting it is not loading 64 bit libraries to connect to Q Manager(6.0.2.9) so there char set encoding at each side takes place and are not compatable hence Q Manager was crashing down.
It is now pointed to load lib64 libraries. Q Manager is running good.
Thanks friends for your help. |
|
| Back to top |
|
|
|
|
