Author |
Message
|
david gui |
Posted: Tue Aug 01, 2006 7:49 pm Post subject: MQ found many 'amqzlaa0' process,until OS cann't telnet! |
|
|
Newbie
Joined: 01 Aug 2006 Posts: 5
|
vi AMQ21834.0.FDC
+-----------------------------------------------------------------------------+
| |
| MQSeries First Failure Symptom Report |
| ===================================== |
| |
| Date/Time :- Tuesday August 01 09:32:34 EAT 2006 |
| Host Name :- hnmq-C (HP-UX B.11.11) |
| PIDS :- 5765B74 |
| LVLS :- 520 |
| Product Long Name :- MQSeries for HP-UX |
| Vendor :- IBM |
| Probe Id :- AO074001 |
| Application Name :- MQM |
| Component :- aocReaper |
| Build Date :- Oct 29 2003 |
| CMVC level :- p520-08-031028 |
| Build Type :- IKAP - (Production) |
| UserID :- 00000107 (mqm) |
| Program Name :- amqzxma0_d |
| Process :- 00021834 |
| Thread :- 00000001 |
| QueueManager :- CDMA_QM |
| Major Errorcode :- arcE_OPERATION_FAILED |
| Minor Errorcode :- OK |
| Probe Type :- INCORROUT |
| Probe Severity :- 2 |
| Probe Description :- AMQ6125: An internal MQSeries error has occurred. |
| |
+-----------------------------------------------------------------------------+
MQM Function Stack
kpiStartup
apiStartup
aocReaper
xcsFFST
MQM Trace History
---------} aduAllocFileCtl rc=OK
---------{ aduBuildOSName
---------} aduBuildOSName rc=OK
---------{ adiOpenFile
---------} adiOpenFile rc=OK
--------} adhOpen rc=OK
-------} aqpOpen rc=OK
-------{ adhWrite
--------{ aduLocateFileCtl
--------} aduLocateFileCtl rc=OK
--------{ adiWriteFile
--------} adiWriteFile rc=OK
-------} adhWrite rc=OK
------} aqpWriteData rc=OK
-----} aqlDoReplayLog rc=OK
-----{ aqmCloseQueue
------{ aqpClose
-------{ adhClose
--------{ aduLocateFileCtl
--------} aduLocateFileCtl rc=OK
..............................................
What's wrong?
Thanks in advance! _________________ Probe Description :- AMQ6125: |
|
Back to top |
|
 |
sebastianhirt |
Posted: Tue Aug 01, 2006 11:32 pm Post subject: |
|
|
Yatiri
Joined: 07 Jun 2004 Posts: 620 Location: Germany
|
I seem to remember that we had the same problem some time ago. But that was on 5.3 CSD7
As you are still on 5.2.
Have you considered updating? At least to CSD12 (I believe that is the latest fix for 5.2) of 5.2?
Otherwise, I would check on the application side, you might have some 'rogue' application that doesn't disconnect properly. |
|
Back to top |
|
 |
mvic |
Posted: Wed Aug 02, 2006 1:01 am Post subject: Re: MQ found many 'amqzlaa0' process,until OS cann't telnet! |
|
|
 Jedi
Joined: 09 Mar 2004 Posts: 2080
|
david gui wrote: |
vi AMQ21834.0.FDC |
The FDC you posted is likely to have been written during a queue manager startup following a catastrophic failure (eg. queue manager processes were ended with signal 9, or for some other reason they ended badly).
It might help us to help you if you provide more details on the problem description "MQ found many 'amqzlaa0' process,until OS cann't telnet!" What was going on on your system - lots of apps? lots of large messages being put/got? etc.? |
|
Back to top |
|
 |
david gui |
Posted: Wed Aug 02, 2006 7:39 am Post subject: |
|
|
Newbie
Joined: 01 Aug 2006 Posts: 5
|
sorry , my information is so few!
hnmq-C-/opt/mqm>uname -a
HP-UX hnmq-C B.11.11 U 9000/800 1089826411 unlimited-user license
to mvic:
The amountsof apps is about 50-60,
The amounts of messages being put/get is about 20-50 per second!
I'm on 5.2!
I will take your suggestion,but how i can get the CSD12 of 5.2 ? Can you give me some info or URL? thanks _________________ Probe Description :- AMQ6125: |
|
Back to top |
|
 |
mvic |
Posted: Wed Aug 02, 2006 8:09 am Post subject: Re: MQ found many 'amqzlaa0' process,until OS cann't telnet! |
|
|
 Jedi
Joined: 09 Mar 2004 Posts: 2080
|
mvic wrote: |
It might help us to help you if you provide more details on the problem description "MQ found many 'amqzlaa0' process,until OS cann't telnet!" |
How many amqzlaa0 processes, how big are they (ie. how much memory are they using)?
A common reason for runaway systems is a very large number of clients connecting, but ending without disconnecting. See also http://www.ibm.com/support/docview.wss?rs=171&uid=swg24006699
If you couldn't run telnet, this is bad... but what is the reason to think it's related to MQ? |
|
Back to top |
|
 |
david gui |
Posted: Wed Aug 02, 2006 8:28 am Post subject: Re: MQ found many 'amqzlaa0' process,until OS cann't telnet! |
|
|
Newbie
Joined: 01 Aug 2006 Posts: 5
|
mvic wrote: |
How many amqzlaa0 processes, how big are they (ie. how much memory are they using)?
If you couldn't run telnet, this is bad... but what is the reason to think it's related to MQ? |
about 400-500 amqzlaa0 processes,98% memory be used! _________________ Probe Description :- AMQ6125: |
|
Back to top |
|
 |
mvic |
Posted: Wed Aug 02, 2006 9:26 am Post subject: Re: MQ found many 'amqzlaa0' process,until OS cann't telnet! |
|
|
 Jedi
Joined: 09 Mar 2004 Posts: 2080
|
david gui wrote: |
about 400-500 amqzlaa0 processes,98% memory be used! |
This implies about 24000-30000 connections to the queue manager. I strongly suspect a runaway situation as I mentioned above. Ensure that the apps disconnect cleanly before ending. If you can't ensure that, tune your TCP/IP keepalive intervals. FYI, this is a relatively common scenario - useful examples might be found by searching this site and/or the internet. |
|
Back to top |
|
 |
david gui |
Posted: Wed Aug 02, 2006 9:49 pm Post subject: |
|
|
Newbie
Joined: 01 Aug 2006 Posts: 5
|
ok! thanks _________________ Probe Description :- AMQ6125: |
|
Back to top |
|
 |
|