Author |
Message
|
just_a_kid |
Posted: Thu Mar 15, 2007 10:05 pm Post subject: MQ Overloaded Session Probelm |
|
|
Apprentice
Joined: 25 Jul 2006 Posts: 28
|
Hi i m having this MQ weird problem (
some of my messages cannot send to queue but some is can )
few hours ago everything was okay
i cannot find listener running on background but when i do
netstat -an|grep 1414 there are so many tcp port listen to 1414
Quote: |
172.22.16.8.1414 172.22.16.7.37117 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37121 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37125 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37128 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37131 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37135 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37138 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37142 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37149 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37154 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37161 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37173 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37183 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37194 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37201 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37204 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37208 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37211 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37216 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37220 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37225 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37235 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37241 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37256 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37263 33580 0 24820 0 ESTABLISHED
172.22.16.8.1414 172.22.16.7.37276 33580 0 24820 0 ESTABLISHED |
then i do ps-ef| grep mqm i found a lot of same entry
Code: |
mqm 10889 173 0 11:47:53 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10923 173 0 11:48:50 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10925 173 0 11:48:55 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10929 173 0 11:48:59 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10940 173 0 11:49:17 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10934 173 0 11:49:03 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10936 173 0 11:49:07 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10938 173 0 11:49:12 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10944 173 0 11:49:23 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10942 173 0 11:49:19 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10946 173 0 11:49:26 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10948 173 0 11:49:29 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10950 173 0 11:49:32 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10952 173 0 11:49:37 ? 0:00 amqcrsta -m ils.queue.manager
mqm 10956 173 0 11:49:46 ? 0:00 amqcrsta -m ils.queue.manager |
what could possibly happen??
Thanks |
|
Back to top |
|
 |
Michael Dag |
Posted: Thu Mar 15, 2007 10:52 pm Post subject: |
|
|
 Jedi Knight
Joined: 13 Jun 2002 Posts: 2607 Location: The Netherlands (Amsterdam)
|
your system is configured to run amqcrsta via inetd
look in the inetd.conf file.
switch to using runmqlsr, if on V6 create a listener object on the queue manager. _________________ Michael
MQSystems Facebook page |
|
Back to top |
|
 |
Michael Dag |
Posted: Thu Mar 15, 2007 10:56 pm Post subject: |
|
|
 Jedi Knight
Joined: 13 Jun 2002 Posts: 2607 Location: The Netherlands (Amsterdam)
|
|
Back to top |
|
 |
just_a_kid |
Posted: Fri Mar 16, 2007 12:40 am Post subject: |
|
|
Apprentice
Joined: 25 Jul 2006 Posts: 28
|
Hi,
mqlistener is on my development
but i just realized that production environment didnt use mq listener |
|
Back to top |
|
 |
just_a_kid |
Posted: Fri Mar 16, 2007 12:43 am Post subject: |
|
|
Apprentice
Joined: 25 Jul 2006 Posts: 28
|
what is the benefit of using listener instead of amqcrsta?
if i want to keep using amqcrsta what should i do?
I believe this could be because of the message load in MQ
Because after i restart the thing few hours ago , everything seems okay until this point of time. |
|
Back to top |
|
 |
Michael Dag |
Posted: Fri Mar 16, 2007 1:03 am Post subject: |
|
|
 Jedi Knight
Joined: 13 Jun 2002 Posts: 2607 Location: The Netherlands (Amsterdam)
|
just_a_kid, time to grow up!
on the top right hand of your screen there is a search button,
type 'amqrsta' and 'listener' ...
a world of wealth will open to you... _________________ Michael
MQSystems Facebook page |
|
Back to top |
|
 |
just_a_kid |
Posted: Fri Mar 16, 2007 1:19 am Post subject: |
|
|
Apprentice
Joined: 25 Jul 2006 Posts: 28
|
Hi
Thanks for the insight.
Now i know that i better use runmqlsr in version 5.3 and above
Thanks |
|
Back to top |
|
 |
just_a_kid |
Posted: Fri Mar 16, 2007 1:32 am Post subject: |
|
|
Apprentice
Joined: 25 Jul 2006 Posts: 28
|
Hi ,
Now i hitting back the same problem..
I suspect one particular queue cannot handle too many messages at same time?
Below is the definition of my queue that my application failed to send over
Code: |
DESCR( ) PROCESS( )
BOQNAME( ) INITQ( )
TRIGDATA( ) CLUSTER( )
CLUSNL( ) QUEUE(SCMQ.QUEUE)
CRDATE(2006-11-14) CRTIME(11.19.26)
ALTDATE(2006-11-14) ALTTIME(11.19.26)
GET(ENABLED) PUT(ENABLED)
DEFPRTY(0) DEFPSIST(NO)
MAXDEPTH(5000) MAXMSGL(4194304)
BOTHRESH(0) SHARE
DEFSOPT(SHARED) HARDENBO
MSGDLVSQ(PRIORITY) RETINTVL(999999999)
USAGE(NORMAL) NOTRIGGER
TRIGTYPE(FIRST) TRIGDPTH(1)
TRIGMPRI(0) QDEPTHHI(80)
QDEPTHLO(20) QDPMAXEV(ENABLED)
QDPHIEV(DISABLED) QDPLOEV(DISABLED)
QSVCINT(999999999) QSVCIEV(NONE)
DISTL(NO) DEFTYPE(PREDEFINED)
TYPE(QLOCAL) SCOPE(QMGR)
DEFBIND(OPEN) IPPROCS(0)
OPPROCS(0) CURDEPTH(0) |
QDEPTHHI(80)
is this talking about maxium 80 messages or 80%?? |
|
Back to top |
|
 |
Vitor |
Posted: Fri Mar 16, 2007 1:56 am Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
No, that's the High Water Mark for event messages. The maximum number of messages in a queue is defined by the MAXDEPTH parameter; yours shows the default value of 5000.
Check out the DEFINE QUEUE command description which lists all of these parameters for full information, and a better description than mine of the use of QDEPTHHI _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
just_a_kid |
Posted: Sun Mar 18, 2007 5:17 pm Post subject: |
|
|
Apprentice
Joined: 25 Jul 2006 Posts: 28
|
Then it should be the queue problem.
Because when it process a lot of messages the mq or rather the connection is start behaving weirdly and refuse some of the connection ( i see a lot of amqcrsta created probably around 50 )
The process is as below
1. my background jobs will read the table
2. each row in the table will processed to mq using java
3. when trying to send the messages to mq it will open connection with mq and send the message.
in normal scenario when it processes like 30-50 messages it is okay.
but when we start to process 300-400 messages it starts behaving badly and the mq connection from java to mq couldnt be established.
Thanks |
|
Back to top |
|
 |
kevinf2349 |
Posted: Sun Mar 18, 2007 5:53 pm Post subject: |
|
|
 Grand Master
Joined: 28 Feb 2003 Posts: 1311 Location: USA
|
...so why do you think that means it is a 'queue problem' and not an application problem?
It sure sounds like an application problem to me especially if MQ connections are failing (you can't do anything with a queue without a connection).
By the way the QDEPTHHI is irrelevant to your 'queue problem' as you aren't even trapping queue events for this queue
Code: |
QDPHIEV(DISABLED) QDPLOEV(DISABLED) |
|
|
Back to top |
|
 |
Vitor |
Posted: Mon Mar 19, 2007 1:22 am Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
just_a_kid wrote: |
Because when it process a lot of messages the mq or rather the connection is start behaving weirdly and refuse some of the connection ( i see a lot of amqcrsta created probably around 50 )
|
I'm with kevinf2349 on this. If it was an MQ problem like you're hitting the maximum number of connections/handles then a) you should get an error rather than "behaving weirdly" (and 50 is not a large number of amqcrsta) and b) it's still an application problem rather than an MQ one because it's your application incorrectly handling connections under load! _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
|