Author |
Message
|
maryom |
Posted: Fri May 24, 2013 10:55 am Post subject: NEED HELP!!!! |
|
|
Newbie
Joined: 24 May 2013 Posts: 5
|
We have MQ running on an iseries. It has been running for years, no problem. All of a sudden, on Sunday night, the mget in the program that reads the messages of the receiver queue is taking about 3 seconds for each read. That's about 5 minutes for each 100 messages. Needless to say, everything is backing up and taking forever.
Any ideas? NOTHING changed on our end. |
|
Back to top |
|
 |
fjb_saper |
Posted: Fri May 24, 2013 11:02 am Post subject: |
|
|
 Grand High Poobah
Joined: 18 Nov 2003 Posts: 20756 Location: LI,NY
|
Queue depth changed and the app is reading LIFO?  _________________ MQ & Broker admin |
|
Back to top |
|
 |
maryom |
Posted: Fri May 24, 2013 11:10 am Post subject: |
|
|
Newbie
Joined: 24 May 2013 Posts: 5
|
Queue depth changed months ago with no effect. I don't know if it's LIFO. I'm not that deep into MQ. Where would LIFO be configured? |
|
Back to top |
|
 |
maryom |
Posted: Fri May 24, 2013 11:25 am Post subject: |
|
|
Newbie
Joined: 24 May 2013 Posts: 5
|
I don't see anywhere in the app where LIFO would be configured. It's an RPGLE program. |
|
Back to top |
|
 |
mqjeff |
Posted: Fri May 24, 2013 11:31 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008 Posts: 17447
|
maryom wrote: |
I don't see anywhere in the app where LIFO would be configured. It's an RPGLE program. |
Ignore LIFO, or look it up to see what FJ is hinting at.
There are any number of reasons why MQ could "suddenly" start slowing down.
The first and easiest to diagnose is that the queue is "suddenly" full of a lot of messages all at once. Deep queues take longer to read than shallow queues. |
|
Back to top |
|
 |
maryom |
Posted: Fri May 24, 2013 11:39 am Post subject: |
|
|
Newbie
Joined: 24 May 2013 Posts: 5
|
I've been watching it for 2 days now. What's happening, all of a sudden, is that each mget is taking about 2-3 seconds to complete. It used to fly through the messages. Even if there's only 100 messages on the queue, it takes about 5 minutes to mget them all. I had to stop the receiver channel before the program starts to read, because it was never ending. It was reading them slower than the sender was getting new messages onto the queue, causing the program to never end.
I found this: (none of the links work)
************Beginning of data**************
10/17/12 03:27:46 - Process(25966.1) User(QMQM) Jobname(333059/QMQM/AMQZXMA0 )
AMQ6184: An internal WebSphere MQ error has occurred.
EXPLANATION:
Cause . . . . . : An internal MQ error has occurred on queue manager HMPROD
and the MQ error recording routine has been called. The failing process is
process 25966.
Recovery . . . : Use the standard facilities supplied with your system to
record the problem identifier and to save any generated output files. Use
either the WMQ Support site:
http://www.ibm.com/software/integration/wmq/support/, or IBM Support Assistant
(ISA): http://www.ibm.com/software/support/isa/, to see whether a solution is
already available. If you are unable to find a match, contact your IBM support
center. Do not discard these files until the problem has been resolved.
Technical Description . . . . . . . . : None.
----- amqxfddx.c : 793 -------------------------------------------------------- |
|
Back to top |
|
 |
PeterPotkay |
Posted: Fri May 24, 2013 12:24 pm Post subject: |
|
|
 Poobah
Joined: 15 May 2001 Posts: 7722
|
LIFO equals Last In First Out.
You say each MQGET is taking 3 seconds. Are you sure its not that each MQGET is being called every 2.9999 seconds and the app is taking 2.9999 seconds to do whatever it does before issuing the next MQGET? Maybe some database inserts all of the sudden are taking forever and that is slowing the app down? _________________ Peter Potkay
Keep Calm and MQ On |
|
Back to top |
|
 |
maryom |
Posted: Sat May 25, 2013 2:17 am Post subject: |
|
|
Newbie
Joined: 24 May 2013 Posts: 5
|
I put some "write to log" statements, and it's definitely the get statement that's holding things up. Everything else is microseconds. I'm starting to think we need some PTF's. This process has been running for years; we upgraded to a new server and new version about 8 months ago. There are fixes out there already for our version. We'll try that and see. |
|
Back to top |
|
 |
imnd |
Posted: Mon Jul 01, 2013 10:44 am Post subject: |
|
|
Newbie
Joined: 01 Jul 2013 Posts: 6
|
So were you able to solve it?? |
|
Back to top |
|
 |
gbaddeley |
Posted: Mon Jul 01, 2013 3:34 pm Post subject: Re: NEED HELP!!!! |
|
|
 Jedi Knight
Joined: 25 Mar 2003 Posts: 2538 Location: Melbourne, Australia
|
maryom wrote: |
We have MQ running on an iseries. It has been running for years, no problem. All of a sudden, on Sunday night, the mget in the program that reads the messages of the receiver queue is taking about 3 seconds for each read. That's about 5 minutes for each 100 messages. Needless to say, everything is backing up and taking forever.
Any ideas? NOTHING changed on our end. |
Ummm... Engage the MQ support team in your organization. They should have good working knowledge of MQ on iSeries and be able to diagnose technical problems in MQ. _________________ Glenn |
|
Back to top |
|
 |
|