ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » General Discussion » MQ Hangs at Startup

Post new topic  Reply to topic
 MQ Hangs at Startup « View previous topic :: View next topic » 
Author Message
scott9
PostPosted: Wed Dec 17, 2008 2:31 pm    Post subject: MQ Hangs at Startup Reply with quote

Acolyte

Joined: 11 Jul 2002
Posts: 62
Location: Sacramento,CA

O/S: AIX 5.1 << old...We know
MQ: Version 5.3 CSD10 << Yeah, we know about this too

Sorry to post about problems in obsolete versions, but my customer is not in a position to upgrade yet. Also, I was not involved in the initial troubleshooting, so I did not see the environment and I have no trace data.

I'm investigating an issue related to a long MQ startup. It normally takes 1 minute to start.
1. The strmqm cmd hung for 2 hrs.
2. They issue endmqm after 2 hrs, but the status remained 'Starting'.
3. They eventually killed the processes and reissued strmqm. It took 1.5 hrs to start on the second attempt.

Only significant FDC is related to busy semaphore for runmqsc. There was also an FDC for busy semaphore on rcrmqobj, but this happened after they killed processes and reissued strmqm.

One thing to note is that there was another qmgr recycled on the system and went into Running status without any issues (seperate filesystem).

My questions:
1. I can't discount the FDC about rcrmqobj...could this just be MQ taking a long time to recover damaged objects? ...and is it possible they damaged the objects by killing the processes on the first attempt?

...if "Yes" to #1, then I still don't have a good reason for the initial delay.

2. Oracle and Message broker are used in this environment and MQ is the XA Coordinator. The endmqm cmd only took 1 minute to complete. If there were any XA rollbacks, I would expect them to occur at shutdown. Is it possible that there were XA rollbacks being processed upon startup?

3. The channel between the qmgr and configuration manager started just prior to the shutdown. Is it possible the config mgr gave the qmgr a batch of work prior to shutdown to be processed at next startup?

4. Any other thoughts on what could keep MQ so busy at startup?
Back to top
View user's profile Send private message
fjb_saper
PostPosted: Thu Dec 18, 2008 12:53 am    Post subject: Reply with quote

Grand High Poobah

Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY

With the "semaphore" stuff and shared memory I'd go for checking the shared memory and seeing what is using it up first...
Try ipcs | more.....

Before restart I would also "clean" the qmgr's ipc resources. Note that the qmgr has to be STOPPED to do this: <mqinstal>/bin/amqiclen -xhvm QMGR

It will slow the restart of the qmgr (by less than a minute) because it has to reacquire shared memory, but in your case this seems to be well worth it.

Finally and as the qmgr is transaction coordinator for the DB, you said nothing about DB load and available DB connections at the time of restart.
Don't know what happens if the qmgr would have to wait for a db connection...

Have fun
_________________
MQ & Broker admin
Back to top
View user's profile Send private message Send e-mail
Display posts from previous:   
Post new topic  Reply to topic Page 1 of 1

MQSeries.net Forum Index » General Discussion » MQ Hangs at Startup
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.