Author |
Message
|
ankurlodhi |
Posted: Thu May 23, 2013 5:45 am Post subject: ZX0000001 and HL066062 queue manager fails to start |
|
|
Master
Joined: 19 Oct 2010 Posts: 266
|
Hi there was an activity on the our server last night and since then MQ is not coming up it is giving error
Log not available
i have checked the FDC flies and they are giving the probe ID
below is the content of FDC file.
+-----------------------------------------------------------------------------+
| |
| WebSphere MQ First Failure Symptom Report |
| ========================================= |
| |
| Date/Time :- Thursday May 23 09:30:04 EDT 2013 |
| Host Name :- sbkprdprtweb2 (SunOS 5.9) |
| PIDS :- 5724B4103 |
| LVLS :- 530.8 CSD08 |
| Product Long Name :- WebSphere MQ for Sun Solaris |
| Vendor :- IBM |
| Probe Id :- ZX000001 |
| Application Name :- MQM |
| Component :- ExecCtrlrMain |
| Build Date :- Sep 21 2004 |
| CMVC level :- p530-08-L040921 |
| Build Type :- IKAP - (Production) |
| UserID :- 00000600 (mqm) |
| Program Name :- amqzxma0_nd |
| Process :- 00002350 |
| Thread :- 00000001 |
| QueueManager :- PRDPRTWEB2 |
| Major Errorcode :- xecF_E_UNEXPECTED_RC |
| Minor Errorcode :- lpiRC_LOG_NOT_AVAILABLE |
| Probe Type :- MSGAMQ6118 |
| Probe Severity :- 2 |
| Probe Description :- AMQ6118: An internal WebSphere MQ error has occurred |
| (7017) |
| FDCSequenceNumber :- 0 |
| Arith1 :- 28695 7017 |
| |
+-----------------------------------------------------------------------------+
+-----------------------------------------------------------------------------+
| |
| WebSphere MQ First Failure Symptom Report |
| ========================================= |
| |
| Date/Time :- Thursday May 23 09:30:04 EDT 2013 |
| Host Name :- sbkprdprtweb2 (SunOS 5.9) |
| PIDS :- 5724B4103 |
| LVLS :- 530.8 CSD08 |
| Product Long Name :- WebSphere MQ for Sun Solaris |
| Vendor :- IBM |
| Probe Id :- ZX000001 |
| Application Name :- MQM |
| Component :- ExecCtrlrMain |
| Build Date :- Sep 21 2004 |
| CMVC level :- p530-08-L040921 |
| Build Type :- IKAP - (Production) |
| UserID :- 00000600 (mqm) |
| Program Name :- amqzxma0_nd |
| Process :- 00002350 |
| Thread :- 00000001 |
| QueueManager :- PRDPRTWEB2 |
| Major Errorcode :- xecF_E_UNEXPECTED_RC |
| Minor Errorcode :- lpiRC_LOG_NOT_AVAILABLE |
| Probe Type :- MSGAMQ6118 |
| Probe Severity :- 2 |
| Probe Description :- AMQ6118: An internal WebSphere MQ error has occurred |
| (7017) |
| FDCSequenceNumber :- 0 |
| Arith1 :- 28695 7017 |
| |
+-----------------------------------------------------------------------------+ |
|
Back to top |
|
 |
exerk |
Posted: Thu May 23, 2013 6:15 am Post subject: |
|
|
 Jedi Council
Joined: 02 Nov 2006 Posts: 6339
|
Firstly, the Stack information is only of use to IBM Support, so please don't post it (I've edited it out), and as regards the issue, I think that lpiRC_LOG_NOT_AVAILABLE is a pretty obvious pointer... _________________ It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys. |
|
Back to top |
|
 |
ankurlodhi |
Posted: Thu May 23, 2013 6:23 am Post subject: |
|
|
Master
Joined: 19 Oct 2010 Posts: 266
|
i tried restoring the log files but it's not working. |
|
Back to top |
|
 |
mqjeff |
Posted: Thu May 23, 2013 6:36 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008 Posts: 17447
|
ankurlodhi wrote: |
i tried restoring the log files but it's not working. |
So you changed something before figuring out what was changed in the first place that broke things.
I guess that doesn't usually work. |
|
Back to top |
|
 |
Vitor |
Posted: Thu May 23, 2013 6:43 am Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
ankurlodhi wrote: |
i tried restoring the log files but it's not working. |
Why? Why not do a media recovery instead, which I bet you can't do now because you've overwritten the log files. _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
Vitor |
Posted: Thu May 23, 2013 6:44 am Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
mqjeff wrote: |
ankurlodhi wrote: |
i tried restoring the log files but it's not working. |
So you changed something before figuring out what was changed in the first place that broke things.
I guess that doesn't usually work. |
No, but the "randomly changing things in the hope the magic will come back" is a popular problem resolution technique. Just not an especially successful one. _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
ankurlodhi |
Posted: Thu May 23, 2013 7:37 am Post subject: |
|
|
Master
Joined: 19 Oct 2010 Posts: 266
|
i first looked at the logs there was only 1 primary log files so i restored the fles from the last full back up. and then restarting the queue manager and before doing anything i took the back up of the one existing file.
i checked all the FDC flies created they are all giving these 2 probe id. |
|
Back to top |
|
 |
Vitor |
Posted: Thu May 23, 2013 7:42 am Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
ankurlodhi wrote: |
i first looked at the logs there was only 1 primary log files so i restored the fles from the last full back up. and then restarting the queue manager and before doing anything i took the back up of the one existing file. |
If you really have a queue manager defined with only 1 primary log then I'm amazed you were ever able to use it. Out of the box the default is 3 and even small test systems often need more.
I put it to you that backup was taken post-server work when the other logs were already missing.
If you're using circular logging you can use the unsupported dodge discussed in this forum a lot to recreate them. If you're using linear logs you need a better backup to restore from. _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
ankurlodhi |
Posted: Thu May 23, 2013 7:49 am Post subject: |
|
|
Master
Joined: 19 Oct 2010 Posts: 266
|
First that queue manager was not defined by me
second i checke the QM.ini it has it's entry written 3.
so it's obvious these files were lost.
some time ago cause full backup from one last month didn't had these 2 flies either.
the only option there is left to check in the Tape back up. |
|
Back to top |
|
 |
Vitor |
Posted: Thu May 23, 2013 7:55 am Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
ankurlodhi wrote: |
First that queue manager was not defined by me |
Never said it was. Just commented that when you got an FDC with "LOG NOT AVAILBALE" & looked in the log directory to see only 1 log file this should have raised a red flag
ankurlodhi wrote: |
second i checke the QM.ini it has it's entry written 3. |
Which should have been your first move after saying "only 1 log file? Seriously? What idiot built this queue manager" after looking in the log directory.
ankurlodhi wrote: |
so it's obvious these files were lost. |
And would have been obvious when you made all this checks and without wasting all this time posting here. I mean it's your time and we're happy to hear from you, but tapes take time to find. _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
ankurlodhi |
Posted: Thu May 23, 2013 8:16 am Post subject: |
|
|
Master
Joined: 19 Oct 2010 Posts: 266
|
That is the Thing it will take one whole day to bring the Tapes. |
|
Back to top |
|
 |
Vitor |
Posted: Thu May 23, 2013 8:27 am Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
ankurlodhi wrote: |
That is the Thing it will take one whole day to bring the Tapes. |
So saving that hour could have helped you catch today's delivery. _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
ankurlodhi |
Posted: Thu May 23, 2013 9:58 am Post subject: |
|
|
Master
Joined: 19 Oct 2010 Posts: 266
|
and we are using circular logs. |
|
Back to top |
|
 |
bruce2359 |
Posted: Thu May 23, 2013 10:19 am Post subject: |
|
|
 Poobah
Joined: 05 Jan 2008 Posts: 9469 Location: US: west coast, almost. Otherwise, enroute.
|
Do you know if there are/were messages in queues when the qmgr was shut down?
If there are no messages (or they can be recreated by applications), then you can delete the qmgr, recreate it, and populate it with your object definitions. _________________ I like deadlines. I like to wave as they pass by.
ב''ה
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live. |
|
Back to top |
|
 |
Vitor |
Posted: Thu May 23, 2013 10:29 am Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
ankurlodhi wrote: |
and we are using circular logs. |
Then you can use the dodge I mentioned. _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
|