Author |
Message
|
mqjava |
Posted: Thu Aug 19, 2010 9:49 am Post subject: recover damaged queue |
|
|
 Voyager
Joined: 25 May 2009 Posts: 80 Location: New Jersey
|
Hi All,
One of the local queue is damaged, it says -
Code: |
AMQ8149: WebSphere MQ object damaged. |
I tried to receover the queue by using - rcrmqobj, but it says -
Code: |
AMQ7042: Media image not available for object TEST.QUEUE
of type queue. |
i belive the log required to recreate the TEST.QUEUE is not availble and its been deleted i think, because we delete the logs which are 10 days old.
Is there any other way we can recover the queue?
If we are able to recover the queue using rcrmqobj will the messages in the queue also recovered?
If the queue manager uses circular logging how can we recover the damaged object?
Thanks. |
|
Back to top |
|
 |
Gaya3 |
Posted: Thu Aug 19, 2010 9:54 am Post subject: Re: recover damaged queue |
|
|
 Jedi
Joined: 12 Sep 2006 Posts: 2493 Location: Boston, US
|
mqjava wrote: |
Hi All,
One of the local queue is damaged, it says -
Code: |
AMQ8149: WebSphere MQ object damaged. |
I tried to receover the queue by using - rcrmqobj, but it says -
Code: |
AMQ7042: Media image not available for object TEST.QUEUE
of type queue. |
i belive the log required to recreate the TEST.QUEUE is not availble and its been deleted i think, because we delete the logs which are 10 days old.
Is there any other way we can recover the queue?
If we are able to recover the queue using rcrmqobj will the messages in the queue also recovered?
If the queue manager uses circular logging how can we recover the damaged object?
Thanks. |
its true from your mail, its not a linear logging, so you cant do media recovery.
delete the damaged object and recreate it, by looking the back ups or documentation.  _________________ Regards
Gayathri
-----------------------------------------------
Do Something Before you Die |
|
Back to top |
|
 |
Vitor |
Posted: Thu Aug 19, 2010 10:10 am Post subject: Re: recover damaged queue |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
mqjava wrote: |
i belive the log required to recreate the TEST.QUEUE is not availble and its been deleted i think, because we delete the logs which are 10 days old. |
If you're using linear logging you should only delete the logs the queue manager has confirmed it doesn't need. These (depending on your queue manager housekeeping) may or may not be older that 10 days.
If you're using circular logging you shouldn't be deleting log files at all.
mqjava wrote: |
Is there any other way we can recover the queue? |
File system restore or DEFINE QLOCAL
mqjava wrote: |
If we are able to recover the queue using rcrmqobj will the messages in the queue also recovered? |
Yes
mqjava wrote: |
If the queue manager uses circular logging how can we recover the damaged object? |
File system restore or DEFINE QLOCAL _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
mqjava |
Posted: Thu Aug 19, 2010 12:49 pm Post subject: |
|
|
 Voyager
Joined: 25 May 2009 Posts: 80 Location: New Jersey
|
Quote: |
its true from your mail, its not a linear logging, so you cant do media recovery.
|
Gaya3 thanks for the reply, this queue manager is using liner logging.
Vitor,
We have deleted the logs which are not needed and confirmed by queue manager. We use the log cleanup script from IBM. But still we dont have the log required to create the damaged queue.
Thanks for answering all my other questions.
Thanks |
|
Back to top |
|
 |
Vitor |
Posted: Thu Aug 19, 2010 1:08 pm Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
mqjava wrote: |
We have deleted the logs which are not needed and confirmed by queue manager. We use the log cleanup script from IBM. But still we dont have the log required to create the damaged queue. |
Then you have a serious problem & should raise a PMR. The "oldest log file" reported by the queue manager takes account of what is needed for media recovery. If it's reporting that you can delete a log, then reporting it doesn't have the log it needs, this is a software defect and a potentially distasterous one for those WMQ sites that rely on this feature.
Or there's a problem with the way you're recording media images in the logs.  _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
mqjava |
Posted: Fri Aug 20, 2010 6:06 am Post subject: |
|
|
 Voyager
Joined: 25 May 2009 Posts: 80 Location: New Jersey
|
Quote: |
Or there's a problem with the way you're recording media images in the logs. |
Hi Vitor,
I am using v 1.18 of the cleanmqlogs by shelden, before running this cleanmqlogs script first our script will delete the .Z files(zipped) which are more than 10 days old, then run the below command - /usr/bin/rcdmqimg -l -m $QMGR -t '*' '*', then it will execute the cleanmqlogs script by shelden, This is the way i have set it to run, do you see any problem in this approach?
Thanks |
|
Back to top |
|
 |
Vitor |
Posted: Fri Aug 20, 2010 6:13 am Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
mqjava wrote: |
do you see any problem in this approach? |
If there's no problem, why is the media image not available for you to recover the damaged queue?
I assume by "v1.18 of the cleanlogs by shelden" you mean MS62 which is currently at v2. From the support pac page:
Quote: |
Gzip is the default so that if the script makes a mistake and thinks it should delete a logfile that the queue manager needs, the file will not be permanently removed. |
So a) why are you deleting these files & b) how did you come up with 10 days? _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
mqjava |
Posted: Fri Aug 20, 2010 6:21 am Post subject: |
|
|
 Voyager
Joined: 25 May 2009 Posts: 80 Location: New Jersey
|
Vitor wrote: |
If there's no problem, why is the media image not available for you to recover the damaged queue? ? |
Thats the reason i want to findout.
Vitor wrote: |
a) why are you deleting these files & b) how did you come up with 10 days? |
a) If we let the .Z files growing then it will fill up the filesystem one day.
b) this is a test env QM, we dont have much storage for /var/mqm, so decided 10 days old .Z files should be deleted. |
|
Back to top |
|
 |
Vitor |
Posted: Fri Aug 20, 2010 6:36 am Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
mqjava wrote: |
b) this is a test env QM |
You have a test queue manager with a linear log? Unusual (since there's typically limited storage and no requirement for recovery) but ok.
I recommend 2 actions:
1) Review the decision about 10 days. I don't know how you "decided" but wonder if it was just a finger in the area rather than based on fact;
2) Fix the bug in your rcdmqimg command.
I've not used the support pac in question myself, but I've always used the queue manager messgaes to determine log requirements and by extension those which are not required.
Where I've been on sites that do use support pacs for linear logging, they've used MS0L which is a Cat 2 from IBM (and more frequently maintained I notice). No disrespect is intended to the other pac or it's authors, not is this a recommendation to change. _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
bruce2359 |
Posted: Fri Aug 20, 2010 7:12 am Post subject: |
|
|
 Poobah
Joined: 05 Jan 2008 Posts: 9469 Location: US: west coast, almost. Otherwise, enroute.
|
Quote: |
If we are able to recover the queue using rcrmqobj will the messages in the queue also recovered? |
Yes, but only if you rcdmqobj of the TEST.QUEUE before you attempt to rcrmqimg to recover the queue object.
Did you rcdmqobj TEST.QUEUE? _________________ I like deadlines. I like to wave as they pass by.
ב''ה
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live. |
|
Back to top |
|
 |
mqjava |
Posted: Fri Aug 20, 2010 7:27 am Post subject: |
|
|
 Voyager
Joined: 25 May 2009 Posts: 80 Location: New Jersey
|
bruce2359 wrote: |
Did you rcdmqobj TEST.QUEUE? |
This is what i have - /usr/bin/rcdmqimg -l -m $QMGR -t '*' '*', so its doing for all the queues and other objects in the queue manager.
Vitor wrote: |
2) Fix the bug in your rcdmqimg command. |
I tried to re run the rcdmqimg, and if i see the output its recording for all objects and it says recorded.
Thanks. |
|
Back to top |
|
 |
mqjava |
Posted: Fri Aug 20, 2010 7:36 am Post subject: |
|
|
 Voyager
Joined: 25 May 2009 Posts: 80 Location: New Jersey
|
In MQ log it says:
Code: |
AMQ7468: The oldest log file required to perform media recovery of queue
manager QMNAME is S0000378.LOG. |
If i go into the queue manager log directory and do "ls S0000378.LOG" that file is available. |
|
Back to top |
|
 |
bruce2359 |
Posted: Fri Aug 20, 2010 7:48 am Post subject: |
|
|
 Poobah
Joined: 05 Jan 2008 Posts: 9469 Location: US: west coast, almost. Otherwise, enroute.
|
Quote: |
...so its doing for all the queues and other objects in the queue manager. |
All queues means all messages in all queues. This will significantly increase the log space required.
Do your queues usually have messages in them? Are the messages large? persistent?
Do you intend to use the recorded images as the only method of recovering "lost" persistent messages? If so, you have a single point of failure - the logs.
If messages stay in queues for a long period of time (hours, days), and the messages are important, queue contents should be backed up to disk/tape with some kind of application or utility. _________________ I like deadlines. I like to wave as they pass by.
ב''ה
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live. |
|
Back to top |
|
 |
mqjava |
Posted: Fri Aug 20, 2010 8:00 am Post subject: |
|
|
 Voyager
Joined: 25 May 2009 Posts: 80 Location: New Jersey
|
Quote: |
Do your queues usually have messages in them? Are the messages large? persistent? |
messages are 4k in size, they are persistent
Quote: |
Do you intend to use the recorded images as the only method of recovering "lost" persistent messages? If so, you have a single point of failure - the logs. |
here my intention is to create the damaged queue. And as i already stated -
Quote: |
In MQ log it says:
Code:
AMQ7468: The oldest log file required to perform media recovery of queue
manager QMNAME is S0000378.LOG.
If i go into the queue manager log directory and do "ls S0000378.LOG" that file is available. |
I am worried about if something is wrong, thats the reason i am not able to recover the damaged queue? |
|
Back to top |
|
 |
Gaya3 |
Posted: Fri Aug 20, 2010 8:02 am Post subject: |
|
|
 Jedi
Joined: 12 Sep 2006 Posts: 2493 Location: Boston, US
|
does this log got corrupted S0000378.LOG ? that could be a chance right _________________ Regards
Gayathri
-----------------------------------------------
Do Something Before you Die |
|
Back to top |
|
 |
|