ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » General IBM MQ Support » recover damaged queue

Post new topic  Reply to topic Goto page 1, 2  Next
 recover damaged queue « View previous topic :: View next topic » 
Author Message
mqjava
PostPosted: Thu Aug 19, 2010 9:49 am    Post subject: recover damaged queue Reply with quote

Voyager

Joined: 25 May 2009
Posts: 80
Location: New Jersey

Hi All,

One of the local queue is damaged, it says -
Code:
AMQ8149: WebSphere MQ object damaged.


I tried to receover the queue by using - rcrmqobj, but it says -

Code:
AMQ7042: Media image not available for object TEST.QUEUE
of type queue.


i belive the log required to recreate the TEST.QUEUE is not availble and its been deleted i think, because we delete the logs which are 10 days old.

Is there any other way we can recover the queue?
If we are able to recover the queue using rcrmqobj will the messages in the queue also recovered?
If the queue manager uses circular logging how can we recover the damaged object?

Thanks.
Back to top
View user's profile Send private message
Gaya3
PostPosted: Thu Aug 19, 2010 9:54 am    Post subject: Re: recover damaged queue Reply with quote

Jedi

Joined: 12 Sep 2006
Posts: 2493
Location: Boston, US

mqjava wrote:
Hi All,

One of the local queue is damaged, it says -
Code:
AMQ8149: WebSphere MQ object damaged.


I tried to receover the queue by using - rcrmqobj, but it says -

Code:
AMQ7042: Media image not available for object TEST.QUEUE
of type queue.


i belive the log required to recreate the TEST.QUEUE is not availble and its been deleted i think, because we delete the logs which are 10 days old.

Is there any other way we can recover the queue?
If we are able to recover the queue using rcrmqobj will the messages in the queue also recovered?
If the queue manager uses circular logging how can we recover the damaged object?

Thanks.


its true from your mail, its not a linear logging, so you cant do media recovery.

delete the damaged object and recreate it, by looking the back ups or documentation.
_________________
Regards
Gayathri
-----------------------------------------------
Do Something Before you Die
Back to top
View user's profile Send private message
Vitor
PostPosted: Thu Aug 19, 2010 10:10 am    Post subject: Re: recover damaged queue Reply with quote

Grand High Poobah

Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA

mqjava wrote:
i belive the log required to recreate the TEST.QUEUE is not availble and its been deleted i think, because we delete the logs which are 10 days old.


If you're using linear logging you should only delete the logs the queue manager has confirmed it doesn't need. These (depending on your queue manager housekeeping) may or may not be older that 10 days.

If you're using circular logging you shouldn't be deleting log files at all.

mqjava wrote:
Is there any other way we can recover the queue?


File system restore or DEFINE QLOCAL

mqjava wrote:
If we are able to recover the queue using rcrmqobj will the messages in the queue also recovered?


Yes

mqjava wrote:
If the queue manager uses circular logging how can we recover the damaged object?


File system restore or DEFINE QLOCAL
_________________
Honesty is the best policy.
Insanity is the best defence.
Back to top
View user's profile Send private message
mqjava
PostPosted: Thu Aug 19, 2010 12:49 pm    Post subject: Reply with quote

Voyager

Joined: 25 May 2009
Posts: 80
Location: New Jersey

Quote:
its true from your mail, its not a linear logging, so you cant do media recovery.


Gaya3 thanks for the reply, this queue manager is using liner logging.

Vitor,

We have deleted the logs which are not needed and confirmed by queue manager. We use the log cleanup script from IBM. But still we dont have the log required to create the damaged queue.

Thanks for answering all my other questions.

Thanks
Back to top
View user's profile Send private message
Vitor
PostPosted: Thu Aug 19, 2010 1:08 pm    Post subject: Reply with quote

Grand High Poobah

Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA

mqjava wrote:
We have deleted the logs which are not needed and confirmed by queue manager. We use the log cleanup script from IBM. But still we dont have the log required to create the damaged queue.


Then you have a serious problem & should raise a PMR. The "oldest log file" reported by the queue manager takes account of what is needed for media recovery. If it's reporting that you can delete a log, then reporting it doesn't have the log it needs, this is a software defect and a potentially distasterous one for those WMQ sites that rely on this feature.

Or there's a problem with the way you're recording media images in the logs.
_________________
Honesty is the best policy.
Insanity is the best defence.
Back to top
View user's profile Send private message
mqjava
PostPosted: Fri Aug 20, 2010 6:06 am    Post subject: Reply with quote

Voyager

Joined: 25 May 2009
Posts: 80
Location: New Jersey

Quote:
Or there's a problem with the way you're recording media images in the logs.


Hi Vitor,

I am using v 1.18 of the cleanmqlogs by shelden, before running this cleanmqlogs script first our script will delete the .Z files(zipped) which are more than 10 days old, then run the below command - /usr/bin/rcdmqimg -l -m $QMGR -t '*' '*', then it will execute the cleanmqlogs script by shelden, This is the way i have set it to run, do you see any problem in this approach?

Thanks
Back to top
View user's profile Send private message
Vitor
PostPosted: Fri Aug 20, 2010 6:13 am    Post subject: Reply with quote

Grand High Poobah

Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA

mqjava wrote:
do you see any problem in this approach?


If there's no problem, why is the media image not available for you to recover the damaged queue?

I assume by "v1.18 of the cleanlogs by shelden" you mean MS62 which is currently at v2. From the support pac page:

Quote:
Gzip is the default so that if the script makes a mistake and thinks it should delete a logfile that the queue manager needs, the file will not be permanently removed.


So a) why are you deleting these files & b) how did you come up with 10 days?
_________________
Honesty is the best policy.
Insanity is the best defence.
Back to top
View user's profile Send private message
mqjava
PostPosted: Fri Aug 20, 2010 6:21 am    Post subject: Reply with quote

Voyager

Joined: 25 May 2009
Posts: 80
Location: New Jersey

Vitor wrote:
If there's no problem, why is the media image not available for you to recover the damaged queue? ?


Thats the reason i want to findout.

Vitor wrote:
a) why are you deleting these files & b) how did you come up with 10 days?


a) If we let the .Z files growing then it will fill up the filesystem one day.

b) this is a test env QM, we dont have much storage for /var/mqm, so decided 10 days old .Z files should be deleted.
Back to top
View user's profile Send private message
Vitor
PostPosted: Fri Aug 20, 2010 6:36 am    Post subject: Reply with quote

Grand High Poobah

Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA

mqjava wrote:
b) this is a test env QM


You have a test queue manager with a linear log? Unusual (since there's typically limited storage and no requirement for recovery) but ok.

I recommend 2 actions:

1) Review the decision about 10 days. I don't know how you "decided" but wonder if it was just a finger in the area rather than based on fact;
2) Fix the bug in your rcdmqimg command.

I've not used the support pac in question myself, but I've always used the queue manager messgaes to determine log requirements and by extension those which are not required.

Where I've been on sites that do use support pacs for linear logging, they've used MS0L which is a Cat 2 from IBM (and more frequently maintained I notice). No disrespect is intended to the other pac or it's authors, not is this a recommendation to change.
_________________
Honesty is the best policy.
Insanity is the best defence.
Back to top
View user's profile Send private message
bruce2359
PostPosted: Fri Aug 20, 2010 7:12 am    Post subject: Reply with quote

Poobah

Joined: 05 Jan 2008
Posts: 9469
Location: US: west coast, almost. Otherwise, enroute.

Quote:
If we are able to recover the queue using rcrmqobj will the messages in the queue also recovered?

Yes, but only if you rcdmqobj of the TEST.QUEUE before you attempt to rcrmqimg to recover the queue object.

Did you rcdmqobj TEST.QUEUE?
_________________
I like deadlines. I like to wave as they pass by.
ב''ה
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live.
Back to top
View user's profile Send private message
mqjava
PostPosted: Fri Aug 20, 2010 7:27 am    Post subject: Reply with quote

Voyager

Joined: 25 May 2009
Posts: 80
Location: New Jersey

bruce2359 wrote:
Did you rcdmqobj TEST.QUEUE?


This is what i have - /usr/bin/rcdmqimg -l -m $QMGR -t '*' '*', so its doing for all the queues and other objects in the queue manager.

Vitor wrote:
2) Fix the bug in your rcdmqimg command.


I tried to re run the rcdmqimg, and if i see the output its recording for all objects and it says recorded.

Thanks.
Back to top
View user's profile Send private message
mqjava
PostPosted: Fri Aug 20, 2010 7:36 am    Post subject: Reply with quote

Voyager

Joined: 25 May 2009
Posts: 80
Location: New Jersey

In MQ log it says:

Code:
AMQ7468: The oldest log file required to perform media recovery of queue
manager QMNAME is S0000378.LOG.


If i go into the queue manager log directory and do "ls S0000378.LOG" that file is available.
Back to top
View user's profile Send private message
bruce2359
PostPosted: Fri Aug 20, 2010 7:48 am    Post subject: Reply with quote

Poobah

Joined: 05 Jan 2008
Posts: 9469
Location: US: west coast, almost. Otherwise, enroute.

Quote:
...so its doing for all the queues and other objects in the queue manager.

All queues means all messages in all queues. This will significantly increase the log space required.

Do your queues usually have messages in them? Are the messages large? persistent?

Do you intend to use the recorded images as the only method of recovering "lost" persistent messages? If so, you have a single point of failure - the logs.

If messages stay in queues for a long period of time (hours, days), and the messages are important, queue contents should be backed up to disk/tape with some kind of application or utility.
_________________
I like deadlines. I like to wave as they pass by.
ב''ה
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live.
Back to top
View user's profile Send private message
mqjava
PostPosted: Fri Aug 20, 2010 8:00 am    Post subject: Reply with quote

Voyager

Joined: 25 May 2009
Posts: 80
Location: New Jersey

Quote:
Do your queues usually have messages in them? Are the messages large? persistent?


messages are 4k in size, they are persistent

Quote:
Do you intend to use the recorded images as the only method of recovering "lost" persistent messages? If so, you have a single point of failure - the logs.


here my intention is to create the damaged queue. And as i already stated -

Quote:
In MQ log it says:

Code:
AMQ7468: The oldest log file required to perform media recovery of queue
manager QMNAME is S0000378.LOG.


If i go into the queue manager log directory and do "ls S0000378.LOG" that file is available.


I am worried about if something is wrong, thats the reason i am not able to recover the damaged queue?
Back to top
View user's profile Send private message
Gaya3
PostPosted: Fri Aug 20, 2010 8:02 am    Post subject: Reply with quote

Jedi

Joined: 12 Sep 2006
Posts: 2493
Location: Boston, US

does this log got corrupted S0000378.LOG ? that could be a chance right
_________________
Regards
Gayathri
-----------------------------------------------
Do Something Before you Die
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic  Reply to topic Goto page 1, 2  Next Page 1 of 2

MQSeries.net Forum Index » General IBM MQ Support » recover damaged queue
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.