| Author |
Message
|
| jeevan |
 Posted: Thu Oct 28, 2010 6:29 am Post subject: Changing and cleaning MQ logfile in Windows |
 |
|
Grand Master
Joined: 12 Nov 2005
Posts: 1432
|
We realised that our stores qmgr( thousand in number) have wrong number of log files. Now, we would like to change them with minimum impact and work as far as possible.
They are on windows platform.
I know we can change the number of log files wihtout recreating them. I can go and change the registry but how I know which files I can delete?
When I tried changing # of log files in one queue manager ( using REGISTRY, as I am testing this in windows) , I was able to restart the QMGR but am not able to figure out which log file can be deleted.
I tried to use DIS QMSTATUS RECLOG and MEDIALOG commands but they did not return anything( supposed to return the lowest # log file aht can be deleted.)
Any suggestions
Last edited by jeevan on Sun Oct 31, 2010 6:29 am; edited 1 time in total |
|
| Back to top |
|
 |
| fjb_saper |
| Posted: Thu Oct 28, 2010 7:34 am Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
First it is unclear if you are using circular or linear logging.
The fact that QMSTATUS reclog and medialog return a blank value makes me think that you are using circular logging.
Nothing to do but wait. Circular logs reclaiming is done by the qmgr when the circumstances are right... (I know it feels more like when the qmgr likes to, but there are some rules behind this process... patience is the only virtue there). 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| jeevan |
| Posted: Thu Oct 28, 2010 7:38 am Post subject: |
|
|
Grand Master
Joined: 12 Nov 2005
Posts: 1432
|
| fjb_saper wrote: |
First it is unclear if you are using circular or linear logging.
The fact that QMSTATUS reclog and medialog return a blank value makes me think that you are using circular logging.
Nothing to do but wait. Circular logs reclaiming is done by the qmgr when the circumstances are right... (I know it feels more like when the qmgr likes to, but there are some rules behind this process... patience is the only virtue there). |
Yes, we are using circular logging and it is windows environment.
what you are saying is, change the # of log files and wait which one will be used and remove the other afterward? |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Thu Oct 28, 2010 7:47 am Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
| jeevan wrote: |
| fjb_saper wrote: |
First it is unclear if you are using circular or linear logging.
The fact that QMSTATUS reclog and medialog return a blank value makes me think that you are using circular logging.
Nothing to do but wait. Circular logs reclaiming is done by the qmgr when the circumstances are right... (I know it feels more like when the qmgr likes to, but there are some rules behind this process... patience is the only virtue there). |
Yes, we are using circular logging and it is windows environment.
what you are saying is, change the # of log files and wait which one will be used and remove the other afterward? |
No what I'm saying is change the settings and don't touch the files. The qmgr will remove the ones that are no longer needed after all the criteria of the algorithm have been fulfilled.
The unneeded files will get removed -- eventually. You have to be armed with patience. Don't remove any logfiles manually!.
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| jeevan |
| Posted: Thu Oct 28, 2010 10:07 am Post subject: |
|
|
Grand Master
Joined: 12 Nov 2005
Posts: 1432
|
| fjb_saper wrote: |
| jeevan wrote: |
| fjb_saper wrote: |
First it is unclear if you are using circular or linear logging.
The fact that QMSTATUS reclog and medialog return a blank value makes me think that you are using circular logging.
Nothing to do but wait. Circular logs reclaiming is done by the qmgr when the circumstances are right... (I know it feels more like when the qmgr likes to, but there are some rules behind this process... patience is the only virtue there). |
Yes, we are using circular logging and it is windows environment.
what you are saying is, change the # of log files and wait which one will be used and remove the other afterward? |
No what I'm saying is change the settings and don't touch the files. The qmgr will remove the ones that are no longer needed after all the criteria of the algorithm have been fulfilled.
The unneeded files will get removed -- eventually. You have to be armed with patience. Don't remove any logfiles manually!. |
Thanks a lot. |
|
| Back to top |
|
|
| bruce2359 |
| Posted: Thu Oct 28, 2010 1:13 pm Post subject: |
|
|
Poobah
Joined: 05 Jan 2008
Posts: 9469
Location: US: west coast, almost. Otherwise, enroute.
|
"..."wrong number of log files."
What do you mean wrong number? Do you want more? Or less?
_________________
I like deadlines. I like to wave as they pass by.
ב''ה
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live. |
|
| Back to top |
|
|
| jeevan |
| Posted: Thu Oct 28, 2010 4:28 pm Post subject: |
|
|
Grand Master
Joined: 12 Nov 2005
Posts: 1432
|
| bruce2359 wrote: |
"..."wrong number of log files."
What do you mean wrong number? Do you want more? Or less? |
we just wanted 3/2 but currently have 10/10 with lf 65535. Means the log files are taking 2.5 gig space(65535*4k =250 mb each*10 =2.5 gb). |
|
| Back to top |
|
|
| ramires |
| Posted: Thu Oct 28, 2010 6:23 pm Post subject: |
|
|
Knight
Joined: 24 Jun 2001
Posts: 523
Location: Portugal - Lisboa
|
| jeevan wrote: |
| but currently have 10/10 with lf 65535. Means the log files are taking 2.5 gig space(65535*4k =250 mb each*10 =2.5 gb). |
but if you have this size a number of log is because someone decided that. Reducing log space can have impact, for example when a long transaction is used. |
|
| Back to top |
|
|
| stuartjohnston1967 |
| Posted: Fri Oct 29, 2010 3:54 am Post subject: |
|
|
Novice
Joined: 12 Jul 2010
Posts: 11
|
I agree with what is said above, its a risk and diskspace is cheap!
But if you do have to reduce the number of logfiles you can look at the modified date on the files and apply MQ changes
Once had a unix system with 100 primary logfiles and it only used 2 since its creation.
Stuart |
|
| Back to top |
|
|
| jeevan |
| Posted: Fri Oct 29, 2010 4:37 am Post subject: |
|
|
Grand Master
Joined: 12 Nov 2005
Posts: 1432
|
| stuartjohnston1967 wrote: |
I agree with what is said above, its a risk and diskspace is cheap!
But if you do have to reduce the number of logfiles you can look at the modified date on the files and apply MQ changes
Once had a unix system with 100 primary logfiles and it only used 2 since its creation.
Stuart |
These are the standalone system so the storage is not coming from SAN or contact admin or GPFS or whatever. Replacing thousand just for nothing( we do not need that big log) is not convincing to management. So we have to change MQ either some way or recreate the queue manager which is a bir headache. |
|
| Back to top |
|
|
| Vitor |
| Posted: Fri Oct 29, 2010 4:58 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| jeevan wrote: |
| So we have to change MQ either some way or recreate the queue manager which is a bir headache. |
I think the point that's being made is that from this post, it sounds like you're reducing the number of log files because they're using too much space on the local disc but without any investigation as to why they were created that way in the first place; 10 / 10 is not a default setting nor is that lf value. Hence you could save space, then have problems when the log fills.
Which is not to say you've not investigated, just that this thread gives the impression you've not.
I also add my voice to the "don't delete the files manually" point. You can check the file mod date as previously posted, but the queue manager will get cross when it comes to clean up the files itself & discovers they're missing. Just wait & let it happen.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| jeevan |
| Posted: Fri Oct 29, 2010 6:04 am Post subject: |
|
|
Grand Master
Joined: 12 Nov 2005
Posts: 1432
|
| Vitor wrote: |
| jeevan wrote: |
| So we have to change MQ either some way or recreate the queue manager which is a bir headache. |
I think the point that's being made is that from this post, it sounds like you're reducing the number of log files because they're using too much space on the local disc but without any investigation as to why they were created that way in the first place; 10 / 10 is not a default setting nor is that lf value. Hence you could save space, then have problems when the log fills.
Which is not to say you've not investigated, just that this thread gives the impression you've not.
I also add my voice to the "don't delete the files manually" point. You can check the file mod date as previously posted, but the queue manager will get cross when it comes to clean up the files itself & discovers they're missing. Just wait & let it happen. |
I think I did not asnwer the questions why the log were created that way at first place. My colleague who was here when they were created said that that was a mistake. The configuration was designed for corporate qmgrs which would be processing millions of message come from thousands of stores qmgrs. But a single store qmgr does not need that big log. There has been a mistake as I asserated at the beginning in my post.
So the purpose is restore space which is wasted for nothing. Also, I am not aurguing on the point that is made earlier that I should not delete the log files manually.
I am just trying to answer the post. I know what I ( we ) need to do. we are making decision soon based on this.
thanks |
|
| Back to top |
|
|
| bruce2359 |
| Posted: Fri Oct 29, 2010 10:06 am Post subject: |
|
|
Poobah
Joined: 05 Jan 2008
Posts: 9469
Location: US: west coast, almost. Otherwise, enroute.
|
How to size the logs is nicely documented in the WMQ System Administration manual.
Once you decide on the appropriate log size, change the appropriate stanza in the qmgrs qm.ini file; then stop/start the qmgr.
_________________
I like deadlines. I like to wave as they pass by.
ב''ה
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live. |
|
| Back to top |
|
|
| jeevan |
| Posted: Fri Oct 29, 2010 11:25 am Post subject: |
|
|
Grand Master
Joined: 12 Nov 2005
Posts: 1432
|
| bruce2359 wrote: |
How to size the logs is nicely documented in the WMQ System Administration manual.
Once you decide on the appropriate log size, change the appropriate stanza in the qmgrs qm.ini file; then stop/start the qmgr. |
Our problem is how to reduce the current log file # from 10/10 to 3/2 not how to size it. We are applying the correct way but that only works now onward. We know what we need, we also know how to change( it is windows so I need to change registry and we can use amqmdain reg command) but the issue here is how to clear those file which are not being used and if mq does not how soon does it do that. These are the issues and I am trying to get an input for. |
|
| Back to top |
|
|
| J.D |
| Posted: Fri Oct 29, 2010 3:57 pm Post subject: |
|
|
Voyager
Joined: 18 Dec 2009
Posts: 92
Location: United States
|
What is the need for changing number of log files when your store queue managers doesn't take more than 1250 MB at any given point of time. MQ doesn't pre-allocate disk space for log files, it takes space on deamand and releases later i guess.
_________________
IBM WebSphere MQ & WAS Administrator |
|
| Back to top |
|
|
|
|
