| Author |
Message
|
| pranaygupta |
 Posted: Tue May 18, 2010 2:59 am Post subject: Very large !!GHOST! folders in MQ file tree |
 |
|
Novice
Joined: 01 Sep 2009
Posts: 14
|
Hi
We have a gateway application based on MQ and FTE. There are 3 queue managers in the system. The queue manager that acts as the coordination and command queue manager has grown to a rather large size of 700 MB and is still growing. Upon further investigation, we found that inside the queues directory, there are 21 !!GHOST!xxxxxx folders, and their total size is ~700MB.
We have faced this problem previously, where the queue manager had balooned to 11GB and we had to rebuild the system. Previously, we had set-up subscription on the SYSTEM.FTE topic, and believed that was the cause of the problwm but this time no such subscription exists. Yet, the problem is just as before.
We have tried deleting and recreating the model queues and that doesn't remove these ghost folders. Also, the continuously cleaning up these queues is not something that is an option in the production environment.
We have a windows server 2008 environ. with MQ v7.0.1 and FTE v7.0.2.
Let me know if I can provide any more information to help figuring out a solution for this.
Thanks
Pranay |
|
| Back to top |
|
 |
| fatherjack |
| Posted: Tue May 18, 2010 3:19 am Post subject: |
|
|
Knight
Joined: 14 Apr 2010
Posts: 522
Location: Craggy Island
|
I didn't know the answer the first time you posted. Posting it again isn't going to change that. 
_________________
Never let the facts get in the way of a good theory. |
|
| Back to top |
|
|
| exerk |
| Posted: Tue May 18, 2010 3:39 am Post subject: |
|
|
Jedi Council
Joined: 02 Nov 2006
Posts: 6339
|
To add to the good fathers sermon - please do NOT double post, or take a scatter-gun approach to the forums in which you do post.
Moving this one to the FTE forum (where it belongs!), and locking the one in the Java/JMS forum (which you could delete).
_________________
It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys. |
|
| Back to top |
|
|
| pranaygupta |
| Posted: Tue May 18, 2010 4:23 am Post subject: |
|
|
Novice
Joined: 01 Sep 2009
Posts: 14
|
Sorry about that. I'll keep this in mind. I had the intention of deleting the old post in JMS but I couldn't find how to delete the post (yes, i know thats an invitation to ridicule, but my intentions were not to double post or use a scatter gun approach)
Wont happen again. |
|
| Back to top |
|
|
| Vitor |
| Posted: Tue May 18, 2010 5:19 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| pranaygupta wrote: |
| I couldn't find how to delete the post |
Reply to your own post with something like "Moderator please delete this post" or indeed "Moderator please move to FTE section" will get it done.
But there's no ridicule in being unable to find the non-existent button. 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| pranaygupta |
| Posted: Tue May 18, 2010 5:25 am Post subject: |
|
|
Novice
Joined: 01 Sep 2009
Posts: 14
|
Thanks Vitor.
Any idea on the issue I'm facing? |
|
| Back to top |
|
|
| exerk |
| Posted: Tue May 18, 2010 5:38 am Post subject: |
|
|
Jedi Council
Joined: 02 Nov 2006
Posts: 6339
|
| Vitor wrote: |
| pranaygupta wrote: |
| I couldn't find how to delete the post |
Reply to your own post with something like "Moderator please delete this post" or indeed "Moderator please move to FTE section" will get it done.
But there's no ridicule in being unable to find the non-existent button. |
Done. I forgot that non-mods do not get a delete button 
_________________
It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys. |
|
| Back to top |
|
|
| Vitor |
| Posted: Tue May 18, 2010 6:03 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| pranaygupta wrote: |
| Any idea on the issue I'm facing? |
Nope, that's why I didn't comment on it. 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| mqjeff |
| Posted: Tue May 18, 2010 6:17 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
It's my understanding that !GHOST! files are there to provide rapid allocation of storage for dynamic queues.
So it's not clear that their existence represents an issue.
Are you concerned about the storage space being used? Shouldn't you have done planning based on the size of your expected messages and data - including what you planned to ship through MQFTE? |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Tue May 18, 2010 7:39 pm Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20696
Location: LI,NY
|
700 MB may look overly big to you. I consider it medium. A base for installing a qmgr being 4 GB...
As Jeff said the GHOST pool is being used to allocate quickly temporary queues. You might want to look at why you need so many temporary queues and what all goes through them... and how long they exist....
Also if you have trouble with a lot of temporary queues(over a few hundred) and the channels keeping them open too long to allow for proper reuse, you might want to check with IBM for the corresponding channel stanza...
Have fun 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| pranaygupta |
| Posted: Wed May 19, 2010 1:13 am Post subject: |
|
|
Novice
Joined: 01 Sep 2009
Posts: 14
|
| 700 MB is not a matter of concern, but the last time we let the queue manager grow, it ended up filling all the space on the disk. It had ballooned to 11 GB and would have probably gone further had space not run out. I was even unable to see any of the objects in this queue manager using MQ explorer. Such cancerous growth is surely not expected behaviour. |
|
| Back to top |
|
|
| pranaygupta |
| Posted: Wed May 19, 2010 1:52 am Post subject: |
|
|
Novice
Joined: 01 Sep 2009
Posts: 14
|
| And also, if these folders are temporary, shouldn't they disappear by themselves. All the times that I have checked the Queues directory for that queue manager, I have never seen one of the GHOST folders disappear. I've still got ones there from the day the queue manager was built. |
|
| Back to top |
|
|
| Vitor |
| Posted: Wed May 19, 2010 5:09 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
Sounds like a PMR to me.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| pranaygupta |
| Posted: Thu May 20, 2010 5:50 am Post subject: |
|
|
Novice
Joined: 01 Sep 2009
Posts: 14
|
| I did just that. Will post whatever I get from there. Thanks guys. |
|
| Back to top |
|
|
| Gerd-in-ZA |
| Posted: Wed Apr 27, 2011 2:44 pm Post subject: Please check my other post if it provides the answer. |
|
|
Novice
Joined: 13 Sep 2006
Posts: 14
Location: Johannesburg, South Africa
|
This item has been idle for about a year now. I just posted a possible resolution to the (much younger) post of "Millions of messages loaded into SYSTEM.MANAGED.DURABLE.XXXX"
Inside the "queues" directory should only be directories representing queues - your 21 ghost directories seem to be permanent dynamic queues representing the durable subscriptions I wrote about in that other post.
(I am theorizing here, it would be nice if you could verify this).
_________________
-- Gerd -- |
|
| Back to top |
|
|
|
|
