Author |
Message
|
camauz |
Posted: Tue Oct 02, 2007 5:18 am Post subject: Storage capacity planning for MQ 5.3 AIX |
|
|
 Acolyte
Joined: 20 Aug 2007 Posts: 52 Location: Mojan, Italy
|
Hi all,
I have to plan how much storage I will need to store a bulk of messages.
I know the number of messages and the message average size.
I'm looking for a formula to compute storage requirement for the queue will host messages.
Someone around can give me a link to useful documentation?
Thanks in advance
Regards |
|
Back to top |
|
 |
Vitor |
Posted: Tue Oct 02, 2007 5:24 am Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
The performance redbooks would be a good place to start. As a rough rule of thumb try this:
Average length of message x average number of message per time period x maximum number of periods x 10%
There are many other possible calculations, which may be more applicable to your situation.
As a side issue, it's not considered best practice to hold messages on a queue for any length of time. Ideally your servicing application should clear them off (storing the data in a database if unable to process immediately) and the queue should be sized in accordance with the maximum possible down time of the reading application. _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
camauz |
Posted: Tue Oct 02, 2007 5:50 am Post subject: |
|
|
 Acolyte
Joined: 20 Aug 2007 Posts: 52 Location: Mojan, Italy
|
Vitor wrote: |
The performance redbooks would be a good place to start. As a rough rule of thumb try this:
|
Thanks,
do you remenber the exact title or the redbook code?
Regards
Ch. |
|
Back to top |
|
 |
Vitor |
Posted: Tue Oct 02, 2007 6:30 am Post subject: |
|
|
 Grand High Poobah
Joined: 11 Nov 2005 Posts: 26093 Location: Texas, USA
|
I remember reading a red book on AIX performance and tuning a while back. There aren't that many suspects and it's fairly general advice you're looking for.
I repeat my comments on the wisdom of storing stuff long term in a queue. _________________ Honesty is the best policy.
Insanity is the best defence. |
|
Back to top |
|
 |
fjb_saper |
Posted: Tue Oct 02, 2007 2:48 pm Post subject: |
|
|
 Grand High Poobah
Joined: 18 Nov 2003 Posts: 20756 Location: LI,NY
|
And let me add some concerns about log space if you plan on storing persistent messages on a qmgr in linear logging...  _________________ MQ & Broker admin |
|
Back to top |
|
 |
belchman |
Posted: Wed Oct 03, 2007 4:26 am Post subject: |
|
|
Partisan
Joined: 31 Mar 2006 Posts: 386 Location: Ohio, USA
|
I would bet that the z/OS Concepts and Planning guide would be useful in determining your queue storage reqs.
After all a queue is a queue. I suspect it takes the same amount of space to store a message on AIX or Windows as it does on z/OS.
There is a good section on calculating storage costs and the problems associated with "using MQ as a database" for long term message retention. _________________ Make three correct guesses consecutively and you will establish a reputation as an expert. ~ Laurence J. Peter |
|
Back to top |
|
 |
camauz |
Posted: Wed Oct 03, 2007 5:55 am Post subject: |
|
|
 Acolyte
Joined: 20 Aug 2007 Posts: 52 Location: Mojan, Italy
|
belchman wrote: |
I would bet that the z/OS Concepts and Planning guide would be useful in determining your queue storage reqs.
After all a queue is a queue. I suspect it takes the same amount of space to store a message on AIX or Windows as it does on z/OS. |
I'm not sure about it. The technology behind z/OS (linear VSAM) is not related to the technology behind AIX (a file is simply a stream of bytes).
Bye
Ch. |
|
Back to top |
|
 |
Walker01 |
Posted: Wed Oct 03, 2007 9:16 am Post subject: |
|
|
 Newbie
Joined: 24 May 2006 Posts: 3
|
AIX Quick Beginings: http://www.elink.ibmlink.ibm.com/publications/servlet/pbi.wss?CTY=US&FNC=SRX&PBL=GC34-6076-02#
To determine the size of the /var/mqm file system for a server installation, consider:
The maximum number of messages in the system at one time
Contingency for message buildups, if there is a system problem
The average size of the message data, plus 500 bytes for the message header
The number of queues
The size of log files and error messages
The amount of SSL trace that is written to the /var/mqm/trace directory |
|
Back to top |
|
 |
camauz |
Posted: Wed Oct 03, 2007 10:49 pm Post subject: |
|
|
 Acolyte
Joined: 20 Aug 2007 Posts: 52 Location: Mojan, Italy
|
Walker01 wrote: |
The average size of the message data, plus 500 bytes for the message header |
Thanks, I missed that paragraph.
In the meantime I performed some testing and these are the experimental results I got:
Message size = 80 KB (81920 bytes)
Message number = 30000
Queue file size = 2493956096
Storage size = 83132 bytes/message
Storage overhead = 1212 bytes/message
"Wasted" space = 1.48%
Message size = 30 KB (30720 bytes)
Message number = 70000
Queue file size = 2190770176
Storage size = 31297 bytes/message
Storage overhead = 135 bytes/message
"Wasted" space = 1.88% |
|
Back to top |
|
 |
|