ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » General IBM MQ Support » Storage capacity planning for MQ 5.3 AIX

Post new topic  Reply to topic
 Storage capacity planning for MQ 5.3 AIX « View previous topic :: View next topic » 
Author Message
camauz
PostPosted: Tue Oct 02, 2007 5:18 am    Post subject: Storage capacity planning for MQ 5.3 AIX Reply with quote

Acolyte

Joined: 20 Aug 2007
Posts: 52
Location: Mojan, Italy

Hi all,
I have to plan how much storage I will need to store a bulk of messages.
I know the number of messages and the message average size.
I'm looking for a formula to compute storage requirement for the queue will host messages.
Someone around can give me a link to useful documentation?
Thanks in advance
Regards
Back to top
View user's profile Send private message
Vitor
PostPosted: Tue Oct 02, 2007 5:24 am    Post subject: Reply with quote

Grand High Poobah

Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA

The performance redbooks would be a good place to start. As a rough rule of thumb try this:

Average length of message x average number of message per time period x maximum number of periods x 10%

There are many other possible calculations, which may be more applicable to your situation.

As a side issue, it's not considered best practice to hold messages on a queue for any length of time. Ideally your servicing application should clear them off (storing the data in a database if unable to process immediately) and the queue should be sized in accordance with the maximum possible down time of the reading application.
_________________
Honesty is the best policy.
Insanity is the best defence.
Back to top
View user's profile Send private message
camauz
PostPosted: Tue Oct 02, 2007 5:50 am    Post subject: Reply with quote

Acolyte

Joined: 20 Aug 2007
Posts: 52
Location: Mojan, Italy

Vitor wrote:
The performance redbooks would be a good place to start. As a rough rule of thumb try this:


Thanks,
do you remenber the exact title or the redbook code?
Regards
Ch.
Back to top
View user's profile Send private message
Vitor
PostPosted: Tue Oct 02, 2007 6:30 am    Post subject: Reply with quote

Grand High Poobah

Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA

I remember reading a red book on AIX performance and tuning a while back. There aren't that many suspects and it's fairly general advice you're looking for.

I repeat my comments on the wisdom of storing stuff long term in a queue.
_________________
Honesty is the best policy.
Insanity is the best defence.
Back to top
View user's profile Send private message
fjb_saper
PostPosted: Tue Oct 02, 2007 2:48 pm    Post subject: Reply with quote

Grand High Poobah

Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY

And let me add some concerns about log space if you plan on storing persistent messages on a qmgr in linear logging...
_________________
MQ & Broker admin
Back to top
View user's profile Send private message Send e-mail
belchman
PostPosted: Wed Oct 03, 2007 4:26 am    Post subject: Reply with quote

Partisan

Joined: 31 Mar 2006
Posts: 386
Location: Ohio, USA

I would bet that the z/OS Concepts and Planning guide would be useful in determining your queue storage reqs.

After all a queue is a queue. I suspect it takes the same amount of space to store a message on AIX or Windows as it does on z/OS.

There is a good section on calculating storage costs and the problems associated with "using MQ as a database" for long term message retention.
_________________
Make three correct guesses consecutively and you will establish a reputation as an expert. ~ Laurence J. Peter
Back to top
View user's profile Send private message
camauz
PostPosted: Wed Oct 03, 2007 5:55 am    Post subject: Reply with quote

Acolyte

Joined: 20 Aug 2007
Posts: 52
Location: Mojan, Italy

belchman wrote:
I would bet that the z/OS Concepts and Planning guide would be useful in determining your queue storage reqs.

After all a queue is a queue. I suspect it takes the same amount of space to store a message on AIX or Windows as it does on z/OS.

I'm not sure about it. The technology behind z/OS (linear VSAM) is not related to the technology behind AIX (a file is simply a stream of bytes).

Bye
Ch.
Back to top
View user's profile Send private message
Walker01
PostPosted: Wed Oct 03, 2007 9:16 am    Post subject: Reply with quote

Newbie

Joined: 24 May 2006
Posts: 3

AIX Quick Beginings: http://www.elink.ibmlink.ibm.com/publications/servlet/pbi.wss?CTY=US&FNC=SRX&PBL=GC34-6076-02#

To determine the size of the /var/mqm file system for a server installation, consider:
The maximum number of messages in the system at one time
Contingency for message buildups, if there is a system problem
The average size of the message data, plus 500 bytes for the message header
The number of queues
The size of log files and error messages
The amount of SSL trace that is written to the /var/mqm/trace directory
Back to top
View user's profile Send private message
camauz
PostPosted: Wed Oct 03, 2007 10:49 pm    Post subject: Reply with quote

Acolyte

Joined: 20 Aug 2007
Posts: 52
Location: Mojan, Italy

Walker01 wrote:

The average size of the message data, plus 500 bytes for the message header


Thanks, I missed that paragraph.
In the meantime I performed some testing and these are the experimental results I got:

Message size = 80 KB (81920 bytes)
Message number = 30000
Queue file size = 2493956096
Storage size = 83132 bytes/message
Storage overhead = 1212 bytes/message
"Wasted" space = 1.48%

Message size = 30 KB (30720 bytes)
Message number = 70000
Queue file size = 2190770176
Storage size = 31297 bytes/message
Storage overhead = 135 bytes/message
"Wasted" space = 1.88%
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic  Reply to topic Page 1 of 1

MQSeries.net Forum Index » General IBM MQ Support » Storage capacity planning for MQ 5.3 AIX
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.