ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » General Discussion » Message Size

Post new topic  Reply to topic
 Message Size « View previous topic :: View next topic » 
Author Message
OzgurAydin
PostPosted: Thu Apr 26, 2018 10:34 pm    Post subject: Message Size Reply with quote

Apprentice

Joined: 08 Sep 2008
Posts: 27

Hi,
We are about to add MQ as the messaging gateway for DataPower. Bu we want to use it with large messages. On MQ what is the max. Queue Size for high performance issues ?
How does MQ handle messages larger than 5 MB ? Let's consider they are Non-Persistent. Will there be a buffer on the disc or in Memory ? How will the system be affected with large messages rather than having hugh numbers of small messages ( < 10K) ?
Thanks
Back to top
View user's profile Send private message
fjb_saper
PostPosted: Fri Apr 27, 2018 1:27 am    Post subject: Reply with quote

Grand High Poobah

Joined: 18 Nov 2003
Posts: 20696
Location: LI,NY

Be aware that large messages will slow down somewhat the delivery... more time in the put, more time in the get, more time during transmission. I would suggest that you create extra queues and channels for big messages so as to keep small messages at their optimum speed: fast...
_________________
MQ & Broker admin
Back to top
View user's profile Send private message Send e-mail
Vitor
PostPosted: Fri Apr 27, 2018 5:09 am    Post subject: Re: Message Size Reply with quote

Grand High Poobah

Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA

OzgurAydin wrote:
On MQ what is the max. Queue Size for high performance issues ?


The maximum size for a single message is 100Mb, and with enough resource & tuning it's possible to get good performance with those. You don't talk about what you consider "high" performance, or indeed how you're measuring performance. Is it how fast DataPower can hand off to MQ? How fast messages get from DataPower to their destination? How large is your MQ topology? How many MQ hops must the message make?

This all affects performance.

OzgurAydin wrote:
How does MQ handle messages larger than 5 MB ?


The same way it handles messages larger and smaller than that. How did you come to 5Mb rather than 4Mb (the OOTB limit for an MQ message)? Is this your current message size?

OzgurAydin wrote:
Let's consider they are Non-Persistent.


Ok - so considered.

OzgurAydin wrote:
Will there be a buffer on the disc or in Memory ?


Will there be enough memory to hold the message data (made up of message size multiplied by number of messages) before it's read off by whatever's consuming the messages? If yes, they're held in memory (still assuming non-persistent here). If not, they'll overflow onto disc.

OzgurAydin wrote:
How will the system be affected with large messages rather than having hugh numbers of small messages ( < 10K) ?


Are the small messages equally non-persistent? Are they being read off at the same speed as the larger ones (we can assume the consuming application takes more time to chew through a large message than a small one)? How much resource does the queue manager have?

Spend some time with the performance reports for the OS you're using.
_________________
Honesty is the best policy.
Insanity is the best defence.
Back to top
View user's profile Send private message
bruce2359
PostPosted: Fri Apr 27, 2018 5:47 am    Post subject: Re: Message Size Reply with quote

Poobah

Joined: 05 Jan 2008
Posts: 9394
Location: US: west coast, almost. Otherwise, enroute.

OzgurAydin wrote:
Will there be a buffer on the disc or in Memory ?

Messages are MQPUT to queue buffers in RAM. If the consuming app is alive and well on the same qmgr, it will likely MQGET the message from the buffer. If the buffer fills or the message sits in the buffer too long, then buffer management software will write the message to queue-holding disk.
_________________
I like deadlines. I like to wave as they pass by.
ב''ה
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live.
Back to top
View user's profile Send private message
gbaddeley
PostPosted: Sun Apr 29, 2018 5:06 pm    Post subject: Reply with quote

Jedi

Joined: 25 Mar 2003
Posts: 2492
Location: Melbourne, Australia

A single large MQ message is more efficient than the equivalent number of small messages (say <10KB), as it reduces the overhead in MQ for handling each message.

However, if application processing time is included, there may not be a significant difference. Eg. MQ could be capable of processing 1 GB/sec message data, but the producer and consumper apps throughput and the network latency only allows 0.1 GB/sec.
_________________
Glenn
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic  Reply to topic Page 1 of 1

MQSeries.net Forum Index » General Discussion » Message Size
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.