| |
|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
  |
|
| Message Size |
« View previous topic :: View next topic » |
| Author |
Message
|
| OzgurAydin |
 Posted: Thu Apr 26, 2018 10:34 pm Post subject: Message Size |
 |
|
Apprentice
Joined: 08 Sep 2008
Posts: 27
|
Hi,
We are about to add MQ as the messaging gateway for DataPower. Bu we want to use it with large messages. On MQ what is the max. Queue Size for high performance issues ?
How does MQ handle messages larger than 5 MB ? Let's consider they are Non-Persistent. Will there be a buffer on the disc or in Memory ? How will the system be affected with large messages rather than having hugh numbers of small messages ( < 10K) ?
Thanks |
|
| Back to top |
|
 |
| fjb_saper |
| Posted: Fri Apr 27, 2018 1:27 am Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
Be aware that large messages will slow down somewhat the delivery... more time in the put, more time in the get, more time during transmission. I would suggest that you create extra queues and channels for big messages so as to keep small messages at their optimum speed: fast... 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| Vitor |
| Posted: Fri Apr 27, 2018 5:09 am Post subject: Re: Message Size |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| OzgurAydin wrote: |
| On MQ what is the max. Queue Size for high performance issues ? |
The maximum size for a single message is 100Mb, and with enough resource & tuning it's possible to get good performance with those. You don't talk about what you consider "high" performance, or indeed how you're measuring performance. Is it how fast DataPower can hand off to MQ? How fast messages get from DataPower to their destination? How large is your MQ topology? How many MQ hops must the message make?
This all affects performance.
| OzgurAydin wrote: |
| How does MQ handle messages larger than 5 MB ? |
The same way it handles messages larger and smaller than that. How did you come to 5Mb rather than 4Mb (the OOTB limit for an MQ message)? Is this your current message size?
| OzgurAydin wrote: |
| Let's consider they are Non-Persistent. |
Ok - so considered.
| OzgurAydin wrote: |
| Will there be a buffer on the disc or in Memory ? |
Will there be enough memory to hold the message data (made up of message size multiplied by number of messages) before it's read off by whatever's consuming the messages? If yes, they're held in memory (still assuming non-persistent here). If not, they'll overflow onto disc.
| OzgurAydin wrote: |
How will the system be affected with large messages rather than having hugh numbers of small messages ( < 10K) ?
|
Are the small messages equally non-persistent? Are they being read off at the same speed as the larger ones (we can assume the consuming application takes more time to chew through a large message than a small one)? How much resource does the queue manager have?
Spend some time with the performance reports for the OS you're using.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| bruce2359 |
| Posted: Fri Apr 27, 2018 5:47 am Post subject: Re: Message Size |
|
|
Poobah
Joined: 05 Jan 2008
Posts: 9469
Location: US: west coast, almost. Otherwise, enroute.
|
| OzgurAydin wrote: |
| Will there be a buffer on the disc or in Memory ? |
Messages are MQPUT to queue buffers in RAM. If the consuming app is alive and well on the same qmgr, it will likely MQGET the message from the buffer. If the buffer fills or the message sits in the buffer too long, then buffer management software will write the message to queue-holding disk.
_________________
I like deadlines. I like to wave as they pass by.
ב''ה
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live. |
|
| Back to top |
|
|
| gbaddeley |
| Posted: Sun Apr 29, 2018 5:06 pm Post subject: |
|
|
Jedi Knight
Joined: 25 Mar 2003
Posts: 2538
Location: Melbourne, Australia
|
A single large MQ message is more efficient than the equivalent number of small messages (say <10KB), as it reduces the overhead in MQ for handling each message.
However, if application processing time is included, there may not be a significant difference. Eg. MQ could be capable of processing 1 GB/sec message data, but the producer and consumper apps throughput and the network latency only allows 0.1 GB/sec.
_________________
Glenn |
|
| Back to top |
|
|
|
|
|
| |
|
Page 1 of 1 |
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
