|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
 |
|
Is there a message limit in MQSI |
« View previous topic :: View next topic » |
Author |
Message
|
wolstek |
Posted: Thu Aug 30, 2001 3:46 am Post subject: |
|
|
Acolyte
Joined: 25 Jun 2001 Posts: 52 Location: Bristol, UK
|
I have been working on various messages running through a flow. In this case a table maintenance flow which populates a reference table based on repeating XML input. I have found that if I have a large input XML message e.g. 25Mb the flow goes into overdrive or hangs until I eventually stop the broker or go home. When the number of repeats in the XML is reduced to say a file less than 10MB, it works ok
Does anyone know of a size limit or is it a system constraint or ??
Thanks |
|
Back to top |
|
 |
Tibor |
Posted: Thu Aug 30, 2001 4:10 am Post subject: |
|
|
 Grand Master
Joined: 20 May 2001 Posts: 1033 Location: Hungary
|
There is no theoretical limit in MQSI only MQ max. message length (100 MByte).
BUT, if you works with large messages and these aren't BLOBs you will get different errors (from 'standard' MQSI errors like "allocate Resource" to OS errors like "Stack fault...")
Of course, IBM's performance supportpacks recommend you to use a small / atomic message as possible.
|
|
Back to top |
|
 |
bower5932 |
Posted: Thu Aug 30, 2001 10:37 am Post subject: |
|
|
 Jedi Knight
Joined: 27 Aug 2001 Posts: 3023 Location: Dallas, TX, USA
|
|
Back to top |
|
 |
wolstek |
Posted: Fri Sep 14, 2001 3:02 am Post subject: |
|
|
Acolyte
Joined: 25 Jun 2001 Posts: 52 Location: Bristol, UK
|
Thanks for the input.
For general information it transpired on further investigation that the flows were abending due to the fact that the input message contained many (>500) repeating XML tags. The flows perform a loop around a series of nodes to process and output each repeat. The flows were failing, not on message size or XML content, but by the fact that the overall runtime message processing end to end went through more than 500 nodes, past the permitted limit.
It would be interesting to know the reasoning behind this limit, my guess being that it is an arbitary value set by the labs to constrain the use of memory/buffering. |
|
Back to top |
|
 |
chrisfra |
Posted: Fri Sep 21, 2001 1:26 pm Post subject: |
|
|
Novice
Joined: 24 Jun 2001 Posts: 14
|
The underlying limitation is stack space. Some value has to be chosen when building the DataFlowEngine executable, and the value chosen was 1 mb.
If your broker is running on NT/2000 what you can do is alter the header for DataFlowEngine.exe using EDITBIN (a utility provided as part of MS Visual Studio). For example, to increase the stack to 2M use the utility as follows:
EDITBIN /STACK:0x200000 DataFlowEngine.exe
Whether it is practical to increase the stack size to accomodate your message flow processing an XML message of 25Mb, you'll have to determine for yourself.
_________________ Regards,
Christopher Frank
Certified Sr. I/T Specialist - IBM Software
IBM Certified Solutions Expert - WebSphere MQ & MQ Integrator
--------------------------------------------
Phone: 612-397-5532 |
|
Back to top |
|
 |
|
|
 |
|
Page 1 of 1 |
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
|
|
|