|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
 |
|
limit to q file size |
« View previous topic :: View next topic » |
Author |
Message
|
bduncan |
Posted: Wed Jul 18, 2001 11:23 am Post subject: |
|
|
Padawan
Joined: 11 Apr 2001 Posts: 1554 Location: Silicon Valley
|
On solaris, or any other unix OS for that matter, is there a limit to the size that a queue's q file can take up on the file system other than the limit imposed by the file system itself? A coworker of mine swears that the "q" file for a given queue cannot exceed 1Gb on Solaris. Is this correct? Or is it limited only by the filesystem itself?
_________________ Brandon Duncan
IBM Certified MQSeries Specialist
MQSeries.net forum moderator |
|
Back to top |
|
 |
bduncan |
Posted: Tue Jul 24, 2001 8:32 am Post subject: |
|
|
Padawan
Joined: 11 Apr 2001 Posts: 1554 Location: Silicon Valley
|
In answering my own question, after talking with IBM support, it turns out that my problem was arising because of the version of MQSeries I was running. We had a Solaris machine running MQSeries version 5.0, and during operations, whenever the size of the file that stores persistent messages in a queue exceeded 335Mb, the queue manager started routing subsequent messages to the dead letter queue saying that it was unable to allocate additional disk space. We had plenty of space free on the partition, so we couldn't figure out what was going on. IBM recommended upgrading to 5.1 because 5.0 had filesystem issues. As soon as we did that, low and behold, we could keep adding messages to our queues such that the "q" files exceeded 335Mb.
_________________ Brandon Duncan
IBM Certified MQSeries Specialist
MQSeries.net forum moderator |
|
Back to top |
|
 |
Pierre-Yves Lesage |
Posted: Tue Aug 28, 2001 3:12 am Post subject: |
|
|
Novice
Joined: 21 Aug 2001 Posts: 17 Location: London, UK
|
Hi,
we have tested our Solaris boxes (with MQSeries 5.1) with very large volumes and the limit on the file size is 2GB (and not 1GB). When the q size reaches 2GB, any additional put won't work.
However, there is also a limit on the number of messages you can commit in one go (around 130000). To get around this problem, you need to put the following in the qm.ini
TuningParameters:
IPCCECSetSize=4000000
IPCCExtensionSize=128000
TransMemSetSize=524288
Hope you find that interesting.
Pierre-Yves |
|
Back to top |
|
 |
royr |
Posted: Tue Aug 28, 2001 3:36 am Post subject: |
|
|
 Acolyte
Joined: 30 Jun 2001 Posts: 65 Location: Israel
|
Pierre-Yves,
I was involved in designing a high-workload messaging environment with MQ a few months ago. It's interesting to hear that I wasn't the only one approaching MQ's workload limits.
While I can imagine how one would reach the 2GB queue size limit under some circumstances (and still it interests me how and why), performing a single commit for 130,000 messages sounds very improbable
Can you describe, in general terms, the applications involved in your design?
|
|
Back to top |
|
 |
Pierre-Yves Lesage |
Posted: Tue Aug 28, 2001 4:35 am Post subject: |
|
|
Novice
Joined: 21 Aug 2001 Posts: 17 Location: London, UK
|
royr,
we have set-up a system that was previously designed around MQSeries 5.0.
I can't give you any specific detail but we have got programs that process legacy application files into a hub that is built around MQSI. At the end of the year,
these files can contain more than 300000 thousands records (for reconciliation for instance). When the program processes the file, it processes the whole file in one go and commits the whole lot on the queue.
Pierre-Yves
[ This Message was edited by: Pierre-Yves Lesage on 2001-08-28 05:37 ] |
|
Back to top |
|
 |
|
|
 |
|
Page 1 of 1 |
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
|
|
|