ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » General IBM MQ Support » limit to q file size

Post new topic  Reply to topic
 limit to q file size « View previous topic :: View next topic » 
Author Message
bduncan
PostPosted: Wed Jul 18, 2001 11:23 am    Post subject: Reply with quote

Padawan

Joined: 11 Apr 2001
Posts: 1554
Location: Silicon Valley

On solaris, or any other unix OS for that matter, is there a limit to the size that a queue's q file can take up on the file system other than the limit imposed by the file system itself? A coworker of mine swears that the "q" file for a given queue cannot exceed 1Gb on Solaris. Is this correct? Or is it limited only by the filesystem itself?


_________________
Brandon Duncan
IBM Certified MQSeries Specialist
MQSeries.net forum moderator
Back to top
View user's profile Send private message Visit poster's website AIM Address
bduncan
PostPosted: Tue Jul 24, 2001 8:32 am    Post subject: Reply with quote

Padawan

Joined: 11 Apr 2001
Posts: 1554
Location: Silicon Valley

In answering my own question, after talking with IBM support, it turns out that my problem was arising because of the version of MQSeries I was running. We had a Solaris machine running MQSeries version 5.0, and during operations, whenever the size of the file that stores persistent messages in a queue exceeded 335Mb, the queue manager started routing subsequent messages to the dead letter queue saying that it was unable to allocate additional disk space. We had plenty of space free on the partition, so we couldn't figure out what was going on. IBM recommended upgrading to 5.1 because 5.0 had filesystem issues. As soon as we did that, low and behold, we could keep adding messages to our queues such that the "q" files exceeded 335Mb.


_________________
Brandon Duncan
IBM Certified MQSeries Specialist
MQSeries.net forum moderator
Back to top
View user's profile Send private message Visit poster's website AIM Address
Pierre-Yves Lesage
PostPosted: Tue Aug 28, 2001 3:12 am    Post subject: Reply with quote

Novice

Joined: 21 Aug 2001
Posts: 17
Location: London, UK

Hi,

we have tested our Solaris boxes (with MQSeries 5.1) with very large volumes and the limit on the file size is 2GB (and not 1GB). When the q size reaches 2GB, any additional put won't work.
However, there is also a limit on the number of messages you can commit in one go (around 130000). To get around this problem, you need to put the following in the qm.ini

TuningParameters:
IPCCECSetSize=4000000
IPCCExtensionSize=128000
TransMemSetSize=524288


Hope you find that interesting.

Pierre-Yves
Back to top
View user's profile Send private message
royr
PostPosted: Tue Aug 28, 2001 3:36 am    Post subject: Reply with quote

Acolyte

Joined: 30 Jun 2001
Posts: 65
Location: Israel

Pierre-Yves,

I was involved in designing a high-workload messaging environment with MQ a few months ago. It's interesting to hear that I wasn't the only one approaching MQ's workload limits.

While I can imagine how one would reach the 2GB queue size limit under some circumstances (and still it interests me how and why), performing a single commit for 130,000 messages sounds very improbable

Can you describe, in general terms, the applications involved in your design?
Back to top
View user's profile Send private message
Pierre-Yves Lesage
PostPosted: Tue Aug 28, 2001 4:35 am    Post subject: Reply with quote

Novice

Joined: 21 Aug 2001
Posts: 17
Location: London, UK

royr,

we have set-up a system that was previously designed around MQSeries 5.0.
I can't give you any specific detail but we have got programs that process legacy application files into a hub that is built around MQSI. At the end of the year,
these files can contain more than 300000 thousands records (for reconciliation for instance). When the program processes the file, it processes the whole file in one go and commits the whole lot on the queue.

Pierre-Yves

[ This Message was edited by: Pierre-Yves Lesage on 2001-08-28 05:37 ]
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic  Reply to topic Page 1 of 1

MQSeries.net Forum Index » General IBM MQ Support » limit to q file size
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.