| Author |
Message
|
| tiangl |
 Posted: Fri Apr 29, 2005 10:05 pm Post subject: how to deal with the maximum length of queue file? |
 |
|
Apprentice
Joined: 19 Nov 2004
Posts: 48
|
MQ has a limitation about the length of queue file, the file size has to be less 1G. but in my case, the msg might exceed 1G in some period. how to deal with in this situation?
thanks! |
|
| Back to top |
|
 |
| zpat |
| Posted: Sat Apr 30, 2005 12:43 am Post subject: |
|
|
Jedi Council
Joined: 19 May 2001
Posts: 5866
Location: UK
|
1 GB messages! Not a good idea, you would need 1GB xmit queues as well to send it anywhere.
Use multiple messages with the groupid set to allow the other end to re-assemble the data. |
|
| Back to top |
|
|
| PeterPotkay |
| Posted: Sat Apr 30, 2005 4:17 am Post subject: |
|
|
Poobah
Joined: 15 May 2001
Posts: 7722
|
Not even a possible idea. Max MQ Message length is 100 MB.
_________________
Peter Potkay
Keep Calm and MQ On |
|
| Back to top |
|
|
| tiangl |
| Posted: Sat May 07, 2005 5:48 pm Post subject: sorry,I didn't make it clear |
|
|
Apprentice
Joined: 19 Nov 2004
Posts: 48
|
| my question is that the length of queue file must be less than 1G,but in sometime, the queue will be put into lots of msg, the total msg's size maybe exceed 1G. how to deal with this situation? is there any way to extend the queue file size ? my platform is aix v5.3, mq is v5.3. |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Sat May 07, 2005 6:37 pm Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
You have to look at this in a practical manner.
With inputs of this size you need to create restart/recovery points.
Let's say every 10 to 12 MB. (5 to 12 messages ?)
Now your messages should only be pass through.
At any point in flight you should not have more than 20 to 30 MB present on the queue (12 MB -- in flight + 12 uncommitted).
MQ should be able to hand this with no problem. You will have to monitor the process carefully as you will not be able to continue if there is a problem with the channel or the receiving application. And you will be limited by the speed of the receiving application.
Enjoy  |
|
| Back to top |
|
|
| PeterPotkay |
| Posted: Sat May 07, 2005 9:40 pm Post subject: |
|
|
Poobah
Joined: 15 May 2001
Posts: 7722
|
| Quote: |
my question is that the length of queue file must be less than 1G
|
Not true.
If you want to use individual queues that will hold more than 2 GB of data, you must enable /var/mqm to use large files.
_________________
Peter Potkay
Keep Calm and MQ On |
|
| Back to top |
|
|
| tiangl |
| Posted: Sat May 07, 2005 10:17 pm Post subject: |
|
|
Apprentice
Joined: 19 Nov 2004
Posts: 48
|
Peter,
got it,thanks a lot! |
|
| Back to top |
|
|
| Michael Dag |
| Posted: Sun May 08, 2005 6:59 am Post subject: Re: how to deal with the maximum length of queue file? |
|
|
Jedi Knight
Joined: 13 Jun 2002
Posts: 2607
Location: The Netherlands (Amsterdam)
|
| tiangl wrote: |
| the msg might exceed 1G in some period. |
What on earth are 1G sized messages ?
_________________
Michael
MQSystems Facebook page |
|
| Back to top |
|
|
| sebastianhirt |
| Posted: Mon May 09, 2005 2:55 am Post subject: |
|
|
Yatiri
Joined: 07 Jun 2004
Posts: 620
Location: Germany
|
Hi Michael,
I don't think that's so unrealistic. We do have some Business Warehouse reports going trough our Middleware that are up to 2 GB big. Even after compression, they are 400 MB. So I can really imagine, that there are scenarios where you need to transport messages that are that incredibly big.
cheers
Sebastian |
|
| Back to top |
|
|
| Tibor |
| Posted: Mon May 09, 2005 4:08 am Post subject: |
|
|
Grand Master
Joined: 20 May 2001
Posts: 1033
Location: Hungary
|
Micheal,
Just imagine a pub/sub movie server 
Tibor |
|
| Back to top |
|
|
| Michael Dag |
| Posted: Mon May 09, 2005 4:12 am Post subject: |
|
|
Jedi Knight
Joined: 13 Jun 2002
Posts: 2607
Location: The Netherlands (Amsterdam)
|
Sebastian/Tibor,
yes I can imagine those examples, but in my mind that's file transfer, not messages. 
_________________
Michael
MQSystems Facebook page |
|
| Back to top |
|
|
| sebastianhirt |
| Posted: Mon May 09, 2005 4:27 am Post subject: |
|
|
Yatiri
Joined: 07 Jun 2004
Posts: 620
Location: Germany
|
I didn't say that I find it a good idea...
In fact I was suggesting to print it out and fax it... That would certainly be even faster than "MQSeries" it trough the WAN |
|
| Back to top |
|
|
|
|
