| Author |
Message
|
| mlong30 |
 Posted: Fri May 19, 2006 6:55 am Post subject: Processing Large Binary Files with MqSeries |
 |
|
Novice
Joined: 01 Mar 2005
Posts: 17
|
Hi,
We are currently using Mqseries 5.3. Today we are just processing very small text messages to process orders on a daily basis.
We have a different business unit who has to upload 200mb -500mb of data using windows ftp. They are experiencing timeouts, network hang-ups, and the process takes up the workstation for 45min to an hour.
I was thinking, it would be great if we could just place the data into a queue, and then let another process deliver the data. Since we already have MQ in place, I was wondering can MQ handle large binary files?
Also note, there are about 30 files total for each directory/folder. So I'm thinking they would have to be zipped up before they were placed on the queue. Once they arrive at the destination queue manager, then just get them off the queue, and unzip them.
I'd appreciated any feed back on this issue.
Thanks.
Matt |
|
| Back to top |
|
 |
| vennela |
| Posted: Fri May 19, 2006 7:00 am Post subject: |
|
|
Jedi Knight
Joined: 11 Aug 2002
Posts: 4055
Location: Hyderabad, India
|
| If you want to buy a product I think there are several. PM4Data is one which uses MQ I think. |
|
| Back to top |
|
|
| mlong30 |
| Posted: Fri May 19, 2006 1:47 pm Post subject: |
|
|
Novice
Joined: 01 Mar 2005
Posts: 17
|
| vennela wrote: |
| If you want to buy a product I think there are several. PM4Data is one which uses MQ I think. |
Where can I get a trial copy of PM4Data to try out?
Also I noticed MQ 6.0 has a feature called "secure file transfer over WebSphere MQ". Does this feature require PM4Data or can Mq file transfer work with out it?
[/url]http://www-306.ibm.com/software/integration/wmq/v60/[url]
I'm currently downloading the trial version of Mq 6.0.
Thanks.
Matt
[/url] |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Sat May 20, 2006 5:09 pm Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
| mlong30 wrote: |
| Where can I get a trial copy of PM4Data to try out? |
You can't, as far as I know.
Your IBM sales representative can arrange a demo, perhaps.
| mlong30 wrote: |
| Also I noticed MQ 6.0 has a feature called "secure file transfer over WebSphere MQ". Does this feature require PM4Data or can Mq file transfer work with out it? |
It's not built using PM4Data.
It's also not production quality.
| mlong30 wrote: |
| I'm currently downloading the trial version of Mq 6.0. |
Why? If you're licensed for v5.3 with maintenance, you should be licensed for v6.
And you should be planning to upgrade all your 5.3 servers anyway.
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| kevinf2349 |
| Posted: Sat May 20, 2006 7:19 pm Post subject: |
|
|
Grand Master
Joined: 28 Feb 2003
Posts: 1311
Location: USA
|
| Quote: |
| upload 200mb -500mb of data using windows ftp |
Upload to what platform? If it is z/OS then there will be an upgrade charge. Any other and as Jeff says, it is a no cost upgrade (Not sure about iSeries either, that may be a cost} IBM should be able to assist you. |
|
| Back to top |
|
|
| mlong30 |
| Posted: Wed May 24, 2006 1:27 pm Post subject: |
|
|
Novice
Joined: 01 Mar 2005
Posts: 17
|
| kevinf2349 wrote: |
| Quote: |
| upload 200mb -500mb of data using windows ftp |
Upload to what platform? If it is z/OS then there will be an upgrade charge. Any other and as Jeff says, it is a no cost upgrade (Not sure about iSeries either, that may be a cost} IBM should be able to assist you. |
I need to upload from a windows server to Unix Servers/NFS.
Matt |
|
| Back to top |
|
|
| mlong30 |
| Posted: Wed May 24, 2006 1:30 pm Post subject: |
|
|
Novice
Joined: 01 Mar 2005
Posts: 17
|
[quote="jefflowrey"]
| mlong30 wrote: |
| Where can I get a trial copy of PM4Data to try out? |
You can't, as far as I know.
Your IBM sales representative can arrange a demo, perhaps.
Does IBM own this product? Is it also seperate from MqSeries?
Thanks.
Matt |
|
| Back to top |
|
|
| mlong30 |
| Posted: Wed May 24, 2006 1:33 pm Post subject: |
|
|
Novice
Joined: 01 Mar 2005
Posts: 17
|
[/quote]
Why? If you're licensed for v5.3 with maintenance, you should be licensed for v6.
[/quote]
Does IBM automatically send the new version, or do I have to make a request?
I don't believe we have a maintenance contract, but I'll check to make sure.
Thanks.
Matt |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Wed May 24, 2006 1:34 pm Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
Again, the v6 File Transfer tool is not, in my opinion, a prodution quality tool. You can use it for one time transfers - but you should disable it or not install it on production machines to ensure that you don't leave an open "hole" for exploit.
Otherwise, MQ does not have a "native" facility to transfer anything without a program being written to put data into messages and address those messages and give them to MQ.
Your IBM Sales Representative can talk to you about PM4Data and other solutions in this same space for using MQ as a transport for moving "files".
Or you can write a simple program that will read the files and put them into messages and another program that will read messages and put them into files. Because of the size of your files, you might have to use segmentation or grouping or reference messages. Whatever choice you make will have to be written into the code.
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
|
|
