| |
|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
  |
|
| File Transfer through MQSeries? |
« View previous topic :: View next topic » |
| Author |
Message
|
| kats |
 Posted: Mon Jul 24, 2006 12:20 pm Post subject: File Transfer through MQSeries? |
 |
|
Voyager
Joined: 20 Apr 2006
Posts: 78
|
I'm inquisitive to know as to how can we transfer large files through MQSeries. There are some software like PM4Data that uses MQSeries for bulk transfer but just wondering can we do it without installing third party software??
I came across certain functions(in MQ) to transfer files like:
mqftrcv Receive file on server
mqftrcvc Receive file on client
mqftsnd Send file from server
mqftsndc Send file from client
I sent a file(4kb) with a following syntax:
mqftsnd -q Q1 -m QM1 -t QM2 -f file.txt
Where QM1 is sender qmgr.
Q1 is remote Queue on QM1 pointing to local Queue Q1 on qmgr QM2.
QM2 is target/recieving qmgr .
And I've sent a file 'file.txt' which is 4KB.
Qlocal Q1 is 4MB size(Being IBM default)
So far my quesitons are:
1. If I transfer a zipped file, is it broken into messages and rejoined over at receiver.
2. Is the file depenend on recipient local queue size?? In my case answer seems to be yes since I failed to transfer a file more than 4MB size. That makes me wonder How can we transfer large files??
3. Is it a viable solution that can potentially replace ftp since ftp at organisational level is always considered as security threat.(Ofcourse not SFTP so far)
4. What platform these functions are supported upon.
#$& Any other attribute you wanna shed light on: ..........???  |
|
| Back to top |
|
 |
| jefflowrey |
| Posted: Mon Jul 24, 2006 12:32 pm Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
In my opinion, this is not an enterprise caliber tool.
It has, for example, no explicit security measures - all security is handled by OS level security provisions and there is no way to confirm that the sender is allowed to copy a particular file to a particular location at the receiver. So if you're not very very careful, for example someone could overwrite /etc/password on unix systems.
In addition, it does not have auditing at what I consider to be an enterprise level. In fact, as far as I know, it has no auditing at all - no way to record who sent what when and if it succeeded or failed.
Also, this is fairly frequently discussed topic - you should spend some time searching for "ftp" or "file transfer" here.
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| kats |
| Posted: Mon Jul 24, 2006 1:08 pm Post subject: |
|
|
Voyager
Joined: 20 Apr 2006
Posts: 78
|
Thanks Jeff,
Ofcourse I did go through this link: http://www.mqseries.net/phpBB2/viewtopic.php?t=28440&highlight=instatalling+mq+6+0+windows
It's very helpful.And a message by ashoon over this page caught my eye:
" I did a test between Windows Copy, FTP and MQ on two windows machines and MQ was much quicker... 4.5 GB in 1 1/2 minutes compared to 4+ w/ FTP. "
That led me to think how can I transfer large/bulk file transfer. ???
I saw you saying at one place over this page
"In general, MQ can be very good for file transfer types of solutions. But it is much much better to buy a product that knows how to use MQ to do this than to try and build one yourself"
So that tells me that there is no in built function in MQSeries product so far, meant for bulk File Transfer??
We have to employ third party tool...!!!! 
And just wondering about zipped file...does MQ really breaks it and then rejoins it. |
|
| Back to top |
|
|
| ashoon |
| Posted: Mon Jul 24, 2006 1:18 pm Post subject: Re: File Transfer through MQSeries? |
|
|
Master
Joined: 26 Oct 2004
Posts: 235
|
hey kats - I agree that pm4data is a 3rd party tool which when compared to FTP is, at first glance, considered 'too expensive'. The real use case for pm4data is when you're trying to implement an enterprise managed file transfer suite. pm4data just happens to use MQ for it's transport vs. other MFT products.
The problems that I see a MFT such as pm4data addressing include:
auditability/visibility into many FTP's allowing for pro-active problem management vs. the waiting for the customer to call.
assurred once-only-once delivery (very tough todo w/ FTP)
platform conversions
HTH,
| kats wrote: |
I'm inquisitive to know as to how can we transfer large files through MQSeries. There are some software like PM4Data that uses MQSeries for bulk transfer but just wondering can we do it without installing third party software??
I came across certain functions(in MQ) to transfer files like:
mqftrcv Receive file on server
mqftrcvc Receive file on client
mqftsnd Send file from server
mqftsndc Send file from client
I sent a file(4kb) with a following syntax:
mqftsnd -q Q1 -m QM1 -t QM2 -f file.txt
Where QM1 is sender qmgr.
Q1 is remote Queue on QM1 pointing to local Queue Q1 on qmgr QM2.
QM2 is target/recieving qmgr .
And I've sent a file 'file.txt' which is 4KB.
Qlocal Q1 is 4MB size(Being IBM default)
So far my quesitons are:
1. If I transfer a zipped file, is it broken into messages and rejoined over at receiver.
2. Is the file depenend on recipient local queue size?? In my case answer seems to be yes since I failed to transfer a file more than 4MB size. That makes me wonder How can we transfer large files??
3. Is it a viable solution that can potentially replace ftp since ftp at organisational level is always considered as security threat.(Ofcourse not SFTP so far)
4. What platform these functions are supported upon.
#$& Any other attribute you wanna shed light on: ..........??? |
|
|
| Back to top |
|
|
| jefflowrey |
| Posted: Mon Jul 24, 2006 1:27 pm Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
Here's the basic deal.
You need to start with your actual file transfer requirements. How big of files do you need to move? How secure does this need to be? Who needs to be able to configure a file transfer? Who needs to be able to monitor a file transfer or restart one? Who needs to know if any file transfer failed or succeeded? Who needs to know how many transfers worked and didnt? And etc. In my opinion, the presupplied file transfer tool does not meet the requirements I think most people will have. But that's just me, and maybe your requirements are different!
The pre-supplied file transfer tool, as I understand it, is supposed to be a bulk-transfer tool. MarkT has posted some hints that it will actually break large files up into individual segments, transfer those over MQ, and reassemble them on the recieving side. This would be regardless of what kind of file it was.
But again, I don't think it's a safe tool, or a tool that meets most people's requirements - without a lot of extra work on top.
You can also look at WebSphere Partner Gateway - this can be used for both internal and external file transfers of all kinds, and I believe it can use MQ as a transport. It's not a third-party tool at least! 
Start with your requirements!
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| kats |
| Posted: Tue Jul 25, 2006 12:37 pm Post subject: |
|
|
Voyager
Joined: 20 Apr 2006
Posts: 78
|
| Quote: |
| In my opinion, the presupplied file transfer tool does not meet the requirements I think most people will have. But that's just me, and maybe your requirements are different! |
I'm sorry I think I lost you Jeff...Did you mean these tools as "pre-supplied file transfer tool"
mqftrcv Receive file on server
mqftrcvc Receive file on client
mqftsnd Send file from server
mqftsndc Send file from client
Anyways, we've nearly 2K qmgrs. Each qmgr is further connected to 10 MQ Clients. We got PM4Data installed at our place considering the scalability of our job. I was only inquisitive if I could do the job (which is right now done by PM4Data) through any inbuilt function in MQSeries.
Talking about the "actual file transfer requirements" , I totally agree with you Jeff. But sitting with my colleauge I was just wondering for a moment How could I send a file say 5GB through any inbuilt function in MQ.
Anyway thanks Jeff and Ashoon for your inputs.
When I was kid, I used to read any new comic by spiderman. Now I read any new message posted by you Jeff... Hats off |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Tue Jul 25, 2006 4:20 pm Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
| kats wrote: |
I'm sorry I think I lost you Jeff...Did you mean these tools as "pre-supplied file transfer tool"
mqftrcv Receive file on server
mqftrcvc Receive file on client
mqftsnd Send file from server
mqftsndc Send file from client |
They are supplied with the product... so, yes, I consider them a "pre-supplied file transfer tool".
I do not, however, consider them an enterprise-caliber "pre-supplied file transfer tool". But I also don't think that was part of the design requirements for them - so I don't consider it a bad thing.
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
|
|
|
| |
|
Page 1 of 1 |
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
