| Author |
Message
|
| Jenny XU |
 Posted: Wed Dec 28, 2005 10:57 pm Post subject: Anybody tell me how to move flatfile into MQ queue? |
 |
|
Newbie
Joined: 28 Dec 2005
Posts: 6
|
Hello all,
I am newbie on MQ.
Currently, I am involved to one integration project using MQ. the logic is designed by others: the flat file from some application server is transported to MQ server1 by FTP, then MQ server1 to MQ server2 using MQ queue, once the flat file is put to specific directory on MQ server1, it will be transfered to MQ server2 using MQ channel.
I will be the owner on MQ server1.
My question is: I would like to how the flat file is moved to queue on MQ server1?
Thanks.
_________________
One thing at one time |
|
| Back to top |
|
 |
| elvis_gn |
| Posted: Wed Dec 28, 2005 11:31 pm Post subject: |
|
|
Padawan
Joined: 08 Oct 2004
Posts: 1905
Location: Dubai
|
Hi Jenny XU,
I think you are not using the Broker, right ?
If you are not then you should have posted in the MQ section...
Anyway, if I'm wrong about the toolkit, then you can use the FTP node.
Else if i'm correct OR if you dont want to go hi-fi, you can write a deamon process to pick messages from the ftp folder and make MQ messages out of it.
Regards. |
|
| Back to top |
|
|
| Jenny XU |
| Posted: Thu Dec 29, 2005 3:49 am Post subject: |
|
|
Newbie
Joined: 28 Dec 2005
Posts: 6
|
Thanks elvis_gn.
I am sorry, I got more information just now, we will use ESB for that.
_________________
One thing at one time |
|
| Back to top |
|
|
| elvis_gn |
| Posted: Thu Dec 29, 2005 3:59 am Post subject: |
|
|
Padawan
Joined: 08 Oct 2004
Posts: 1905
Location: Dubai
|
Hi Jenny XU,
Why dont you share how you are planning to handle this requirement in Detail.
It will definitely be helpful to all of us.
Regards. |
|
| Back to top |
|
|
| Jenny XU |
| Posted: Thu Dec 29, 2005 4:28 am Post subject: |
|
|
Newbie
Joined: 28 Dec 2005
Posts: 6
|
Hello elvis_gn,
Thanks, I am sorry, I am just involved in this project, few document for that at all, so I just asked corp. people and known that logic.
If possible, I will share with you for all. Currently, I just know we used ESB to be tooled to handle message queue.
_________________
One thing at one time |
|
| Back to top |
|
|
| Jenny XU |
| Posted: Thu Dec 29, 2005 8:36 pm Post subject: |
|
|
Newbie
Joined: 28 Dec 2005
Posts: 6
|
ESB is like MQ client written in Java... , which is bussiness oriented, using XML to be triggered to transmit the messagel...
I hope go for more...
_________________
One thing at one time |
|
| Back to top |
|
|
| elvis_gn |
| Posted: Thu Dec 29, 2005 8:44 pm Post subject: |
|
|
Padawan
Joined: 08 Oct 2004
Posts: 1905
Location: Dubai
|
Hi Jenny XU,
Then it is nothing but
| Quote: |
| you can write a deamon process to pick messages from the ftp folder and make MQ messages out of it. |
You are writing the code in Java and using the MQ jar files to access the Queue and put the messages from the ftp'ed files.
Am i right ? 
Where does your Broker come into picture here ? I guess it comes after the Server2.....
It would have been a great learning curve, if you ould use the ftp node directly...I'm waiting for an oppurtunity to use it myself .... 
Regards. |
|
| Back to top |
|
|
| ashoon |
| Posted: Fri Dec 30, 2005 9:43 am Post subject: check out pm4data |
|
|
Master
Joined: 26 Oct 2004
Posts: 235
|
| using PM4Data you can put that file into mq messages either as one message per file or multiple messages per file. No broker required... in fact instead of doing FTP from one server to another by having MQ/pm4data on the originating server you can bypass the FTP component directly. |
|
| Back to top |
|
|
| smeunier |
| Posted: Wed Jan 04, 2006 12:33 pm Post subject: |
|
|
Partisan
Joined: 19 Aug 2002
Posts: 305
Location: Green Mountains of Vermont
|
|
| Back to top |
|
|
| philip.baker |
| Posted: Wed Jan 04, 2006 1:30 pm Post subject: |
|
|
Voyager
Joined: 21 Mar 2002
Posts: 77
Location: Baker Systems Consulting, Inc. - Tampa
|
If needed, the PM4Data product can also FTP 'put' or 'get' a file and place it on a queue or take it from a queue rather than, typically, transferring the file via MQ.
_________________
Regards,
Phil |
|
| Back to top |
|
|
| tinye |
| Posted: Thu Jan 05, 2006 11:40 am Post subject: |
|
|
Novice
Joined: 02 Aug 2005
Posts: 17
Location: OHIO
|
I'm way over my head on this one, so forgive me if this is an obviously fundemental question. My knowledge is limited to putting a data string into a queue, moving it to another queue, and pulling the string out on the other end. But....
In reading this thread, I get the idea that I can take a file (perhaps an xml file?), put it in a queue, move it to another queue, and extract the file on the other end.
Am I seeing this right, or totally missing the boat? |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Thu Jan 05, 2006 11:42 am Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
Yes.
What is a file, but a data string?
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| tinye |
| Posted: Thu Jan 05, 2006 11:56 am Post subject: |
|
|
Novice
Joined: 02 Aug 2005
Posts: 17
Location: OHIO
|
Please wait, while I place my tiny brain around that thought 
Looks like I'll need to crawl back to my boss and tell him we can do it...but of course, I'll need most of 2006 to figure out how
Thanks, Jeff! |
|
| Back to top |
|
|
| ashoon |
| Posted: Thu Jan 05, 2006 4:44 pm Post subject: why even bother w/ files? |
|
|
Master
Joined: 26 Oct 2004
Posts: 235
|
unless your application is already reading and writing files today why even bother doing so instead of reading/writing directly to MQ and a Database - saves you from having to worry about error handling wrt. files and you can do online transactions vs. bulk/batch.
| tinye wrote: |
I get the idea that I can take a file (perhaps an xml file?), put it in a queue, move it to another queue, and extract the file on the other end.
|
|
|
| Back to top |
|
|
| jefflowrey |
| Posted: Thu Jan 05, 2006 5:04 pm Post subject: Re: why even bother w/ files? |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
| ashoon wrote: |
| unless your application is already reading and writing files today why even bother doing so |
Because MQ is a lot more resiliant, reliable and manageable than an FTP transfer. Or a DOS copy. Or a scp. Or a uucp. Or a lot of other "file transfer" technologies. And than things that are not file transfer technologies, but have been abused to be such - like HTTP.
But file transfer is a *complicated* problem on the enterprise level. Reading a file into a variable and then sticking it into an MQ message buffer is only about 1/100th of the actual problem.
But I've done that rant several tens of times already.
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
|
|
