| Author |
Message
|
| busy_chap |
 Posted: Thu Jun 10, 2010 9:17 am Post subject: File Input Node Question |
 |
|
Acolyte
Joined: 18 May 2006
Posts: 69
|
Hello,
I have been looking around to try to find an answer but couldn't get an exact answer so I am posting my question here.
We have a requirement where we have to move files from 4 different folders on the source server to 4 different folders on the target server.
Example:
Server A Server B
Input 1-----------------------Input a
Input 2----------------------- Input b
Input 3----------------------- Input c
I did some research and it looks like the File input can have only one folder as the source but many different folders as targets or is there a way to have multiple folders as Input also?
Please let me know if anyone was able to accomplish this as I was thinking that creating one flow per file transfer for different folders on different servers would be ideal from a re-usability perspective but don't know if that is even achievable. |
|
| Back to top |
|
 |
| Gaya3 |
| Posted: Thu Jun 10, 2010 10:53 am Post subject: Re: File Input Node Question |
|
|
Jedi
Joined: 12 Sep 2006
Posts: 2493
Location: Boston, US
|
| busy_chap wrote: |
I did some research and it looks like the File input can have only one folder as the source but many different folders as targets
|
Yes, file input node can have only one folder at a time, its static.
| busy_chap wrote: |
or is there a way to have multiple folders as Input also?
|
No ,its not possible
| busy_chap wrote: |
Please let me know if anyone was able to accomplish this as I was thinking that creating one flow per file transfer for different folders on different servers would be ideal from a re-usability perspective but don't know if that is even achievable. |
create one flow per file transfer for different folders
or
keep all the files in one folder and do a content based routing and process it.
_________________
Regards
Gayathri
-----------------------------------------------
Do Something Before you Die |
|
| Back to top |
|
|
| fatherjack |
| Posted: Thu Jun 10, 2010 11:08 am Post subject: Re: File Input Node Question |
|
|
Knight
Joined: 14 Apr 2010
Posts: 522
Location: Craggy Island
|
| busy_chap wrote: |
| We have a requirement where we have to move files from 4 different folders on the source server to 4 different folders on the target server. |
Is that your full requirement. If so, do you need WMB at all?
_________________
Never let the facts get in the way of a good theory. |
|
| Back to top |
|
|
| busy_chap |
| Posted: Thu Jun 10, 2010 11:48 am Post subject: |
|
|
Acolyte
Joined: 18 May 2006
Posts: 69
|
Thanks for the answers. That is exactly what I am looking for and yes that is my full requirement.
I know that there are couple of other tools available that we could easily do this with and we are in the process of purchasing one but the business can't wait for that long so we have to create as many message flows as needed to accomodate this.
Thanks again for your responses |
|
| Back to top |
|
|
| fatherjack |
| Posted: Thu Jun 10, 2010 11:54 am Post subject: |
|
|
Knight
Joined: 14 Apr 2010
Posts: 522
Location: Craggy Island
|
| busy_chap wrote: |
| yes that is my full requirement. |
Can't you just transfer them using ftp or other file transfer tool.
_________________
Never let the facts get in the way of a good theory. |
|
| Back to top |
|
|
| busy_chap |
| Posted: Thu Jun 10, 2010 11:58 am Post subject: |
|
|
Acolyte
Joined: 18 May 2006
Posts: 69
|
Currently, that is how we have been handling these kind of requests and our business had many bitter experiences with the FTP file transfer so they are relying on us to do a better job of File transfer with WBI or any other tool we could use to make their life easy.
Have you guys seen any performance hits with many File input node flows? I was looking at the info center , they only mentioned that lesser Polling interval takes lot of resources but nothing related to performance or CPU utilization.
Do you know anything about that? |
|
| Back to top |
|
|
| Gaya3 |
| Posted: Thu Jun 10, 2010 12:05 pm Post subject: |
|
|
Jedi
Joined: 12 Sep 2006
Posts: 2493
Location: Boston, US
|
| busy_chap wrote: |
Currently, that is how we have been handling these kind of requests and our business had many bitter experiences with the FTP file transfer so they are relying on us to do a better job of File transfer with WBI or any other tool we could use to make their life easy.
Have you guys seen any performance hits with many File input node flows? I was looking at the info center , they only mentioned that lesser Polling interval takes lot of resources but nothing related to performance or CPU utilization.
Do you know anything about that? |
There are some tools for this,
Metastorm Integration File Transfer tool , FTP over MQ
_________________
Regards
Gayathri
-----------------------------------------------
Do Something Before you Die |
|
| Back to top |
|
|
| fatherjack |
| Posted: Thu Jun 10, 2010 12:13 pm Post subject: |
|
|
Knight
Joined: 14 Apr 2010
Posts: 522
Location: Craggy Island
|
| busy_chap wrote: |
| Currently, that is how we have been handling these kind of requests and our business had many bitter experiences with the FTP file transfer so they are relying on us to do a better job of File transfer with WBI or any other tool we could use to make their life easy. |
But the file nodes in WBI don't actually do the file transfer. You either have to do this as a separate ftp (or other) step in the process or configure the ftp properties on the file output node in which case you're still using ftp. Or maybe use some shared disk solution. Anyway I'm still not convinced WBI adds any value to what you are trying to do i.e. get a file from A to B.
If your business have had bad experiences with ftp I suggest you look at a more robust managed file transfer solution. There's plenty about.
_________________
Never let the facts get in the way of a good theory. |
|
| Back to top |
|
|
| fatherjack |
| Posted: Thu Jun 10, 2010 12:17 pm Post subject: |
|
|
Knight
Joined: 14 Apr 2010
Posts: 522
Location: Craggy Island
|
| fatherjack wrote: |
| There's plenty about. |
Including those Gaya3 has just mentioned. FYI the Metastorm product uses MQ as its transfer mechanism.Or at least it did when it was CommerceQuest's product.
_________________
Never let the facts get in the way of a good theory. |
|
| Back to top |
|
|
| busy_chap |
| Posted: Thu Jun 10, 2010 12:29 pm Post subject: |
|
|
Acolyte
Joined: 18 May 2006
Posts: 69
|
Thanks for the suggestions. I will bring them to management's attention but to be honest with you, with in the given time and technologies that I have in my reach at my firm right now, I have to use the File input node to accomplish this.
But anyways I will keep trying. Thanks again for your quick responses. |
|
| Back to top |
|
|
| Gaya3 |
| Posted: Thu Jun 10, 2010 1:00 pm Post subject: |
|
|
Jedi
Joined: 12 Sep 2006
Posts: 2493
Location: Boston, US
|
| busy_chap wrote: |
Thanks for the suggestions. I will bring them to management's attention but to be honest with you, with in the given time and technologies that I have in my reach at my firm right now, I have to use the File input node to accomplish this.
But anyways I will keep trying. Thanks again for your quick responses. |
thats nice, but please convey them that
"Not to treat Message Broker as a FTP Tool" : 
It can do more than what we think.....  
_________________
Regards
Gayathri
-----------------------------------------------
Do Something Before you Die |
|
| Back to top |
|
|
| fatherjack |
| Posted: Thu Jun 10, 2010 1:33 pm Post subject: |
|
|
Knight
Joined: 14 Apr 2010
Posts: 522
Location: Craggy Island
|
| busy_chap wrote: |
| with in the given time and technologies that I have in my reach at my firm right now, I have to use the File input node to accomplish this. |
To accomplish what? The File Input node will not transfer files from one server to another which is what you said you are trying to do.
| Gaya3 wrote: |
| "Not to treat Message Broker as a FTP Tool" |
Correct. Because it isn't. It doesn't do file transfer.
_________________
Never let the facts get in the way of a good theory. |
|
| Back to top |
|
|
| busy_chap |
| Posted: Thu Jun 10, 2010 2:01 pm Post subject: |
|
|
Acolyte
Joined: 18 May 2006
Posts: 69
|
fatherjack.. may be I am missing something but Yes the File input node is used to move files from one server to other.
Infact we have been testing this but with only one directory. Don't know what you mean by we cannot use File input/output nodes to do file transfer.
Our scenario:
We have files in a /ar/...../bi/input on Server A and we built a FTP flow that moves the files in the respective folder on Server A and moves it to /ap....../bi/output folder on Server B. Ofcourse the servers are within our network.
I agree this cannot be treated as a FTP tool but right now I don't have a choice |
|
| Back to top |
|
|
| fatherjack |
| Posted: Thu Jun 10, 2010 2:32 pm Post subject: |
|
|
Knight
Joined: 14 Apr 2010
Posts: 522
Location: Craggy Island
|
| busy_chap wrote: |
| fatherjack.. may be I am missing something but Yes the File input node is used to move files from one server to other. |
No it isn't. It reads a file in, as a whole or record by record, into a message flow.
| busy_chap wrote: |
| Don't know what you mean by we cannot use File input/output nodes to do file transfer. |
I didn't say that. I said WMB doesn't do file transfer. Sure, you can configure the File Output node to invoke the file transfer but you still need an FTP server to do it.
| busy_chap wrote: |
| we built a FTP flow |
I guess you mean you built a message flow that has a File Input node, maybe some other nodes and a File Output node, with the File Output node's FTP properties configured. So you are still using FTP.
So what added value is WMB giving you?
_________________
Never let the facts get in the way of a good theory. |
|
| Back to top |
|
|
| sushilishere |
| Posted: Fri Jun 11, 2010 1:27 am Post subject: |
|
|
Apprentice
Joined: 27 Jul 2008
Posts: 36
|
From personal experiences!!!
Using the FTP provided with MB has all the problems of using a generic FTP( MB again uses the same thing).
IF u blve u have conquered the issues related to FTP by using Fileoutput nodes ftp properties , you are wrong.
We right now use scripts to do the ftp job.
When the FTP connection is a lil cranky, broker tends to hang(probably retrying) not allowing any other process related to it to continue.
Just a request after facing the pains of FTP.. don use IT if the FTP setup is bad. MB will not solve tat issue for u!!!
_________________
----------------------------
IBM MQ v6.0 Sys Admin
IBM MBv6.0 Sol Desgnr
----------------------------------------------------
By the Mountain Side.. looking at the Great Divide
---------------------------------------------------- |
|
| Back to top |
|
|
|
|
