| Author |
Message
|
| sarathmattam |
 Posted: Sun Jul 19, 2009 10:37 pm Post subject: File output node holds the connection while doing FTP |
 |
|
Voyager
Joined: 05 Sep 2008
Posts: 94
|
Dear All,
I am using message broker 6.1.0.2 in Solaris environment. For the last few weeks i have been facing a problem with FTP. I have a message flow which triggers in every 15 min and get the DB updates, forms a flat file and sends it to the end system which is a Windows server. But some times when the file transfers, it reaches the end system as a 0 KB file. But in my exit log i can see the contents of the file. The FTP parameters are set in the broker level using mqsicreateconfigurablesproperties command. This happens very rarely like once in a day or once in two days. But we are loosing the data. 
So i have done a work around. Now i have edited the configurable properties and set the FTP location to a local folder. Now am using a script to take a back up of the output files and then transfer the files to the FTP location . it is configured in cron tab and its been working successfully for the last one day.
Now what i want to know is
1. Is there any bug reported on File output node related to FTP?
2. How will broker react if the target system is down while it tries to do an FTP?
3. How will broker react if the connection is getting lost while transferring?
Please share your view and experience. Thanks in advance
Thanks & Regards,
Sarath KS |
|
| Back to top |
|
 |
| smdavies99 |
| Posted: Mon Jul 20, 2009 2:44 am Post subject: |
|
|
Jedi Council
Joined: 10 Feb 2003
Posts: 6076
Location: Somewhere over the Rainbow this side of Never-never land.
|
| Quote: |
1. Is there any bug reported on File output node related to FTP?
|
We won't know that information here. The only way you are going to get to the bottom of this is to raise a PMR with IBM.
Please do that and let us know the outcome.
_________________
WMQ User since 1999
MQSI/WBI/WMB/'Thingy' User since 2002
Linux user since 1995
Every time you reinvent the wheel the more square it gets (anon). If in doubt think and investigate before you ask silly questions. |
|
| Back to top |
|
|
| zpat |
| Posted: Mon Jul 20, 2009 4:53 am Post subject: |
|
|
Jedi Council
Joined: 19 May 2001
Posts: 5866
Location: UK
|
It's better to use MQ to deliver important data. FTP (as in the Unix command) was never designed for automated or reliable operation.
MQ gives transactional, reliable, cross-platform, assured, one-time delivery.
It was developed to avoid precisely this kind of issue. |
|
| Back to top |
|
|
| sarathmattam |
| Posted: Mon Jul 20, 2009 9:05 am Post subject: |
|
|
Voyager
Joined: 05 Sep 2008
Posts: 94
|
Dear Zpat/smdavies99,
Thanks for your replies.
FTP was decided because the target system to which we are sending the data is an existing application and they are supporting only FTP. The client was not ready to pay for purchasing MQ
But i have a doubt regarding the way by which a File Output node FTPs a file. Because after enabling a script in cron tab for FTP ing the file i have observed that the script is holding the connection till a complete successful transfer happens(even more than 10 min at times).
Is there any default retry mechanism or default time out available in the Fileoutput node when there is some latency in the connectivity?
Thanks & Regards,
Sarath KS |
|
| Back to top |
|
|
| zpat |
| Posted: Mon Jul 20, 2009 9:21 am Post subject: |
|
|
Jedi Council
Joined: 19 May 2001
Posts: 5866
Location: UK
|
1 - MQ is much cheaper than losing vital data.
2 - MQ client is actually free.
3 - If you can afford WMB, you can certainly afford MQ.
4 - Operationally it has been shown that FTP costs 10 times more than MQ to manage.
FTP can never be anything better than a kludge, a contact admin, vulnerable, insecure, unreliable weak point and a problem legacy for the future.
If you are happy to manage it and watch it like a hawk - fine, but you can still expect to lose or duplicate data on a regular basis.
Let's hope this data does not involve other people's money or personal information. |
|
| Back to top |
|
|
| sarathmattam |
| Posted: Mon Jul 20, 2009 9:48 am Post subject: |
|
|
Voyager
Joined: 05 Sep 2008
Posts: 94
|
Dear Zpat,
From my side, am supporting MQ and FTP. But the target system is not ready to purchase MQ since they have been in place for the last 6 years. Currently we are doing an integration and am doing the role of ESB.
For sure the data doesn't involve Money and personal data.
Thanks & Regards,
Sarath KS |
|
| Back to top |
|
|
| mqjeff |
| Posted: Mon Jul 20, 2009 10:24 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
| You may not be seeing any issues at all with Broker, or FTP, but merely an issue with the receiving program trying to read the file too soon. |
|
| Back to top |
|
|
|
|
