ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Custom Java code for sftp

Post new topic  Reply to topic
 Custom Java code for sftp « View previous topic :: View next topic » 
Author Message
sravan
PostPosted: Tue Feb 01, 2011 8:26 pm    Post subject: Custom Java code for sftp Reply with quote

Centurion

Joined: 02 Apr 2010
Posts: 104
Location: Charlotte

We use custom Java code from Java compute node to transfer files(SFTP) from UNIX to Windows server.
(Since we had earlier version of WMB which did not support file node with sftp at that time).
We use a sftp ssh client vendor for sftp key management/set up.

When the volume is huge ,we are seeing hung therads for the ssh cleint
which is causing a password prompt for the sftp ssh client.

Did anyone experienced this scenario in your applications.

At this moment we are unable to decide who is creating the hung threads(
ssh client or the java code from ajav compute node).
_________________
skr_wmb
Back to top
View user's profile Send private message
fjb_saper
PostPosted: Tue Feb 01, 2011 8:41 pm    Post subject: Reply with quote

Grand High Poobah

Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY

Remember that ftp and even sftp is not highly reliable and that transfers can be aborted, due to various environmental conditions, before their completion. You might want to be looking into using a product like MQFTE, Connect Direct, etc... (their protocol guarantees the arrival of the full file before triggering stuff) for your file transfers.

Have fun
_________________
MQ & Broker admin
Back to top
View user's profile Send private message Send e-mail
mqjeff
PostPosted: Wed Feb 02, 2011 5:37 am    Post subject: Reply with quote

Grand Master

Joined: 25 Jun 2008
Posts: 17447

You should at least migrate to a version of Broker that has the FileInput node and supports sftp.

Then you will be able to point fingers in the right places via a PMR if you still see hung threads.

As FJ says, the care and feeding of an ftp transfer, whether over SSh or not, is a complicated process, and is a much much harder problem than it seems at first. So it's usually much less expensive to use an off-the-shelf solution to handle file transfers to external partners than to write your own, over the lifetime of the solution.
Back to top
View user's profile Send private message
sravan
PostPosted: Wed Feb 02, 2011 11:16 am    Post subject: Reply with quote

Centurion

Joined: 02 Apr 2010
Posts: 104
Location: Charlotte

Thanks for you'r responses.

If we use higher version of file node which has the sftp capability,there is chance that it might be resolved,The only concern is because of the intermittent nature of this hung threads it is difficult to replicate in the test environment to prove this.
_________________
skr_wmb
Back to top
View user's profile Send private message
lancelotlinc
PostPosted: Wed Feb 02, 2011 11:47 am    Post subject: Reply with quote

Jedi Knight

Joined: 22 Mar 2010
Posts: 4941
Location: Bloomington, IL USA

sravan wrote:
Thanks for you'r responses.

If we use higher version of file node which has the sftp capability,there is chance that it might be resolved,The only concern is because of the intermittent nature of this hung threads it is difficult to replicate in the test environment to prove this.


Sounds like a great business case for a Performance Test Environment which is capable to simulate true business transactions for long periods, like several days straight. Else, how would you promote this code to Prod without knowing if it worked first?

You should be capable of replicating any business transaction in test. You should be capable of replicating any combinations of business transactions in test. This may imply the need to build downstream simulators.
_________________
http://leanpub.com/IIB_Tips_and_Tricks
Save $20: Coupon Code: MQSERIES_READER
Back to top
View user's profile Send private message Send e-mail
Display posts from previous:   
Post new topic  Reply to topic Page 1 of 1

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Custom Java code for sftp
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.