Posted: Wed May 07, 2008 8:46 am Post subject: 61 fileInput ftp performance
Partisan
Joined: 07 Aug 2001 Posts: 386
I am using WMB 61 on AIX
I have a very simple flow
FileInput - compute - MQOUTPUT
The fileInput is using the blob parser, the compute node is just doing copy entire message.
The entire file will be output to the queue as a MQ message.
The hardware configuration is
AIX(File server) - AIX(Message broker). So the broker FileInput node is getting the file from a remote AIX server using ftp.
The ftp scan delay is set at 30 sec
I started with no file on the file server with the message flow running.
I than created the file using a shell script which included a timestamp in the file. So I know the time when the file is created. The file is of size 2M bytes.
When I compare the MQPUT time of the message on the output queue and the timestamp in my file, there is a close to 2 minute 10 sec difference. The clock of the two boxes has a 10 sec difference. Taking the full 30 sec scan delay into account, it still takes cloase 2 minutes from the file is picked up to the creation of the output message.
I than repeat the same test with an Input file size increased from 2M to 5 M, the elapse time is about 4 minutes.
If I just ftp the same 2M file between the two AIX boxes, it takes 0.033 sec.
Why is the fileInout node so slow ? Is there any tuning I can do to make it faster? Please let me know if my test is wrong.
Has anyine perform similar kind of testing and have different results ?
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum