ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Processing large files using FileInput node

Post new topic  Reply to topic
 Processing large files using FileInput node « View previous topic :: View next topic » 
Author Message
wbi_telecom
PostPosted: Fri Sep 25, 2009 7:00 am    Post subject: Processing large files using FileInput node Reply with quote

Disciple

Joined: 15 Feb 2006
Posts: 188
Location: Harrisburg, PA

Environment wmb 6.1.0.3 on Z Linux.
We are using Fielinput nodes to process large XML files. The flow breaks the file into smaller messages and drops them on a queue.
We process a file as big as 51 MB in 1 minute. But when we test with a file which is 200 MB in size its taking 1 hour. We are trying to figure out why the same code is performing so poorly with 250 mb file. We added more RAM on the server and tried increasing the heap size of the EG but it has no effect on the processing time.
Do you know if we are hitting a upper limit on some resources because of which the flow behaves differently for 250 MB file?

Cheers,
Back to top
View user's profile Send private message
mqjeff
PostPosted: Fri Sep 25, 2009 7:03 am    Post subject: Reply with quote

Grand Master

Joined: 25 Jun 2008
Posts: 17447

Review the performance reports and SupportPac IP04. Make sure your code is not causing the performance issue.

Review the Large Message sample flow that comes with Broker 6.1, make sure you're following it's model.
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic  Reply to topic Page 1 of 1

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Processing large files using FileInput node
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.