MQSeries.net :: View topic - Large Files Handling more than 100 MB using MB and WTX Node

MQSeries.net

Tech Exchange

Education

Certifications

Library

Info Center

SupportPacs

FAQÂ Â

Usergroups

RSS Feed - WebSphere MQ Support

RSS Feed - Message Broker Support

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Large Files Handling more than 100 MB using MB and WTX Node

Large Files Handling more than 100 MB using MB and WTX Node

« View previous topic :: View next topic »

Author

Message

sunil521

Posted: Mon Dec 31, 2012 1:43 pm Post subject: Large Files Handling more than 100 MB using MB and WTX Node

Newbie

Joined: 05 Dec 2012
Posts: 1

Hello All,

In my design I need to get the two data files using FileInput nodes. One data file is more than 100 MB and another is small data file. Then I need to send to WebSphere TX node using collector node. Here the data records are stored in SYSTEM.BROKER.EDA.COLLECTIONS when the collector node handles the message but the queue max size is 100 MB.

Can anybody throw some ideas.

Thanks,
Sunil Sure

Vitor

Posted: Tue Jan 01, 2013 5:27 am Post subject: Re: Large Files Handling more than 100 MB using MB and WTX N

Grand High Poobah

Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA

sunil521 wrote:

Can anybody throw some ideas.

Only if you throw some more information. You appear to be indicating that you have one giant file which needs to be collated with a smaller data file. If this is the case your design sucks and you're be better off using SyncSort or a similar utility to collate the files.

Confirm that you really, actually have a file of 100Mb or larger which is a single data entity and not a series of records, and then explain how this smaller file fits in (pun only slightly intended) given that all the collector node is doing is placing both in a message tree (see my comment above on utilities)
_________________
Honesty is the best policy.
Insanity is the best defence.

Display posts from previous:

Page 1 of 1

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Large Files Handling more than 100 MB using MB and WTX Node

Jump to:

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum

Protected by Anti-Spam ACP