ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Large XML > 250MB scenario in MB / WTX

Post new topic  Reply to topic
 Large XML > 250MB scenario in MB / WTX « View previous topic :: View next topic » 
Author Message
vani_cool
PostPosted: Tue Feb 10, 2015 1:12 pm    Post subject: Large XML > 250MB scenario in MB / WTX Reply with quote

Novice

Joined: 15 Jul 2009
Posts: 17

We have a requirement to handle large XML file in WMB7.0.0.6

Here are the details>
- Recieving input XML file with a probablity of maximum size 250 MB - with 1 million smaller requests

Here is the flow:
Step 1) Receive Big XML File via MFT in WMB -->
Step 2) split xml and send smaller xml's to validate smaller request to system 1 -->
Step 3) bulk the responses and update the req XML to new big XML and send to WTX node in WMB for transformation to Text -->
Step 4) send text file to system 2 via MFT

We have IBM Sterling gateway for file exchange.

We have some queires>
1) should the transformation(XML to text) be carried out in MFT using WTX? is it recommended, viable, more advantages as compared to WTX in WMB X?
2) Should there be other approach of handling big XML - meaning splitting to smaller xmls happen in MFT? And joining smaller xml to big xml in MFT too?
3) is WMB more powerful in aggregate/join than MFT for large xml with 1 milllion smller requests?
4) what over head mq persistance adds to smaller requests?
5) Is replacing MFT(File exchange) with MQ advisable? by increasing size of MQ queue?

Look forward to responses
Back to top
View user's profile Send private message
fjb_saper
PostPosted: Wed Feb 11, 2015 5:34 am    Post subject: Reply with quote

Grand High Poobah

Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY

Lot of questions...
I would suggest you do a POC that will give you some of the answers like overhead, time it takes, etc...
Is 1 million of smaller messages just an expression for a lot, or is the number real?
I was thinking more about a collection than an aggregation...

Have fun
_________________
MQ & Broker admin
Back to top
View user's profile Send private message Send e-mail
mqjeff
PostPosted: Wed Feb 11, 2015 5:50 am    Post subject: Reply with quote

Grand Master

Joined: 25 Jun 2008
Posts: 17447

Look at the large message sample.

That comes with the product, in the samples gallery.
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic  Reply to topic Page 1 of 1

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Large XML > 250MB scenario in MB / WTX
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.