|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
 |
|
Large XML > 250MB scenario in MB / WTX |
« View previous topic :: View next topic » |
Author |
Message
|
vani_cool |
Posted: Tue Feb 10, 2015 1:12 pm Post subject: Large XML > 250MB scenario in MB / WTX |
|
|
Novice
Joined: 15 Jul 2009 Posts: 17
|
We have a requirement to handle large XML file in WMB7.0.0.6
Here are the details>
- Recieving input XML file with a probablity of maximum size 250 MB - with 1 million smaller requests
Here is the flow:
Step 1) Receive Big XML File via MFT in WMB -->
Step 2) split xml and send smaller xml's to validate smaller request to system 1 -->
Step 3) bulk the responses and update the req XML to new big XML and send to WTX node in WMB for transformation to Text -->
Step 4) send text file to system 2 via MFT
We have IBM Sterling gateway for file exchange.
We have some queires>
1) should the transformation(XML to text) be carried out in MFT using WTX? is it recommended, viable, more advantages as compared to WTX in WMB X?
2) Should there be other approach of handling big XML - meaning splitting to smaller xmls happen in MFT? And joining smaller xml to big xml in MFT too?
3) is WMB more powerful in aggregate/join than MFT for large xml with 1 milllion smller requests?
4) what over head mq persistance adds to smaller requests?
5) Is replacing MFT(File exchange) with MQ advisable? by increasing size of MQ queue?
Look forward to responses |
|
Back to top |
|
 |
fjb_saper |
Posted: Wed Feb 11, 2015 5:34 am Post subject: |
|
|
 Grand High Poobah
Joined: 18 Nov 2003 Posts: 20756 Location: LI,NY
|
Lot of questions...
I would suggest you do a POC that will give you some of the answers like overhead, time it takes, etc...
Is 1 million of smaller messages just an expression for a lot, or is the number real?
I was thinking more about a collection than an aggregation...
Have fun  _________________ MQ & Broker admin |
|
Back to top |
|
 |
mqjeff |
Posted: Wed Feb 11, 2015 5:50 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008 Posts: 17447
|
Look at the large message sample.
That comes with the product, in the samples gallery. |
|
Back to top |
|
 |
|
|
 |
|
Page 1 of 1 |
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
|
|
|