| Author |
Message
|
| psandip |
 Posted: Wed Mar 28, 2012 4:59 am Post subject: parsing large MRM message |
 |
|
Novice
Joined: 11 Aug 2006
Posts: 17
|
Hi All,
I have a requirement where we need to parse TDS message which maybe upto 40MB in file size and split it into multiple XML's for each line of record. Is there any best practice on how to do this? Any suggestion will be appreciated.
Regards,
Sandeep.
_________________
With Best Regards,
Sandeep |
|
| Back to top |
|
 |
| mqjeff |
| Posted: Wed Mar 28, 2012 5:06 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
First, upgrade to v8 and use DFDL instead of TDS in MRM.
Baring that, look at the large message handling sample. |
|
| Back to top |
|
|
| kimbert |
| Posted: Wed Mar 28, 2012 5:26 am Post subject: |
|
|
Jedi Council
Joined: 29 Jul 2003
Posts: 5542
Location: Southampton
|
|
| Back to top |
|
|
| psandip |
| Posted: Wed Mar 28, 2012 5:45 am Post subject: |
|
|
Novice
Joined: 11 Aug 2006
Posts: 17
|
thanks for your reply guys....
mqjeff,
Upgrading to v8 is not something i can suggest...v7 has been decided by the solution architects and designers... 
kimbert,
Thanks for the link. I am going through it. Actually the input is not in TDS format...input is an XML file which has a CDATA section which can be very large to take the file size to 40MB....and the data in CDATA is tagged delimited....so i said input is in TDS...i hope the scenario doesn't differ.. lol
_________________
With Best Regards,
Sandeep |
|
| Back to top |
|
|
| mqjeff |
| Posted: Wed Mar 28, 2012 5:47 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
|
| Back to top |
|
|
| kimbert |
| Posted: Wed Mar 28, 2012 8:00 am Post subject: |
|
|
Jedi Council
Joined: 29 Jul 2003
Posts: 5542
Location: Southampton
|
| Quote: |
| input is an XML file which has a CDATA section which can be very large to take the file size to 40MB....and the data in CDATA is tagged delimited |
In that case, watch out for line feed character normalization in your TDS data. The XML processor will collapse all cr/lf pairs to a single lf. |
|
| Back to top |
|
|
|
|
