MQSeries.net :: View topic

Qadeer_824 · Posted: Mon Sep 08, 2008 5:41 am Post subject: Selective idoc xml processing

Hi,
I am looking at processing huge idocs coming out of SAP and doing the required transformations in message broker.

I could see that the WBIA SAP Connector breaks the idoc retrieved from SAP into chunks of 1MB each. These chunks are placed as messages in EVENTS queue of SAP Connector. The SAP Connector then takes the message from EVENTS queue and converts it into XML using the xsd.

To create the message set, i start ODA client on SAP and connect to SAP using BO Designer. I then extract the BO as .xsd files and import them into Toolkit.

However, there could be many segments in SAP, but if i were to use only one or two of those segments, is it possible for SAP connector to generate the xml only for selected segments instead of creating all the unused segments as this unnecessarily increases the message size.

eg: In article master idocs, i could use only the MATHEAD and VARKEY segments, but there could be MARCRT, MVKEEXTRT, MVKEEXTRTX, VARKEYX, MARCRTX segments which are not required by me.
But the xml generated has all these segments inside it. So if the actual data to be processed is 5MB, the XML generated by SAP Connector reaches 20MB.

Can someone please advice on the best way to handle such huge idocs?
Also, is is necessary to set the XML rendering for every element/field in the mxsd files generated by importing the xsd outputs of BO designer?

Please let me know if i'm not clear.

Thanx,
Qadeer