MQSeries.net :: View topic - to process large xml file record by record

MQSeries.net

Tech Exchange

Education

Certifications

Library

Info Center

SupportPacs

FAQÂ Â

Usergroups

RSS Feed - WebSphere MQ Support

RSS Feed - Message Broker Support

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » to process large xml file record by record

to process large xml file record by record

« View previous topic :: View next topic »

Author

Message

adars1

Posted: Thu Jul 17, 2014 4:04 pm Post subject: to process large xml file record by record

Apprentice

Joined: 13 Jun 2010
Posts: 39

Hi

I have large xml file and i want to read record(<data>) by record to create one msg for every record.

<Test>
<head>
<\data>
<\data>
<\data>
</Test>

Is there a way in fileinput node to read xml file using delimiter xpath.

smdavies99

Posted: Thu Jul 17, 2014 9:33 pm Post subject:

Jedi Council

Joined: 10 Feb 2003
Posts: 6076
Location: Somewhere over the Rainbow this side of Never-never land.

Have you looked at the various properties of the FileInput Node?

What options have you tried?
_________________
WMQ User since 1999
MQSI/WBI/WMB/'Thingy' User since 2002
Linux user since 1995

Every time you reinvent the wheel the more square it gets (anon). If in doubt think and investigate before you ask silly questions.

adars1

Posted: Thu Jul 17, 2014 10:07 pm Post subject:

Apprentice

Joined: 13 Jun 2010
Posts: 39

for xml file i tried both whole file and parsed record sequence but both options load entire file.

ghoshly

Posted: Thu Jul 17, 2014 10:49 pm Post subject: record delimiter

Partisan

Joined: 10 Jan 2008
Posts: 325

How are you marking each record ?

What parameter you are providing as record delimiter?

fjb_saper

Posted: Fri Jul 18, 2014 4:39 am Post subject:

Grand High Poobah

Joined: 18 Nov 2003
Posts: 20696
Location: LI,NY

If your file is less than 2 GB you can use whole file and Large message technique.... If your file is > 2GB you will have to decide how you are going to cut the XML....

Have fun

_________________
MQ & Broker admin

adars1

Posted: Fri Jul 18, 2014 9:20 am Post subject:

Apprentice

Joined: 13 Jun 2010
Posts: 39

the problem I have is custom delimiter(xml element name) is more than the max length 32 hexadecimal digits allowed. is the option is read as blob and read each record out of blob ? or is there any built in option to read xml record by its repeating element.

Vitor

Posted: Fri Jul 18, 2014 9:29 am Post subject:

Grand High Poobah

Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA

adars1 wrote:

or is there any built in option to read xml record by its repeating element.

Yes - the Large Message technque my worthy associate mentioned. It's not an "option" in the sense of "I can do my job by simply ticking this check box" but it's not a lot of coding & it's well explained in the documentation.
_________________
Honesty is the best policy.
Insanity is the best defence.

Display posts from previous:

Page 1 of 1

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » to process large xml file record by record

Jump to:

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum

Protected by Anti-Spam ACP