| |
|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
  |
|
| Handling large CSV files. |
« View previous topic :: View next topic » |
| Author |
Message
|
| varun.gubba |
 Posted: Mon Sep 16, 2013 10:15 am Post subject: Handling large CSV files. |
 |
|
Newbie
Joined: 16 Sep 2013
Posts: 4
|
Hi am very new to Message broker can you guys please help me..
Am trying to convert a CSV file into XML format.. for which i have created a CSV message set(with the help of WMB info center) and created a Message flow with MQinput, compute and a MQ output node. and in the Compute node i did the req Esql coding for conversion.
Here comes the problem... My requirement is to convert a large amount of data.. i.e i have more than a million records in a file and i need to convert all those records into XML.... my code is working fine for 10,15, 20 records but when am trying to use a big file the message flow is failing.
what should i do now? |
|
| Back to top |
|
 |
| lancelotlinc |
| Posted: Mon Sep 16, 2013 10:22 am Post subject: Re: Handling large CSV files. |
|
|
Jedi Knight
Joined: 22 Mar 2010
Posts: 4941
Location: Bloomington, IL USA
|
| varun.gubba wrote: |
Hi am very new to Message broker can you guys please help me..
Am trying to convert a CSV file into XML format.. for which i have created a CSV message set(with the help of WMB info center) and created a Message flow with MQinput, compute and a MQ output node. and in the Compute node i did the req Esql coding for conversion.
Here comes the problem... My requirement is to convert a large amount of data.. i.e i have more than a million records in a file and i need to convert all those records into XML.... my code is working fine for 10,15, 20 records but when am trying to use a big file the message flow is failing.
what should i do now? |
Troubleshoot the root problem and fix the root cause.
_________________
http://leanpub.com/IIB_Tips_and_Tricks
Save $20: Coupon Code: MQSERIES_READER |
|
| Back to top |
|
|
| Vitor |
| Posted: Mon Sep 16, 2013 10:41 am Post subject: Re: Handling large CSV files. |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| varun.gubba wrote: |
| what should i do now? |
Tell us what it's failing with so we don't have to guess. The way you've described it your code could be fine & you're filling the output queue....
Review the advice in the InfoCenter for handling large files.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
|
|
|
| |
|
Page 1 of 1 |
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
