MQSeries.net :: View topic - Large size (50MB) JSON response to convert to CSV in IIB

MQSeries.net

Tech Exchange

Education

Certifications

Library

Info Center

SupportPacs

FAQÂ Â

Usergroups

RSS Feed - WebSphere MQ Support

RSS Feed - Message Broker Support

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Large size (50MB) JSON response to convert to CSV in IIB

Large size (50MB) JSON response to convert to CSV in IIB

« View previous topic :: View next topic »

Author

Message

yshakraj

Posted: Mon Sep 18, 2017 2:51 am Post subject: Large size (50MB) JSON response to convert to CSV in IIB

Voyager

Joined: 14 Sep 2011
Posts: 91

Hi All ,

We have a requirement to get a report from an external REST API which is in JSON data format and of size upto 50 MB .The same needs to be converted to a csv file .

I would like to know the best approach for solving this . I have tried with HTTP request node and compute node which works for a file of size upto 9Mb beyond which my machine gets hung .

Please advice me how to tackle this issue , the response JSON is an array of objects .

Thanks in Advance ,

yshakraj

mqjeff

Posted: Mon Sep 18, 2017 3:27 am Post subject:

Grand Master

Joined: 25 Jun 2008
Posts: 17447

If it's not an [ array of json objects ] is it a { list of json object } ?

Does the rest API let you do paging of results - i.e. get 20 objects?

Did you review the documentation/patterns on handling large messages?
_________________
chmod -R ugo-wx /

yshakraj

Posted: Tue Sep 19, 2017 10:26 pm Post subject:

Voyager

Joined: 14 Sep 2011
Posts: 91

Thanks for your reply mqjeff .

Its an array of objects and about paging am not sure .

Currently checking the patterns for large message - I will update if am successful .

https://www.ibm.com/support/knowledgecenter/en/SSMKHH_10.0.0/com.ibm.etools.mft.doc/ac20702_.htm

Display posts from previous:

Page 1 of 1

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Large size (50MB) JSON response to convert to CSV in IIB

Jump to:

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum

Protected by Anti-Spam ACP