MQSeries.net :: View topic - Best way to fetch huge records in WMB v6.0 JCN

MQSeries.net

Tech Exchange

Education

Certifications

Library

Info Center

SupportPacs

FAQÂ Â

Usergroups

RSS Feed - WebSphere MQ Support

RSS Feed - Message Broker Support

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Best way to fetch huge records in WMB v6.0 JCN

Best way to fetch huge records in WMB v6.0 JCN

« View previous topic :: View next topic »

Author

Message

bprasana

Posted: Wed Nov 04, 2009 11:29 am Post subject: Best way to fetch huge records in WMB v6.0 JCN

Disciple

Joined: 18 Apr 2005
Posts: 179

Hi,

We are trying to fetch a large number of records in java compute node using the standard select statement. This is already giving issues in FVT. We are fetting a lot "application heap size exceeded" SQL errors if the records cound increases to more than say 200.

Although currently we can manually run this SQL query to run in batches(of 100s) by setting some temp value for other records. But we are looking for a permanent solution for this.
One thing that came up was : using the Fetch Cursors to limit the select query to 100 max and go in loops till end.
Does this make sense? can this be implemented in WMB? a few examples would help.

Thanks
bprasana

mqjeff

Posted: Wed Nov 04, 2009 11:38 am Post subject:

Grand Master

Joined: 25 Jun 2008
Posts: 17447

What do you mean by "the standard select statement"?

The *JDBC* standard select statement? Or the MbSQLStatement standard select statement?

Vitor

Posted: Wed Nov 04, 2009 11:55 am Post subject: Re: Best way to fetch huge records in WMB v6.0 JCN

Grand High Poobah

Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA

bprasana wrote:

We are trying to fetch a large number of records in java compute node using the standard select statement.

Why Java? Why in batches?

bprasana wrote:

One thing that came up was : using the Fetch Cursors to limit the select query to 100 max and go in loops till end.
Does this make sense?

I doubt it makes sense. Database cursors are notoriously inefficient and get worse the deep you go through a table.

bprasana wrote:

can this be implemented in WMB?

Probably - you can do most anything in a JCN. How much of a good idea it is forms another question entirely.

I think a bit of background on your requirement may yield better advice here. Or at least answers to my 2 questions above!
_________________
Honesty is the best policy.
Insanity is the best defence.

Display posts from previous:

Page 1 of 1

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Best way to fetch huge records in WMB v6.0 JCN

Jump to:

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum

Protected by Anti-Spam ACP