| Author |
Message
|
| hp_tvm |
 Posted: Fri Jan 11, 2008 2:43 am Post subject: MQ Performance with Java and WAS 6.2 Sever |
 |
|
Newbie
Joined: 11 Jan 2008
Posts: 6
|
Hi - We are in the process of writing a Java component that would read from an MQ. This Q would get around 20K messages per hour. Our Java program needs to read this Q, parse the data and process it.
Are there any guidelines/ performance improving techniques while programming Java with MQ for Txns of this volume ? Any tips or pointers to sites containing MQ Java tuning techniques would be helpful. Thanks |
|
| Back to top |
|
 |
| Vitor |
| Posted: Fri Jan 11, 2008 3:19 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
Don't double post! 
Moved to Java forum
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| hp_tvm |
| Posted: Fri Jan 11, 2008 3:41 am Post subject: Where is the Java forum |
|
|
Newbie
Joined: 11 Jan 2008
Posts: 6
|
Sorry for cross-posting.
Can you provide the url for the Java forum ? Thanks much |
|
| Back to top |
|
|
| Vitor |
| Posted: Fri Jan 11, 2008 4:10 am Post subject: Re: Where is the Java forum |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| hp_tvm wrote: |
Sorry for cross-posting.
Can you provide the url for the Java forum ? Thanks much |
You're looking at it!
Perhaps I should have said section.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Fri Jan 11, 2008 4:10 am Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
Use JMS standards and read the JMS Topologies red book. 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| JLRowe |
| Posted: Fri Jan 11, 2008 9:25 am Post subject: Re: MQ Performance with Java and WAS 6.2 Sever |
|
|
Yatiri
Joined: 25 May 2002
Posts: 664
Location: South East London
|
| hp_tvm wrote: |
Hi - We are in the process of writing a Java component that would read from an MQ. This Q would get around 20K messages per hour. Our Java program needs to read this Q, parse the data and process it.
Are there any guidelines/ performance improving techniques while programming Java with MQ for Txns of this volume ? Any tips or pointers to sites containing MQ Java tuning techniques would be helpful. Thanks |
Is message loss acceptable?
Then you can use non-persistent messages
Are the messages idempotent (can duplicates be tolerated)?
If yes, then you may not need XA transactions
Does sequencing matter?
If no, then you can have multiple receiver instances
Are the transactions complex?
If no, then you can process several messages for each commit and save overhead
How do you handle poison messages?
Either stop processing or use a backout queue |
|
| Back to top |
|
|
| David.Partridge |
| Posted: Mon Jan 14, 2008 1:01 am Post subject: |
|
|
Master
Joined: 28 Jun 2001
Posts: 249
|
20K messages per hour isn't a big deal (unless of course you're talking about humunguously large messages), so a good application design etc won't be crucial in the first instance. Though of course I'm not condoning the use of poor design patterns or implementations.
You problem will likely come when the message volumes grow beyond you initial predictions and the performance goes down the pan.
Crucial here may be whether the processing associated with each message is relatively trivial, or at the other extreme. If the latter and the application messaging design allows you should consider having multiple consumers feeding off the same input queue.
HtH
_________________
Cheers,
David C. Partridge |
|
| Back to top |
|
|
| hp_tvm |
| Posted: Mon Jan 14, 2008 4:27 am Post subject: MQ Performance |
|
|
Newbie
Joined: 11 Jan 2008
Posts: 6
|
Hi - Thanks for the response.
Im an MQ newbie. So I may not be able to explain the problem in great detail.
Here's the scenario:
Our Q would have around 20K messages put on it per hour.
A java pgm has to poll this Q, parse the message in XML format and then insert into appropriate DAO.
Are there any performance enhancing things which can be used in this specific scenaraio - some thing like a list of Do's and donts
Appreciate your help |
|
| Back to top |
|
|
| hp_tvm |
| Posted: Mon Jan 14, 2008 4:29 am Post subject: Typo |
|
|
Newbie
Joined: 11 Jan 2008
Posts: 6
|
I meant calling the approporiate DAO and perform the appropriate insert/update etc
There are 30 tables with an average no of 200 columns per table |
|
| Back to top |
|
|
| Vitor |
| Posted: Mon Jan 14, 2008 4:33 am Post subject: Re: MQ Performance |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| hp_tvm wrote: |
Im an MQ newbie. So I may not be able to explain the problem in great detail...Our Q would have around 20K messages put on it per hour....some thing like a list of Do's and donts
|
It's not an MQ problem per se, it's an interface problem. 20K messages an hour is not a lot (as has been said before) unless the XML document is ridiculously large. You should take the suggestions offered regarding queue tuning and the JMS standard; you should also look to the tuning of the XML parser and especially the database, which is by far the most likely bottleneck in this kind of situation.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
|
|
