| Author |
Message
|
| sysmq012 |
 Posted: Wed Sep 05, 2007 10:53 pm Post subject: Performance issues using mqclients |
 |
|
Newbie
Joined: 11 Feb 2007
Posts: 9
|
Hi all,
I have a system that has to support high throughput of messages.
the application is sending messages to a queue manager through a client connection.
with several instances of the writing application I reach about 1000 messages per second, adding more processes or threads doesn't improve the over all throughput.
when adding more client machines each machine reaches about the same rate of messages.
it appears that the bottle neck is the client machine, but I didn't notice that the resource consumption (CPU, Memory, network) was reaching critical levels.
any other suggestions of a possible bottle neck?
Ophir |
|
| Back to top |
|
 |
| zpat |
| Posted: Wed Sep 05, 2007 11:22 pm Post subject: |
|
|
Jedi Council
Joined: 19 May 2001
Posts: 5866
Location: UK
|
| How many concurrent client connections are being used? If only one then you are not going to have massive scalability. Is the connection (and the queue) being kept open between MQPUTs? |
|
| Back to top |
|
|
| sysmq012 |
| Posted: Wed Sep 05, 2007 11:53 pm Post subject: |
|
|
Newbie
Joined: 11 Feb 2007
Posts: 9
|
We have about 10 concurrent connections.
We found out that adding more (from the same client machine) doesn't improve throughput.
the connection and queue are kept open between put's
Ophir |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Thu Sep 06, 2007 12:30 am Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
Are you running into issues processing work on the server side - where most of the work of the client is actually performed?
Are you running into issues due to log file constraints on the server side?
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| sysmq012 |
| Posted: Thu Sep 06, 2007 12:40 am Post subject: |
|
|
Newbie
Joined: 11 Feb 2007
Posts: 9
|
No,
If we add another client machine each will get the 1000 messages per second throughput when running concurrently - so I assume the bottleneck is in the client machine.
The messages are non persistent, so logs should be relevant.
Ophir |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Thu Sep 06, 2007 2:10 am Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
Are you putting messages all to the same queue, or different queues?
Are you seeing the correct number of listener processes, for the number of connections you have?
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Thu Sep 06, 2007 2:47 am Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
Does using different channels from the same box allow you channel * 1000 messages per second? 
What is the IO load of the client box? How far are you from 100%?
What is the bandwidth utilization of the client box ?
How many boxes on the same switch / bandwidth ?
_________________
MQ & Broker admin |
|
| Back to top |
|
|
|
|
