| |
|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
| Contention on queue ? |
« View previous topic :: View next topic » |
| Author |
Message
|
| JuulV |
 Posted: Sun Oct 21, 2007 4:18 am Post subject: |
 |
|
Apprentice
Joined: 05 Sep 2007
Posts: 28
Location: Belgium
|
Hi,
There was never an answer to the question: "Why 2000 connections?"
I don't think you'll ever be able to get a reliable, stable and performing environment with 2000 concurrent processes or threads on Windows. Even if the vast majority of them are waiting, you'll suffer from severe problems at the Windows level, because the Operating System has to look after too many things (mainly object handles, but also memory management and dispatching will be a nightmare)...
So, I would first look at a way to reduce the number of concurrent Server processes SIGNIFICANTY (with a factor 10 - 100!!!).
And only then I would start worrying about the overhead of WMQ Calls; and yes, the cost of MQCONN(X) and MQDISC calls is hughe, and the cost of MQOPEN/MQCLOSE is significant, so you should certainly consider to limit these calls...
_________________
Juul Vanparijs
Senior Developer
Cressida Technology Ltd |
|
| Back to top |
|
 |
| mattb |
| Posted: Mon Oct 22, 2007 6:07 am Post subject: |
|
|
Newbie
Joined: 15 Oct 2007
Posts: 8
|
Thanks to everyone for their comments and advice. Particularly Vitor for pointing out our misuse of MessageId.
Our next version will use priority queues and will not use MessageId when doing MQGETs. In the interim period we are trying to make the legacy system as reliable/performant as possible before we can get the next version into production.
To answer some of your questions:
- The 2000 open input connections are from ~400 physical servers which pull jobs from the request queue. (We don't have 1 server opening 2000 connections to the same queue). Typically each server will be busy calculating for 3-15 minutes between GET calls.
- There are usually 1..20 clients posting requests (as fast as they can).
- The request depth varies enormously - typically peaking at < 30,000, sometimes peaking at 80,000.
Thanks again
Matt |
|
| Back to top |
|
|
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
