|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
![Reply to topic](templates/DAJ_Glass/images/lang_english/reply.gif) |
|
Stale connection buildup |
« View previous topic :: View next topic » |
Author |
Message
|
guptasworld |
Posted: Mon Apr 03, 2017 12:14 pm Post subject: Stale connection buildup |
|
|
Newbie
Joined: 03 Apr 2017 Posts: 2
|
Hi All, requesting you suggestions to resolve below issues causing frequent WAS restarts.
In our Core APIs implementation, we have multiple activity services running in WAS v8.5.5.11 and using MQ v7.5 for APIs. These activity services (total 31) uses Spring 4.1 (26) & MDB Framework (5). Each Activity service has own QCF.
We are observing that number of connections in MQ keep on increasing over a period of time of 2 to 3 days and WAS is not able to make any new connections with MQ QMgr once the total number of connections crosses max limit 2048.
Once the max connection reaches, it forces the WAS to restart. Post WAS restart, connections are reset however connection counts (CHSTATUS = NONE) keep on increasing slowly and not coming down once load it reduced during non business hours or weekend.
Another observation is, once the WAS is restarted, exactly after 24 hours, we find unusual increase in stale connection buildup which doesn’t come down as we mentioned earlier.
As per the analysis, we can see that there are 3 types of objects opened by the connections:
After Server Restart:
Total Number of channel instances: 36
Total shared conversations: 194
Unique CONNs: 194
Objects opened by CONNs:
129 ""
1 "QMGR"
66 "QUEUE
after 3 days of continuous running:
Total Number of channel instances: 107
Total shared conversations: 414
Unique CONNs: 413
Objects opened by CONNs:
112 ""
241 "QMGR"
60 "QUEUE"
"" and "QUEUE" object type connections remain almost same over period of time but "QMGR" type connections keep on increasing and it seems they are closed only after a server restart.
JMS Configuration:
Transport – Bindings, then Client
Connection Pool:
• Connection timeout : 120
• Maximum connections : 10
• Minimum connections : 1
• Reap time : 180
• Unused timeout : 600
• Aged timeout : 0
Session Pool:
• Connection timeout : 90
• Maximum connections : 10
• Minimum connections : 1
• Reap time : 150
• Unused timeout : 480
• Aged timeout : 0
Other settings:
• Polling Interval 5000 Milli Seconds
• Rescan Interval 5000 Milli Seconds
Can you help in understanding why these "QMGR" type connections are getting created and if they are required how can we ensure they are closed regularly?
Have you faced similar issues and observations & can help us resolve?
Thanks!! |
|
Back to top |
|
![](templates/DAJ_Glass/images/spacer.gif) |
fjb_saper |
Posted: Mon Apr 03, 2017 5:48 pm Post subject: |
|
|
![](images/avatars/gallery/misc/2.gif) Grand High Poobah
Joined: 18 Nov 2003 Posts: 20696 Location: LI,NY
|
check the net for the leak of the ConnectionFactory... seems to me that would fit the case. There was an APAR about it, just can't remember when...
On the other hand check the purge and timeout policies for your JMS Connection pool.
Have fun ![](images/smiles/innocent.gif) _________________ MQ & Broker admin |
|
Back to top |
|
![](templates/DAJ_Glass/images/spacer.gif) |
guptasworld |
Posted: Tue Apr 04, 2017 3:11 am Post subject: |
|
|
Newbie
Joined: 03 Apr 2017 Posts: 2
|
Thanks @fjb_saper.
Most of the issues are with activity services using Spring 4.1.2. We don't find any issues so far with connection params (posted in original Q) and still struggling to find root cause and fix.
We have requested SysAdmin to capture the net stats and other diagnosis. |
|
Back to top |
|
![](templates/DAJ_Glass/images/spacer.gif) |
fjb_saper |
Posted: Tue Apr 04, 2017 7:29 pm Post subject: |
|
|
![](images/avatars/gallery/misc/2.gif) Grand High Poobah
Joined: 18 Nov 2003 Posts: 20696 Location: LI,NY
|
guptasworld wrote: |
Thanks @fjb_saper.
Most of the issues are with activity services using Spring 4.1.2. We don't find any issues so far with connection params (posted in original Q) and still struggling to find root cause and fix.
We have requested SysAdmin to capture the net stats and other diagnosis. |
Check for a ConnectionFactory leak... ![](images/smiles/innocent.gif) _________________ MQ & Broker admin |
|
Back to top |
|
![](templates/DAJ_Glass/images/spacer.gif) |
|
|
![Reply to topic](templates/DAJ_Glass/images/lang_english/reply.gif) |
|
Page 1 of 1 |
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
|
|
|