ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum IndexIBM MQ Java / JMSStale connection buildup

Post new topicReply to topic
Stale connection buildup View previous topic :: View next topic
Author Message
guptasworld
PostPosted: Mon Apr 03, 2017 12:14 pm Post subject: Stale connection buildup Reply with quote

Newbie

Joined: 03 Apr 2017
Posts: 2

Hi All, requesting you suggestions to resolve below issues causing frequent WAS restarts.

In our Core APIs implementation, we have multiple activity services running in WAS v8.5.5.11 and using MQ v7.5 for APIs. These activity services (total 31) uses Spring 4.1 (26) & MDB Framework (5). Each Activity service has own QCF.
We are observing that number of connections in MQ keep on increasing over a period of time of 2 to 3 days and WAS is not able to make any new connections with MQ QMgr once the total number of connections crosses max limit 2048.
Once the max connection reaches, it forces the WAS to restart. Post WAS restart, connections are reset however connection counts (CHSTATUS = NONE) keep on increasing slowly and not coming down once load it reduced during non business hours or weekend.

Another observation is, once the WAS is restarted, exactly after 24 hours, we find unusual increase in stale connection buildup which doesnt come down as we mentioned earlier.

As per the analysis, we can see that there are 3 types of objects opened by the connections:

After Server Restart:

Total Number of channel instances: 36
Total shared conversations: 194
Unique CONNs: 194
Objects opened by CONNs:
129 ""
1 "QMGR"
66 "QUEUE

after 3 days of continuous running:

Total Number of channel instances: 107
Total shared conversations: 414
Unique CONNs: 413
Objects opened by CONNs:
112 ""
241 "QMGR"
60 "QUEUE"

"" and "QUEUE" object type connections remain almost same over period of time but "QMGR" type connections keep on increasing and it seems they are closed only after a server restart.

JMS Configuration:
Transport Bindings, then Client
Connection Pool:
Connection timeout : 120
Maximum connections : 10
Minimum connections : 1
Reap time : 180
Unused timeout : 600
Aged timeout : 0
Session Pool:
Connection timeout : 90
Maximum connections : 10
Minimum connections : 1
Reap time : 150
Unused timeout : 480
Aged timeout : 0
Other settings:
Polling Interval 5000 Milli Seconds
Rescan Interval 5000 Milli Seconds

Can you help in understanding why these "QMGR" type connections are getting created and if they are required how can we ensure they are closed regularly?
Have you faced similar issues and observations & can help us resolve?

Thanks!!
Back to top
View user's profile Send private message
fjb_saper
PostPosted: Mon Apr 03, 2017 5:48 pm Post subject: Reply with quote

Grand Poobah

Joined: 18 Nov 2003
Posts: 19432
Location: LI,NY

check the net for the leak of the ConnectionFactory... seems to me that would fit the case. There was an APAR about it, just can't remember when...

On the other hand check the purge and timeout policies for your JMS Connection pool.

Have fun
_________________
MQ & Broker admin
Back to top
View user's profile Send private message Send e-mail
guptasworld
PostPosted: Tue Apr 04, 2017 3:11 am Post subject: Reply with quote

Newbie

Joined: 03 Apr 2017
Posts: 2

Thanks @fjb_saper.
Most of the issues are with activity services using Spring 4.1.2. We don't find any issues so far with connection params (posted in original Q) and still struggling to find root cause and fix.
We have requested SysAdmin to capture the net stats and other diagnosis.
Back to top
View user's profile Send private message
fjb_saper
PostPosted: Tue Apr 04, 2017 7:29 pm Post subject: Reply with quote

Grand Poobah

Joined: 18 Nov 2003
Posts: 19432
Location: LI,NY

guptasworld wrote:
Thanks @fjb_saper.
Most of the issues are with activity services using Spring 4.1.2. We don't find any issues so far with connection params (posted in original Q) and still struggling to find root cause and fix.
We have requested SysAdmin to capture the net stats and other diagnosis.

Check for a ConnectionFactory leak...
_________________
MQ & Broker admin
Back to top
View user's profile Send private message Send e-mail
Display posts from previous:
Post new topicReply to topic Page 1 of 1

MQSeries.net Forum IndexIBM MQ Java / JMSStale connection buildup
Jump to:



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP


Theme by Dustin Baccetti
Powered by phpBB 2001, 2002 phpBB Group

Copyright MQSeries.net. All rights reserved.