ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Swap Space and Dataflow Engines

Post new topic  Reply to topic
 Swap Space and Dataflow Engines « View previous topic :: View next topic » 
Author Message
moepi
PostPosted: Fri Aug 08, 2003 2:05 am    Post subject: Swap Space and Dataflow Engines Reply with quote

Novice

Joined: 11 Jul 2001
Posts: 21
Location: South Africa

Hi All,

We are running WMQI 2.1, DB2 7.2 CSD05, MQSeries 5.2 on Solaris 2.8.

We have a problem where the Dataflows engines do not really
release memory.

We get an error that says the system is running out of swap space. I've
been monitoring the system and this has lead me to belief its WQMI that's
causing the problem.

How can we make sure that WMQI(Dataflow engines) releases memory once its
done processing messages ?

Please find below the stats regarding memory usage.


Thanks,
Moepi

load averages: 0.02, 0.05, 0.05 10:15:24
196 processes: 195 sleeping, 1 on cpu
CPU states: 99.2% idle, 0.0% user, 0.8% kernel, 0.0% iowait, 0.0% swap
Memory: 1024M real, 17M free, 617M swap in use, 509M swap free

PID USERNAME THR PRI NICE SIZE RES STATE TIME CPU COMMAND
985 mqadmin 18 58 0 570M 336M sleep 17:29 0.00% DataFlow
951 mqadmin 15 59 0 452M 213M sleep 11:26 0.00% DataFlow
896 mqadmin 12 59 0 167M 47M sleep 0:11 0.00% DataFlow 957 mqadmin 18 59 0 156M 51M sleep 0:15 0.00% DataFlow 954 mqadmin 15 59 0 134M 38M sleep 0:09 0.00% DataFlow 960 mqadmin 12 59 0 131M 37M sleep 0:08 0.00% DataFlow 956 mqadmin 13 59 0 130M 37M sleep 0:07 0.00% DataFlow 976 mqadmin 11 59 0 130M 37M sleep 0:07 0.00% DataFlow 955 mqadmin 9 59 0 129M 36M sleep 0:07 0.00% DataFlow 1015 mqadmin 4 58 0 88M 54M sleep 0:00 0.00% db2sysc
1100 mqadmin 4 58 0 86M 49M sleep 0:01 0.00% db2sysc
878 mqadmin 4 58 0 86M 51M sleep 0:00 0.00% db2sysc
1140 mqadmin 4 34 0 85M 51M sleep 0:00 0.00% db2sysc
1146 mqadmin 4 54 0 85M 48M sleep 0:00 0.00% db2sysc
1018 mqadmin 4 58 0 85M 52M sleep 0:00 0.00% db2sysc
986 mqadmin 4 58 0 85M 51M sleep 0:00 0.00% db2sysc
952 mqadmin 4 58 0 85M 51M sleep 0:00 0.00% db2sysc
965 mqadmin 4 58 0 85M 51M sleep 0:00 0.00% db2sysc
971 mqadmin 4 58 0 85M 51M sleep 0:00 0.00% db2sysc
894 mqadmin 4 58 0 85M 51M sleep 0:00 0.00% db2sysc
962 mqadmin 4 46 0 85M 51M sleep 0:00 0.00% db2sysc
1934 mqadmin 4 54 0 85M 52M sleep 0:00 0.00% db2sysc
1928 mqadmin 4 54 0 85M 52M sleep 0:00 0.00% db2sysc
877 mqadmin 4 58 0 85M 51M sleep 0:00 0.00% db2sysc
1128 mqadmin 4 28 0 85M 51M sleep 0:00 0.00% db2sysc
1268 mqadmin 4 58 0 85M 51M sleep 0:03 0.00% db2sysc
1932 mqadmin 4 58 0 85M 51M sleep 0:00 0.00% db2sysc
1960 mqadmin 4 58 0 85M 51M sleep 0:00 0.00% db2sysc
2852 mqadmin 4 58 0 85M 51M sleep 0:00 0.00% db2sysc
1473 mqadmin 4 58 0 85M 51M sleep 0:00 0.00% db2sysc

swap -l
swapfile dev swaplo blocks free
/dev/dsk/c2t1d0s1 32,609 16 2100704 1041664
/swapfile - 16 204784 0
Back to top
View user's profile Send private message Send e-mail Visit poster's website
DanielG
PostPosted: Fri Aug 08, 2003 4:32 am    Post subject: Reply with quote

Novice

Joined: 29 Mar 2003
Posts: 13

Moepi,

which CSD level is your WMQI running on? There have been several memory related problems that have been fixed in CSD04 / CSD05 (NNSY components).

If you're up to date, pls. describe your situation in a bit more detail: is memory consumption steadily growing over time or is it just rising when processing a single message, what sizes are your messages of, format/parser/message domain, complexity of message flow...
Back to top
View user's profile Send private message
Craig B
PostPosted: Wed Aug 13, 2003 6:54 am    Post subject: Reply with quote

Partisan

Joined: 18 Jun 2003
Posts: 316
Location: UK

Once the operating system allocates memory to your DataFlowEngine process and it has been committed to that process, then the operating system will never reclaim the storage from the process until the process is terminated. What this means is that you will never see the memory usage statistics of your DataFlowEngine process reduce while it is running.

The message flows within your DataFlowEngine will free storage at the end of the processing of your message flow, but this will be freed up on the memory heap, and not back to the operating system.

At some point during your processing, your DataFlowEngine processes storage usage should plateau at the point where its internal memory heap has enough storage to satisfy its message flows without requesting more from the operating system.

Some operating system heap managers may be able to reclaim unused storage from a process during its lifetime, but I believe the Solaris operating system does not do this.
_________________
Regards
Craig
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic  Reply to topic Page 1 of 1

MQSeries.net Forum Index » WebSphere Message Broker (ACE) Support » Swap Space and Dataflow Engines
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.