| Author |
Message
|
| ANILK |
 Posted: Sun Nov 08, 2015 9:24 pm Post subject: Reducing Memmory Utilization |
 |
|
Acolyte
Joined: 01 May 2014
Posts: 61
|
Hi Friends,
We are running WMB 8.0.0.4 on AIX , currently our AIX admin complained that the Memory utilization is very high and we need to optimize the code.
Currently we are using Single broker Global cache service .
will this impact the Memory utilization heavily? , we are using Global cache only to store a running number , and this number will be used as a unique transaction id and accessed by 6 EG's.
Now we are planing to use sequence node to replace the Global cache service.
1) If we stopped Global cache service , will it show big change in Memory utilization ?
2) is there any known issues for sequence node ?
your suggestion and advises always welcomed
Thanks
[/b] |
|
| Back to top |
|
 |
| smdavies99 |
| Posted: Sun Nov 08, 2015 10:40 pm Post subject: |
|
|
Jedi Council
Joined: 10 Feb 2003
Posts: 6076
Location: Somewhere over the Rainbow this side of Never-never land.
|
Of course remving the Global Cache will save memory. All that lovely Java won't be used to access the data.
Sigh.
Perhaps you should go back to your Sysadmin and ask what is using all the memory.
Then ask him if the applications/services you are providing with this system are charged on how much RAM they use.
If the answer is no and there is RAM free then a polite answer would be 'On Yer Bike'.
If you are running on a severly RAM limited LPAR then some investigation might reveal some issues but apart from juge Java Heaps the modern broker is pretty memory efficient.
YMMV though.
_________________
WMQ User since 1999
MQSI/WBI/WMB/'Thingy' User since 2002
Linux user since 1995
Every time you reinvent the wheel the more square it gets (anon). If in doubt think and investigate before you ask silly questions. |
|
| Back to top |
|
|
| ANILK |
| Posted: Sun Nov 08, 2015 11:14 pm Post subject: |
|
|
Acolyte
Joined: 01 May 2014
Posts: 61
|
| smdavies99 wrote: |
Of course remving the Global Cache will save memory. All that lovely Java won't be used to access the data.
Sigh.
Perhaps you should go back to your Sysadmin and ask what is using all the memory.
Then ask him if the applications/services you are providing with this system are charged on how much RAM they use.
If the answer is no and there is RAM free then a polite answer would be 'On Yer Bike'.
If you are running on a severly RAM limited LPAR then some investigation might reveal some issues but apart from juge Java Heaps the modern broker is pretty memory efficient.
YMMV though. |
Thank you smdavies for your valuable advice .
Current system info
----------------------------
TOTAL RAM = 48 GB
Total EG's Running = 38
Total EG's Accessing Global cache code = 8
OS = AIX 7.1
NMON Result
-------------------
Used Memmory - 100%
Used CPU - 22 %
Used Page Space - 1%
1) based on the NMON, is system running out of memory ?
2) Every time NMON shows 100 % usage of memory , is there any way to find out active and inactive memory ?
Thanks |
|
| Back to top |
|
|
| zpat |
| Posted: Mon Nov 09, 2015 1:55 am Post subject: |
|
|
Jedi Council
Joined: 19 May 2001
Posts: 5849
Location: UK
|
First of all - it is not necessarily a bad thing to use all the memory.
All operating systems initially load objects into real memory, and then they can get paged or swapped out, if the real memory becomes contended (i.e. something else wants it).
The question is whether the paging or swapping rate is high.
Since the swap space is 1% used - doesn't seem like an issue.
However on purely a "finger in the air" basis - I would suggest having at least 64 GB.
_________________
Well, I don't think there is any question about it. It can only be attributable to human error. This sort of thing has cropped up before, and it has always been due to human error. |
|
| Back to top |
|
|
| ANILK |
| Posted: Sat Nov 21, 2015 3:17 am Post subject: |
|
|
Acolyte
Joined: 01 May 2014
Posts: 61
|
Thank you zpat for the quick response.
in the current environment, Broker is running on AIX machine .
when i use NMON comand to get the top process ,
i could see some of the dataflow engine is taking more than 40 % CPU.
and totally all dataflow engine together it shows more than 130 %.
i am not sure whether it shows actual CPU utilization or .. ?
Nmon Report Top process result
PID %CPU
-------------------------
x26476792 37.8
x 4391166 36.8
x24838260 35.2
x10485852 14.5
x21823524 13.9
x15138986 11.3
x18677910 10.1
-------------------------
When i use TOPAS comand it shows only 18 % CPU utilization
which one should i trust NMON or TOPAS ?
Kindly share your valuable advice
Anil
 |
|
| Back to top |
|
|
| smdavies99 |
| Posted: Sat Nov 21, 2015 5:12 am Post subject: |
|
|
Jedi Council
Joined: 10 Feb 2003
Posts: 6076
Location: Somewhere over the Rainbow this side of Never-never land.
|
How many CPU's is your System using?
Perhaps that accounts for cpu utilisation totals to be more than 100%
Why not ask your SysAdmins about the relative merits of the two commands?
That would be part of their job IMHO.
_________________
WMQ User since 1999
MQSI/WBI/WMB/'Thingy' User since 2002
Linux user since 1995
Every time you reinvent the wheel the more square it gets (anon). If in doubt think and investigate before you ask silly questions. |
|
| Back to top |
|
|
| ANILK |
| Posted: Sun Nov 22, 2015 2:39 am Post subject: |
|
|
Acolyte
Joined: 01 May 2014
Posts: 61
|
| smdavies99 wrote: |
How many CPU's is your System using?
Perhaps that accounts for cpu utilisation totals to be more than 100%
Why not ask your SysAdmins about the relative merits of the two commands?
That would be part of their job IMHO. |
Thank you smdavies
this command "prtconf | more" shows
System Model: IBM,8233-E8B
Processor Type: PowerPC_POWER7
Processor Implementation Mode: POWER 7
Processor Version: PV_7_Compat
Number Of Processors: 6
Processor Clock Speed: 3612 MHz
CPU Type: 64-bit
Kernel Type: 64-bit
Memory Size: 49152 MB
Good Memory Size: 49152 MB
Platform Firmware level: AL730_099
Auto Restart: true
Full Core: false
------------------------------------------
NMON Comand shows
24 - CPUs currently
24 - CPUs configured
3612 - MHz CPU clock rate
PowerPC_POWER7 - Processor
64 bit - Hardware
64 bit - Kernel
------------------------------------
Our System admin team is not cooperative ,
Kindly provide your valuable suggestions
Anil |
|
| Back to top |
|
|
| PeterPotkay |
| Posted: Sun Nov 22, 2015 12:02 pm Post subject: |
|
|
Poobah
Joined: 15 May 2001
Posts: 7717
|
|
| Back to top |
|
|
| fjb_saper |
| Posted: Sun Nov 22, 2015 12:21 pm Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20696
Location: LI,NY
|
Instead of using the sequence number for the transaction identifier, try using the broker function for generating a UID. It should be unique.
Or use a db function for a sequence number... but make sure it's access is serialized (select for update, update)
Have fun 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| ANILK |
| Posted: Sun Nov 22, 2015 5:59 pm Post subject: |
|
|
Acolyte
Joined: 01 May 2014
Posts: 61
|
| fjb_saper wrote: |
Instead of using the sequence number for the transaction identifier, try using the broker function for generating a UID. It should be unique.
Or use a db function for a sequence number... but make sure it's access is serialized (select for update, update)
Have fun |
Thank you fjb_saper ,
1) Can you elaborate "serialized (select for update, update)" .
a) You mean when we run a select sql qry to get a Unique number, DB needs to return "1" for first qry.
b) for second time if we run the select qry DB need to return "2", is it so ?
--------------
2) Regarding the NMON & TOPAS command output difference which i mentioned in my POST , can you give me any advice ?
Thanks
Anil |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Sun Nov 22, 2015 9:32 pm Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20696
Location: LI,NY
|
| ANILK wrote: |
| fjb_saper wrote: |
Instead of using the sequence number for the transaction identifier, try using the broker function for generating a UID. It should be unique.
Or use a db function for a sequence number... but make sure it's access is serialized (select for update, update)
Have fun |
Thank you fjb_saper ,
1) Can you elaborate "serialized (select for update, update)" .
a) You mean when we run a select sql qry to get a Unique number, DB needs to return "1" for first qry.
b) for second time if we run the select qry DB need to return "2", is it so ?
--------------
2) Regarding the NMON & TOPAS command output difference which i mentioned in my POST , can you give me any advice ?
Thanks
Anil |
Talk to your friendly Unix/Linux admin...
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| smdavies99 |
| Posted: Sun Nov 22, 2015 10:41 pm Post subject: |
|
|
Jedi Council
Joined: 10 Feb 2003
Posts: 6076
Location: Somewhere over the Rainbow this side of Never-never land.
|
| fjb_saper wrote: |
Talk to your friendly Unix/Linux admin... |
Sadly the OP has indicated that they won't help.
If I were him, I'd go to the next level up the PHB chain and get the Admins to help. This is their job and you are not being paid to do it.
But there again, I'm an awkward old  close to retirement so YMMV (probably).
_________________
WMQ User since 1999
MQSI/WBI/WMB/'Thingy' User since 2002
Linux user since 1995
Every time you reinvent the wheel the more square it gets (anon). If in doubt think and investigate before you ask silly questions. |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Sun Nov 22, 2015 11:36 pm Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20696
Location: LI,NY
|
|
| Back to top |
|
|
|
|
