| Author |
Message
|
| Kireeti84 |
 Posted: Wed Jul 27, 2016 11:48 am Post subject: Broker issue |
 |
|
Apprentice
Joined: 18 Oct 2013
Posts: 40
|
I need your ideas to resolve one of the issue that we are working. We have two brokers ( 1 and 2 ). Broker 2 always process the messages pretty fast than the broker 1.Our admin team confirmed the configuration like the CPU, memory is the same for both brokers. I also opened a PMR with IBM. Please help me with your ideas where to go and what to look to identify the problem.
Thanks for the help..!
FYI - All the flows having issue in broker 2 are queue based. |
|
| Back to top |
|
 |
| Vitor |
| Posted: Wed Jul 27, 2016 12:05 pm Post subject: Re: Broker issue |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| Kireeti84 wrote: |
| Broker 2 always process the messages pretty fast than the broker 1. |
What, according to the accounting stats, is the difference in throughput?
What, according to the resource stats, is the difference in resource usage (given that you've established the actual resources available are the same)
Where, according to the resource stats, is the extra time going on the "slow" broker? What node(s) take longer on one side than the other?
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| Vitor |
| Posted: Wed Jul 27, 2016 12:07 pm Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
I'm assuming that both brokers have the same number of flows deployed.
For example, if broker 1 runs a lot of flows that have nothing to do with this situation and broker 2 only runs the flows in question here then I've found your problem......
....but I'm guessing you've thought of that.
You might also want to check both machines are running the same non-broker software stack and broker 1 isn't fighting for resources with (say) a WAS server
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| Kireeti84 |
| Posted: Wed Jul 27, 2016 12:32 pm Post subject: |
|
|
Apprentice
Joined: 18 Oct 2013
Posts: 40
|
Yes Vitor. we have same no of flows deployed in both the brokers. OS and CPU teams confirmed no issues there.
What kind of logs i should capture for IBM ? Any other place i can go look ? please suggest. |
|
| Back to top |
|
|
| Kireeti84 |
| Posted: Wed Jul 27, 2016 12:34 pm Post subject: |
|
|
Apprentice
Joined: 18 Oct 2013
Posts: 40
|
| Since it is load balanced we are getting same no of messages to both the brokers. Applications OR flows running in broker 1 process the messages just fine but the applications running under broker 2 has about 50 min delay. |
|
| Back to top |
|
|
| JosephGramig |
| Posted: Wed Jul 27, 2016 1:00 pm Post subject: |
|
|
Grand Master
Joined: 09 Feb 2006
Posts: 1244
Location: Gold Coast of Florida, USA
|
You need to turn on Broker Accounting and Statistics and capture that information. You will need to read about how to turn it on and emit the data as XML.
Then you can use MB Explorer to view real time data or you can subscribe to the Broker Accounting and Statics to capture that to a queue. You will need someting that reads that queue and stores that information somewhere (file or DB). Then you want to export the data of interest to an CSV file for the time period you are interested in. You need to do this for the Good and Poor performing brokers to compare. Using Excel, build a pivot table and use time for the X axis, max of max processing time as left axis, volume (max of max msgs per snapshot) as right axis.
That will lead you in one direction or another and change what you are looking at base on the results.
BTW, the post belongs in the IIB/WMB topic.
Simple, no? |
|
| Back to top |
|
|
| Vitor |
| Posted: Thu Jul 28, 2016 4:23 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| Kireeti84 wrote: |
| What kind of logs i should capture for IBM ? |
No. But I bet they'll ask the same questions I did.
| Kireeti84 wrote: |
| Any other place i can go look ? |
In the broker statistics as I indicated in my previous post. Answer those 3 questions and you'll be halfway to finding your problem.
| Kireeti84 wrote: |
| please suggest. |
I did. What more were you expecting? 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
|
|
