| |
|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
  |
|
| Issue with EG |
« View previous topic :: View next topic » |
| Author |
Message
|
| sarathmattam |
 Posted: Wed Feb 24, 2010 12:21 am Post subject: Issue with EG |
 |
|
Voyager
Joined: 05 Sep 2008
Posts: 94
|
Dear All,
I am working with Solaris environment, MB 6.1 & MQ 6.0.
I am facing a weird issue with my EGs. I have one interfaces which basically has two flows. One flow reads the message from a Q and write it in to a file. The second flow will be listening to the output directory of the first. It will pick the files and insert in to a remote DB.
Here the issue am facing is, the processing becomes slower after say one month of deployment. Messages will start accumulating in the Q and it goes on increasing. But any point of time flow is not stopped. It continously processes the messages, but very slow. I have tried restart of the message flow and redeployment of the barfile , reload of EG etc. But nothing helps. No errors are reported any where in my logs & system logs.
Then i removed the message flows from the previous EG & redeployed the same barfile in another EG in the same broker. To my surprise the flow started processing normally.Similar to as it was when i deployed it first time... I was not able to find out the root cause of this problem.
Did any one face this issue before? Kindly advice
Regards,
Sarath KS |
|
| Back to top |
|
 |
| fjb_saper |
| Posted: Wed Feb 24, 2010 1:38 am Post subject: Re: Issue with EG |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
| sarathmattam wrote: |
Dear All,
I am working with Solaris environment, MB 6.1 & MQ 6.0.
I am facing a weird issue with my EGs. I have one interfaces which basically has two flows. One flow reads the message from a Q and write it in to a file. The second flow will be listening to the output directory of the first. It will pick the files and insert in to a remote DB.
Here the issue am facing is, the processing becomes slower after say one month of deployment. Messages will start accumulating in the Q and it goes on increasing. But any point of time flow is not stopped. It continously processes the messages, but very slow. I have tried restart of the message flow and redeployment of the barfile , reload of EG etc. But nothing helps. No errors are reported any where in my logs & system logs.
Then i removed the message flows from the previous EG & redeployed the same barfile in another EG in the same broker. To my surprise the flow started processing normally.Similar to as it was when i deployed it first time... I was not able to find out the root cause of this problem.
Did any one face this issue before? Kindly advice
Regards,
Sarath KS |
The first advice I would be giving you is that you have a design that can be improved upon.
Get rid of the file system as middle man. Have the first flow put the messages into a queue. Have the second flow pickup the messages from the queue and put them to the DB.
Have fun 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| Vitor |
| Posted: Wed Feb 24, 2010 6:02 am Post subject: Re: Issue with EG |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| fjb_saper wrote: |
The first advice I would be giving you is that you have a design that can be improved upon.
Get rid of the file system as middle man. |
It sounds a lot like file system fragmentation. Without knowing exactly where the slow response is/was, it's hard to be certain.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| zpat |
| Posted: Wed Feb 24, 2010 7:30 am Post subject: |
|
|
Jedi Council
Joined: 19 May 2001
Posts: 5866
Location: UK
|
Messages and databases are transactionally safe. Files are not.
Do not use files for transactionally safe integration, especially when you don't have to. Think messages, not files.
Files get corrupted with multi-write, files can be processed (read) more than once. Files can be processed in the wrong sequence. I could go on, but IBM did not invent MQ for it's own amusement. |
|
| Back to top |
|
|
| sarathmattam |
| Posted: Sun Feb 28, 2010 2:07 am Post subject: |
|
|
Voyager
Joined: 05 Sep 2008
Posts: 94
|
Guys,
Thanks for your suggestions .. But actually at this stage i can not change the design ... What i am interested is the issue around EG..
The same flows works fine if you deploy it in another EG ..
Regards,
Sarath |
|
| Back to top |
|
|
| Vitor |
| Posted: Sun Feb 28, 2010 3:11 pm Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| sarathmattam wrote: |
What i am interested is the issue around EG..
The same flows works fine if you deploy it in another EG ..
|
This implies something bad is happening with file handles and the EG threads. If I had to guess, I'd say file handles are accumulating for some reason until Solaris and/or the EGs chokes trying to handle them. Remember both EGs will be trying to get handles on the directory/files, one to read, one to write.
A PMR may be of use, but aside from that (and in the short term) you may just have to live with as another reason your design is non-optimal.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
|
|
|
| |
|
Page 1 of 1 |
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
