| Author |
Message
|
| nits_018 |
 Posted: Sat Jul 06, 2013 1:48 pm Post subject: Uncommitted Message causing messages geting lost |
 |
|
Apprentice
Joined: 24 Oct 2012
Posts: 34
|
Hello,
We have an application which gets around 25 msg per min from a Queue and updates the end system to another flow. Following is the DataFlow:
Queue-> Flow1 -> Pub -> Sub Queue -> Flow2 -> Pub -> Sub Queue 1 & Sub Queue2 -> Flow3 & Flow4
Now i am facing a situation here where if a msg fails on Flow 3 or Flow 4 the Flow1 Queue has a Output Count as 1 on Websphere MQ and if i push any further Msg on Flow1 Queue they somehow get into Uncommitted State and does not gets processed.
Can you clear following points?
1. If the Flow 3 commits msg then that Output Count will not be reflected in The Flow1 Queue. If Yes then what should be done to make sure the Flow 3 & Flow 4 commits msg on failure.
2. What is the impact of transaction Mode on the Commit on msg on MQ. Like if I do a transaction mode as Yes on Flow 3 & Flow 4 Input Queue will that resolve the Problem?
Thanks in Advance.
Regards
Vineet More |
|
| Back to top |
|
 |
| lancelotlinc |
| Posted: Sun Jul 07, 2013 3:55 am Post subject: |
|
|
Jedi Knight
Joined: 22 Mar 2010
Posts: 4941
Location: Bloomington, IL USA
|
Set transaction mode to off on all MQ message flow nodes..
By the way, I don't see any Trace nodes in your flows.
Messages don't get lost. You probably are not handling all the exceptions in your flows.
If you publish a JPEG of your flow, we can point out which terminals you may have not connected.
_________________
http://leanpub.com/IIB_Tips_and_Tricks
Save $20: Coupon Code: MQSERIES_READER |
|
| Back to top |
|
|
| nits_018 |
| Posted: Thu Jul 11, 2013 1:51 am Post subject: |
|
|
Apprentice
Joined: 24 Oct 2012
Posts: 34
|
Hello,
Sry for stating the term messages getting lost. Messages are not getting lost but instead they are getting stuck on the Local Queues.We are using a Alias queue to get messages from local Queue as a Input and Alias Queue to put message to Local. Now when i am pumping around 800 messages at a time some of messages are getting stuck on the Local Queues of the Flow and they are not processed even after waiting for a long time. I also observed that in the Local Queues the IpProcs is 1 and a Dataflow is always associated with it. The topology is something like below:
Source-> Queue(L1) -> Flow1 -> Queue (L2) ->Flow2 -> PUB -> SUB -> Queue(L3)-> Flow3-> PUB -> SUB1 ->Queue(L3) -> Flow4(Databse Update) |
\ /
SUB2 -> Queue(L4) -> Flow5 (SAP RFC Request updates the SAPBW Table)
Now the Messages are getting stuck on Queues L2,L3,L4,L5. On Flow3 we are using a Subflow which inserts into database whenever a new message comes in. When we remove the subflow we do not face any message stuck issue and we also tested the subflow as a standalone msgflow and it does not throw any issue.
We are using broker version as 8.0.0.2
Request you to please help me out as i am stuck in the issue for last 1 week.
Thanks in Advance |
|
| Back to top |
|
|
| lancelotlinc |
| Posted: Thu Jul 11, 2013 3:47 am Post subject: |
|
|
Jedi Knight
Joined: 22 Mar 2010
Posts: 4941
Location: Bloomington, IL USA
|
| nits_018 wrote: |
The topology is something like below:
Source-> Queue(L1) -> Flow1 -> Queue (L2) ->Flow2 -> PUB -> SUB -> Queue(L3)-> Flow3-> PUB -> SUB1 ->Queue(L3) -> Flow4(Databse Update) |
\ /
SUB2 -> Queue(L4) -> Flow5 (SAP RFC Request updates the SAPBW Table)
|
Where are your Trace nodes?
_________________
http://leanpub.com/IIB_Tips_and_Tricks
Save $20: Coupon Code: MQSERIES_READER |
|
| Back to top |
|
|
| nits_018 |
| Posted: Fri Jul 12, 2013 2:11 am Post subject: |
|
|
Apprentice
Joined: 24 Oct 2012
Posts: 34
|
Hello,
We are not using any trace nodes in any of our flow though i have captured the Service trace but that does not say anything related to message stuck error.
I have tried several options and found that whenever i remove a subflow which perform insertion on Database tables(6 of them) none of the messages gets stuck, but as soon as i connect the subflow a randomly behaviour starts popping in sometimes messages gets processed and sometimes they get stuck.
So is there way i can track whether the issue is with Database resource allocation or connection pool of odbc in WMB which might be causing this problem. |
|
| Back to top |
|
|
| lancelotlinc |
| Posted: Fri Jul 12, 2013 3:03 am Post subject: |
|
|
Jedi Knight
Joined: 22 Mar 2010
Posts: 4941
Location: Bloomington, IL USA
|
| nits_018 wrote: |
Hello,
We are not using any trace nodes in any of our flow though i have captured the Service trace but that does not say anything related to message stuck error.
I have tried several options and found that whenever i remove a subflow which perform insertion on Database tables(6 of them) none of the messages gets stuck, but as soon as i connect the subflow a randomly behaviour starts popping in sometimes messages gets processed and sometimes they get stuck.
So is there way i can track whether the issue is with Database resource allocation or connection pool of odbc in WMB which might be causing this problem. |
http://publib.boulder.ibm.com/infocenter/wmbhelp/v8r0m0/index.jsp?topic=%2Fcom.ibm.etools.mft.doc%2Fag66270_.htm
| Quote: |
By adding a Trace node to a message flow, you can write debugging messages to a file, to user trace, or to the system log, and review those messages after the message flow has processed some data.
You must add a Trace node when the message flow is designed. Viewing the logical message tree in trace output explains how to view the structure of the logical message tree at any point in the message flow, and contains an example of the message content. You can turn the Trace node off when a message flow is promoted to production to improve performance, but you can turn the node on when required. |
_________________
http://leanpub.com/IIB_Tips_and_Tricks
Save $20: Coupon Code: MQSERIES_READER |
|
| Back to top |
|
|
| nits_018 |
| Posted: Fri Jul 12, 2013 4:17 am Post subject: |
|
|
Apprentice
Joined: 24 Oct 2012
Posts: 34
|
Hello,
Okay i will try the Trace Node and will get back to you. Thanks |
|
| Back to top |
|
|
| lancelotlinc |
| Posted: Fri Jul 12, 2013 5:12 am Post subject: |
|
|
Jedi Knight
Joined: 22 Mar 2010
Posts: 4941
Location: Bloomington, IL USA
|
| nits_018 wrote: |
Hello,
Okay i will try the Trace Node and will get back to you. Thanks |
| Code: |
Root:
${Root}
===
LocalEnvironment:
${LocalEnvironment}
===
Environment:
${Environment}
===
ExceptionList:
${ExceptionList}
===
${CURRENT_TIMESTAMP}
======================= |
Put a Trace node before and after every major node. Make sure they point to unique files, not the same file.
_________________
http://leanpub.com/IIB_Tips_and_Tricks
Save $20: Coupon Code: MQSERIES_READER |
|
| Back to top |
|
|
|
|
