| Author |
Message
|
| elvis_gn |
 Posted: Mon Oct 01, 2007 5:35 am Post subject: Pub/Sub BIP7032I incorrect sequence number |
 |
|
Padawan
Joined: 08 Oct 2004
Posts: 1905
Location: Dubai
|
Hi guys,
MB Runtime 6.0.0.3
We are facing a scenario where we create a bulk of Subscription messages on the SYSTEM.BROKER.CONTROL.QUEUE using MB.
We find that around 8-10 messages are successfully picked by the Broker and processed successfully with responses on the replyTo queue.
But the rest lie on the SYSTEM.BROKER.CONTROL.QUEUE with the broker log showing the below error
| Quote: |
deehqap030eagx6 user:info WebSphere Broker v6003[434220]: (WMBE01.IN461355)[5912]BIP7032I: Publish/Subscribe state recovery started due to incorrect sequence number. : WMBE01.d43e73d3-1301-0000-0080-f83dc391c627: /build/S600_P/src/DataFlowEngine/JavaNodeLibrary/ImbPubSubControlNode.cpp: 1507: ImbPubSubControlNode::sequenceNumberRecovery: ComIbmPSControlNode: ControlNode
Oct 1 12:24:35 deehqap030eagx6 user:info WebSphere Broker v6003[1695844]: (WMBE01.IN771611)[5912]BIP7033I: Publish/Subscribe state recovery completed. : WMBE01.ce0d74d3-1301-0000-0080-f83dc391c627: /build/S600_P/src/DataFlowEngine/JavaNodeLibrary/ImbPubSubControlNode.cpp: 1547: ImbPubSubControlNode::sequenceNumberRecovery: ComIbmPSControlNode: ControlNode |
The broker hangs and the only way to make things work is a restart...Even purging the whole queue and putting more msgs does not work.
Has anyone faced this issue ? My current assumption is that the broker is not able to maintain transactions with its internal tables when so many messages are arriving so quickly.
Note: The message is perfectly fine as i'm looping it, so if it worked 8 times, it should always work 
Regards. |
|
| Back to top |
|
 |
| jefflowrey |
| Posted: Mon Oct 01, 2007 11:24 am Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
I'd say you are doing something wrong in your bulk creation of subscription messages.
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| dilse |
| Posted: Mon Oct 01, 2007 11:40 am Post subject: |
|
|
Master
Joined: 24 Jun 2004
Posts: 270
|
| Do you see any error messages in replyTo Queue? If not, it could be a memory issue. |
|
| Back to top |
|
|
| elvis_gn |
| Posted: Mon Oct 01, 2007 11:48 am Post subject: |
|
|
Padawan
Joined: 08 Oct 2004
Posts: 1905
Location: Dubai
|
Hi jefflowrey,
| jefflowrey wrote: |
| I'd say you are doing something wrong in your bulk creation of subscription messages. |
The message creation(for the CONTROL.QUEUE) is done by a Message Broker flow, and I'm running the same input through the flow, so if the message output structure is wrong, not a single output should be processed by the broker right ? I shouldn't be getting 8 perfectly good responses from the Broker....
@ dilse:
No errors on the replyToQ, no reason codes raised and no msgs on DLQ....8 beautiful responses 
Not even a memory problem as I had a look at the memory usage for the execution groups....perfectly fine, but the CONTROL msgs are not picked further and broker restart is the ONLY option...
I think we might just raise this as a PMR, but before that I wanted to know if there were any related fixes or known bugs...
Regards. |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Mon Oct 01, 2007 11:51 am Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
Any MQ errors?
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| dilse |
| Posted: Mon Oct 01, 2007 1:50 pm Post subject: |
|
|
Master
Joined: 24 Jun 2004
Posts: 270
|
I am not sure if you tried this already but do the following :
1. unload the messages from BROKER.CONTROL.QUEUE into a files or move them into a different queue.
2. Restart the broker.
3. Try putting the same messages back into the CONTROL queue( either from file or from a queue) in the same order to see if they get processed.
4. If they are still not getting processed, remove the first message by an MQGET and see if it works.
This procedure may not solve your problem but helps in debugging the issue. Let us know what is the behaviour with the above procedure. Also check all the logs to see if can you find anything else. And why are you inserting the same message each time? Just curious |
|
| Back to top |
|
|
| elvis_gn |
| Posted: Tue Oct 02, 2007 8:54 pm Post subject: |
|
|
Padawan
Joined: 08 Oct 2004
Posts: 1905
Location: Dubai
|
Hi guys,
| jefflowrey wrote: |
| Any MQ errors? |
Had a look at them today morning, cannot find anything related...looks fine.
| dilse wrote: |
1. unload the messages from BROKER.CONTROL.QUEUE into a files or move them into a different queue.
2. Restart the broker.
3. Try putting the same messages back into the CONTROL queue( either from file or from a queue) in the same order to see if they get processed.
4. If they are still not getting processed, remove the first message by an MQGET and see if it works. |
I'll try this and let you know, though I did try the MQGET when things failed, and it did not help.
| dilse wrote: |
| And why are you inserting the same message each time? Just curious |
We found this issue on the test environment, on re-runs of the msgs stuck on the queue, we found that the msgs are ok and pass through, thats when we decided to do this load test with just 1 msg
Regards. |
|
| Back to top |
|
|
|
|
