| Author |
Message
|
| Lisa |
 Posted: Wed Jun 25, 2003 9:58 am Post subject: Missing Records? |
 |
|
Master
Joined: 07 Jun 2002
Posts: 287
Location: NJ
|
Hi All,
Today in our production enviroment, our audit Put and Get records do not add. We have a mainframe process that put 73612 messages to WMQI queue. WMQI only logged 73573, a difference of 39 messages.
Our Environment is:
4 HP-UX servers using MQSeries Clustering.
WMQI 2.1, CSD04 and MQSeries 5.21 CSD06
Has anyone experience lost of messages during large batch processing?
There are no errors in the HP syslogs or in the application dead letter or system dead letter queues.
Thanks, |
|
| Back to top |
|
 |
| kirani |
| Posted: Wed Jun 25, 2003 10:06 am Post subject: |
|
|
Jedi Knight
Joined: 05 Sep 2001
Posts: 3779
Location: Torrance, CA, USA
|
Could those be the Expired messages? How are you getting the number of messages received/sent?
_________________
Kiran
IBM Cert. Solution Designer & System Administrator - WBIMB V5
IBM Cert. Solutions Expert - WMQI
IBM Cert. Specialist - WMQI, MQSeries
IBM Cert. Developer - MQSeries
|
|
| Back to top |
|
|
| EddieA |
| Posted: Wed Jun 25, 2003 10:56 am Post subject: |
|
|
Jedi
Joined: 28 Jun 2001
Posts: 2453
Location: Los Angeles
|
Are the missing messages failing (somehow) in WMQI and going to a Failure queue or the DLQ.
Cheers,
_________________
Eddie Atherton
IBM Certified Solution Developer - WebSphere Message Broker V6.1
IBM Certified Solution Developer - WebSphere Message Broker V7.0 |
|
| Back to top |
|
|
| Lisa |
| Posted: Wed Jun 25, 2003 11:58 am Post subject: Missing Messages |
|
|
Master
Joined: 07 Jun 2002
Posts: 287
Location: NJ
|
Hi,
Expiry is set to -1 for unlimited. The messages are not being sent to the dead letter queue or application dead letter queue.
Everything is defined as persistent (message, xmitq, local queue).
It appears that the messages are just disappearing.
Thanks, |
|
| Back to top |
|
|
| shalabh1976 |
| Posted: Wed Jun 25, 2003 10:25 pm Post subject: |
|
|
Partisan
Joined: 18 Jul 2002
Posts: 381
Location: Gurgaon, India
|
What is the page set size allocated to the channel.
If there is insufficient space a truncation might occur.
Did you check SDSF for the no. of messages transmitted.
Are you using CSQUTIL for this job ?
Also are you using MQ concentrators ?
Looks like you might be having MQ problems. |
|
| Back to top |
|
|
| Craig B |
| Posted: Wed Jun 25, 2003 10:53 pm Post subject: |
|
|
Partisan
Joined: 18 Jun 2003
Posts: 316
Location: UK
|
I think the first part of your investigation need to isolate at which point the messages are going missing. It would seem that you would need to add some check points into your scenario that has more granular tracking/checkpoints to see where there the counts do not match. This type of tracking would involves :
1) Ensuring that the messages were actually MQPUT. It seems that you have a count for this but I would check that there is no scope for MQPUTs failing and the counts being incremented.
2) If you are using clustering techology to route these messages to the WMQI brokers queue manager then it will be difficult to check transmission queue depths and target queue depths to ensure they match. Is it possible that these missing messages got routed to a different cluster queue manager?
3) Would it be possible to temporarily GET disable your flows input queues and then check the depths of the input queue to ensure this is correct. This will help to verify whether the messages are going missing in transport or within WMQI processing. Have you checked the Dead letter queues on both the sender and receiver queue managers?
4) In your WMQI to you have error handling logic throughout your flows?
Have you not wired terminals that are occasionally required such as the Unknown, False terminals on the Filter Node? Have you used Try-Catch nodes or wired Catch terminals but not written the message out to a failure queue, and if you dont write the message out, is this counted in your audit?
_________________
Regards
Craig |
|
| Back to top |
|
|
| wmqiguy |
| Posted: Thu Jun 26, 2003 5:21 am Post subject: |
|
|
Centurion
Joined: 09 Oct 2002
Posts: 145
Location: Florida
|
My hunch is #4 from Craig's post. MQ doesn't lose messages......programmers do. I would recommend that you change your audit within WMQI. Log your message when it enters and when it leaves the flow. This way you can "rule out" or "rule in" whether the problem is within the WMQI flow.
Example 1:
Source App: sent 1000
WMQI: received 1000
WMQI: sent 990
Result: WMQI has possibly mishandled 10 (or more to the point...a WMQI programmer)
Example 2:
Source App: sent 1000
WMQI: received 990
WMQI: sent 990
Result: MQSeries/Source App possibly have an issue
It does not necessarily solve all your ills, but it does give you a bit more granularity and should shorten your search for wayward messages.
Good Luck  |
|
| Back to top |
|
|
| Lisa |
| Posted: Thu Jun 26, 2003 6:06 am Post subject: Missing Messages |
|
|
Master
Joined: 07 Jun 2002
Posts: 287
Location: NJ
|
Thanks everyone for your prompt responses,
I will report back to everyone with my test results!
I will stop the message flows and get the counts and if
I need to add check points, I will do that. |
|
| Back to top |
|
|
|
|
