| Author |
Message
|
| mqbansal |
 Posted: Mon May 09, 2011 12:51 pm Post subject: Messages Pilling up in SYSTEM.DEAD.LETTER.QUEUE |
 |
|
Novice
Joined: 09 May 2011
Posts: 13
Location: Atlanta
|
Message with reason code 2052 are ending up in SYSTEM.DEAD.LETTER.QUEUE.
Reason code 2052 indicates some issue related to dynamic queue. But application does not have any dynamic queues
Destination queues, shown in questionable DLQ messages, are not application related queues. E.g. AMSMQS.4DB305B820006985
No functional impact.
Any diagnosis tool/approach to determine the origin/source these messages
What could be the possible reason for the SYSTEM.DEAD.LETTER.QUEUE getting filled up? |
|
| Back to top |
|
 |
| bruce2359 |
| Posted: Mon May 09, 2011 2:01 pm Post subject: Re: Messages Pilling up in SYSTEM.DEAD.LETTER.QUEUE |
|
|
Poobah
Joined: 05 Jan 2008
Posts: 9469
Location: US: west coast, almost. Otherwise, enroute.
|
| mqbansal wrote: |
| Reason code 2052 indicates some issue related to dynamic queue. |
rc 2052 means MQRC_Q_DELETED.
| Quote: |
| But application does not have any dynamic queues. |
What application?
Please post the dead-letter header of one of the messages in the dlq.
_________________
I like deadlines. I like to wave as they pass by.
ב''ה
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live. |
|
| Back to top |
|
|
| Mitra |
| Posted: Mon May 09, 2011 2:32 pm Post subject: Re: Messages Pilling up in SYSTEM.DEAD.LETTER.QUEUE |
|
|
Voyager
Joined: 21 Mar 2011
Posts: 78
|
| mqbansal wrote: |
Message with reason code 2052 are ending up in SYSTEM.DEAD.LETTER.QUEUE.
Reason code 2052 indicates some issue related to dynamic queue. But application does not have any dynamic queues
Destination queues, shown in questionable DLQ messages, are not application related queues. E.g. AMSMQS.4DB305B820006985
No functional impact.
Any diagnosis tool/approach to determine the origin/source these messages
What could be the possible reason for the SYSTEM.DEAD.LETTER.QUEUE getting filled up? |
The messages will go to DLQ when certain queue that is looking to put messages is not available. may be in ur case as it is showing RC 2052 that queue is not there at all or may be deleted.
and coming to dynamic queues they are defined on fly (when ever required).i think through the Process connecting to the qmgr you can find but not sure |
|
| Back to top |
|
|
| mqjeff |
| Posted: Mon May 09, 2011 2:35 pm Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
What's the content of the message?
AMSMQS as a prefix almost sounds like it's being used by WebSphere MQ Advanced Message Security edition - but I don't know that application well enough to be sure. |
|
| Back to top |
|
|
| shashivarungupta |
| Posted: Mon May 09, 2011 11:13 pm Post subject: |
|
|
Grand Master
Joined: 24 Feb 2009
Posts: 1343
Location: Floating in space on a round rock.
|
| mqbansal wrote: |
| Any diagnosis tool/approach to determine the origin/source these messages |
You can use dlq handler in order to pick the msgs from dlq ( to avoid ripple effects of pile up of undelivered msgs on dlq ) and forward those to another queue for further diagnosis.
( Read the chapter 12, of MQv6.0 Admin Redbook, if you want to implement dlq handler. )
You can check the DL Header for much more information other then Reason, like Put application name, Put date, Put time, Destination queue and qmgr.
_________________
*Life will beat you down, you need to decide to fight back or leave it. |
|
| Back to top |
|
|
| mqbansal |
| Posted: Tue May 10, 2011 7:04 am Post subject: |
|
|
Novice
Joined: 09 May 2011
Posts: 13
Location: Atlanta
|
Thanks All for your reply.
@shashivarungupta:
Destination Q Name : AMSMQS.4D876C51284FD707
Put Application Type: MQAT_UNIX
Put Application Name: amqpcsea
Encoding: 273
CCSID: 819
Format: MQADMIN
@mqjeff: here is the content of the message
=================================
DLH AMSMQS.4D876C51284FD707 QMgr 3MQADMIN amqpcsea 2011051007543242 $ D à 0jms.queue.queuename T Ý @0jms.queue.queuename Æ
==========================================
I am not displaying the right queue mgr name and queue anme just for security reasons.
@Mitra: Queue name which this is referring to is present and is not deleted
@bruce2359: I have posted the entire message content. Please let me know why such mesaages are seen in the the DLQ. The queues are present physically then why does it give the reason code
as MQRC_Q_DELETED
I am even posting the MQMD of the message:
Message Type: MQMT_REPLY
Message Priority:0
Message Persistence: MQPER_NOT_PERSISTENT |
|
| Back to top |
|
|
| bruce2359 |
| Posted: Tue May 10, 2011 7:14 am Post subject: |
|
|
Poobah
Joined: 05 Jan 2008
Posts: 9469
Location: US: west coast, almost. Otherwise, enroute.
|
Please use amqsbcg to browse the dlq, and post the dlh output here.
_________________
I like deadlines. I like to wave as they pass by.
ב''ה
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live. |
|
| Back to top |
|
|
| mqbansal |
| Posted: Tue May 10, 2011 7:20 am Post subject: |
|
|
Novice
Joined: 09 May 2011
Posts: 13
Location: Atlanta
|
Can you provide me the details of how to use? I am new to this command amqsbcg.
Appreciate your help |
|
| Back to top |
|
|
| mqjeff |
| Posted: Tue May 10, 2011 7:20 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
I don't actually need to see the actual contents of the message.
My question was if it looked like application data to you, if it looked like encrypted data (random), or if would otherwise give you a clue as to who is creating these messages.
And, again, are you using WebSphere MQ AMS or not? |
|
| Back to top |
|
|
| mqbansal |
| Posted: Tue May 10, 2011 7:24 am Post subject: |
|
|
Novice
Joined: 09 May 2011
Posts: 13
Location: Atlanta
|
@mqjeff - This is not the application data. This looks like encrypted data.
I am not sure why are these messages getting created 
Yes we are using WebSphere MQ AMS. |
|
| Back to top |
|
|
| shashivarungupta |
| Posted: Tue May 10, 2011 7:28 am Post subject: |
|
|
Grand Master
Joined: 24 Feb 2009
Posts: 1343
Location: Floating in space on a round rock.
|
| mqbansal wrote: |
Put Application Type: MQAT_UNIX
Put Application Name: amqpcsea |
What version of mq you are using ?
Whats the status of command server on your machine of that qmgr ?
Someone is trying to remotely administer the qmgr using pcf command ?
Is there any recent and related .FDC in your /var/mqm/errors ?
_________________
*Life will beat you down, you need to decide to fight back or leave it. |
|
| Back to top |
|
|
| shashivarungupta |
| Posted: Tue May 10, 2011 7:31 am Post subject: |
|
|
Grand Master
Joined: 24 Feb 2009
Posts: 1343
Location: Floating in space on a round rock.
|
| mqbansal wrote: |
| Can you provide me the details of how to use? I am new to this command amqsbcg. |
amqsbcg QName [ QMgrName ] [ PropOption ]
ex : amqsbcg Qlocal1 QMGR1
_________________
*Life will beat you down, you need to decide to fight back or leave it. |
|
| Back to top |
|
|
| mqbansal |
| Posted: Tue May 10, 2011 7:40 am Post subject: |
|
|
Novice
Joined: 09 May 2011
Posts: 13
Location: Atlanta
|
@shashivarungupta: MQ version - 7.0.1.3
yes we saw .FDC in the /var/mqm/errors but keeps on removing the .fdc from this directory.
I have a snapshot of what did it look like. Do you want me paste that for you? It is not a recent one. |
|
| Back to top |
|
|
| shashivarungupta |
| Posted: Tue May 10, 2011 7:43 am Post subject: |
|
|
Grand Master
Joined: 24 Feb 2009
Posts: 1343
Location: Floating in space on a round rock.
|
| Quote: |
yes we saw .FDC in the /var/mqm/errors but keeps on removing the .fdc from this directory.
|
why ?
| Quote: |
| I have a snapshot of what did it look like. Do you want me paste that for you? It is not a recent one. |
It would be helpful, as much as information you share.
_________________
*Life will beat you down, you need to decide to fight back or leave it. |
|
| Back to top |
|
|
| mqbansal |
| Posted: Tue May 10, 2011 7:44 am Post subject: |
|
|
Novice
Joined: 09 May 2011
Posts: 13
Location: Atlanta
|
@shashivarungupta: when I try to use the command "amqsbcg", It says not found for me.
Is this because I dont have access to run this? |
|
| Back to top |
|
|
|
|
