| Author |
Message
|
| LearnMQSI |
 Posted: Thu Apr 20, 2006 12:27 pm Post subject: PROCESSING HUGE MESSAGE 2.8 MG, GETTING BIP2228E, BIP2060W.. |
 |
|
Centurion
Joined: 20 Aug 2002
Posts: 137
|
Hi There,
My Environment
MQSI 2.1
WMQ 5.3 - CSD 6
AIX 5.1
Request Message Flow: (XML-TO-MRM)
InputNode------>ComputeNode--------->OutputNode
Inputting a small XML message and producing 2.8mg MRM message causing following errors:
Apr 20 15:16:47 dmqsi1 WMQIv210[111642]: (BRKD1.BigMsgRequest)[2057]BIP2228E:
Severe error: /build/S210_P/src/CommonServices/Unix/ImbAbend.cpp 478 signal received Abend file: /var/mqsi/errors/BRKD1.BigMsgRequest.111642.2057.abend acti
on: abort
Apr 20 15:17:04 dmqsi1 WMQIv210[90292]: (BRKD1)[1800]BIP2060W: The broker has detected that the Execution Group BigMsgRequest, process ID 111642, has shutdow n. : BRKD1.agent: /build/S210_P/src/AdminAgent/ImbAdminAgent.cpp: 3791: ImbAdminAgent::startAndMonitorADataFlowEngine: :
Apr 20 15:17:04 dmqsi1 WMQIv210[98356]: (BRKD1.BigMsgRequest)[1]BIP2201I: Execution Group started: process '98356'; thread '1'; additional information: brokerName 'BRKD1'; executionGroupUUID '025fc993-0a01-0000-0080-ae0299c9746a'; exe
cutionGroupLabel 'BigMsgRequest'; defaultExecutionGroup 'false'; queueManagerName 'BRKD1'; trusted 'false'; dataSourceName 'BRKD1R'; userId 'db2eig'; migra
tionNeeded 'false'; brokerUUID '47573405-0a01-0000-0080-ddd077b4a25b'; filePath '/usr/opt/mqsi'; workPath '/var/mqsi'. : BRKD1.025fc993-0a01-0000-0080-ae0299
c9746a: /build/S210_P/src/DataFlowEngine/ImbMain.cpp: 215: main: :
Any shed on this issue would be higly appreciated!!!
Thank you in advance for your help
_________________
IBM Certified System Administrator - WebSphere MQ 5.3 |
|
| Back to top |
|
 |
| wbibrk |
| Posted: Thu Apr 20, 2006 12:39 pm Post subject: |
|
|
Apprentice
Joined: 09 Jul 2005
Posts: 46
|
Hi,
Can you please post the abend stack. |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Thu Apr 20, 2006 12:41 pm Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
Isn't there some way with 2.1 to increase the broker's heap size?
I'm sure there must have been...
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| LearnMQSI |
| Posted: Thu Apr 20, 2006 12:57 pm Post subject: |
|
|
Centurion
Joined: 20 Aug 2002
Posts: 137
|
Hi wbibrk and jefflowrey,
Thank you so much for your quick response.
Here is the Abend Stack:
abend record for pid 111642 tid 2057 time in seconds since 01/01/1970: 114556060
7
File: /build/S210_P/src/CommonServices/Unix/ImbAbend.cpp
Line: 478
Function: signal received
---- Inserts ----
11
@(#) 1.28.1.6 CommonServices/Unix/ImbAbend.cpp, CommonServices, S210, S210-CSD08
04/09/13 18:40:11 [11/15/04 23:00:57]
976560336
-----------------
----------------------------- Stack dump for current thread ( 2057)
(0xd68b2ccc+0x00000ffc) logTreeAsStringInner__16ImbSyntaxElementFR13ImbStringBas
eXTwTQ2_3std11char_traitsXTw_SP18SP37_13ImbStringBaseXTwTQ2_3std11char_traitsXTw
_SP18SP37_ [/usr/opt/wmqi/lib/libMessageServices.a(libMessageServices.a.so)]
(0xd68b2ccc+0x00001a94) logTreeAsStringInner__16ImbSyntaxElementFR13ImbStringBas
eXTwTQ2_3std11char_traitsXTw_SP18SP37_13ImbStringBaseXTwTQ2_3std11char_traitsXTw
_SP18SP37_ [/usr/opt/wmqi/lib/libMessageServices.a(libMessageServices.a.so)]
(0xd68b2ccc+0x00001a94) logTreeAsStringInner__16ImbSyntaxElementFR13ImbStringBas
eXTwTQ2_3std11char_traitsXTw_SP18SP37_13ImbStringBaseXTwTQ2_3std11char_traitsXTw
_SP18SP37_ [/usr/opt/wmqi/lib/libMessageServices.a(libMessageServices.a.so)]
(0xd68b2ccc+0x00001a94) logTreeAsStringInner__16ImbSyntaxElementFR13ImbStringBas
eXTwTQ2_3std11char_traitsXTw_SP18SP37_13ImbStringBaseXTwTQ2_3std11char_traitsXTw
_SP18SP37_ [/usr/opt/wmqi/lib/libMessageServices.a(libMessageServices.a.so)]
(0xd68b2ccc+0x00001a94) logTreeAsStringInner__16ImbSyntaxElementFR13ImbStringBas
eXTwTQ2_3std11char_traitsXTw_SP18SP37_13ImbStringBaseXTwTQ2_3std11char_traitsXTw
_SP18SP37_ [/usr/opt/wmqi/lib/libMessageServices.a(libMessageServices.a.so)]
(0xd68b0498+0x00000080) logTreeAsString__16ImbSyntaxElementFR13ImbStringBaseXTwT
Q2_3std11char_traitsXTw_SP18SP37_13ImbStringBaseXTwTQ2_3std11char_traitsXTw_SP18
SP37_ [/usr/opt/wmqi/lib/libMessageServices.a(libMessageServices.a.so)]
(0xd7a014dc+0x00000094) logTreeAsString__Q2_10ImbMessage10ReadCursorFR13ImbStrin
gBaseXTwTQ2_3std11char_traitsXTw_SP18SP37_ [/usr/opt/wmqi/lib/libImbRdl.a(libImb
Rdl.a.so)]
(0xd7a01074+0x00000070) logToString2__19SqlCursorEvalResultFR13ImbStringBaseXTwT
Q2_3std11char_traitsXTw_SP18SP37_ [/usr/opt/wmqi/lib/libImbRdl.a(libImbRdl.a.so)
]
(0xd7d6f388+0x000004d4) logToString__13SqlEvalResultFR13ImbStringBaseXTwTQ2_3std
11char_traitsXTw_SP18SP37_ [/usr/opt/wmqi/lib/libImbRdl.a(libImbRdl.a.so)]
(0xd7db1ca8+0x000008f4) evaluate__21SqlTraceNodeInterfaceFRC18ImbMessageAssembly
R13ImbStringBaseXTwTQ2_3std11char_traitsXTw_SP18SP37_ [/usr/opt/wmqi/lib/libImbR
dl.a(libImbRdl.a.so)]
(0xd8cde460+0x00000140) evaluate__12ImbTraceNodeFRC18ImbMessageAssemblyPC19ImbDa
taFlowTerminal [/usr/opt/mqsi/lil/imbdfsql.lil]
(0xd7868a28+0x000001bc) evaluate__19ImbDataFlowTerminalFRC18ImbMessageAssembly [
/usr/opt/wmqi/lib/libDataFlowDLL.a(libDataFlowDLL.a.so)]
(0xd7868840+0x00000074) propagate__19ImbDataFlowTerminalFRC18ImbMessageAssembly
[/usr/opt/wmqi/lib/libDataFlowDLL.a(libDataFlowDLL.a.so)]
(0xd8ce5fb0+0x000001cc) propagate__14ImbComputeNodeFRC18ImbMessageAssemblyR18Imb
MessageAssembly [/usr/opt/mqsi/lil/imbdfsql.lil]
(0xd8ca8cf0+0x00000a1c) evaluate__14ImbComputeNodeFRC18ImbMessageAssemblyPC19Imb
DataFlowTerminal [/usr/opt/mqsi/lil/imbdfsql.lil]
(0xd7868a28+0x000001bc) evaluate__19ImbDataFlowTerminalFRC18ImbMessageAssembly [
/usr/opt/wmqi/lib/libDataFlowDLL.a(libDataFlowDLL.a.so)]
(0xd7868840+0x00000074) propagate__19ImbDataFlowTerminalFRC18ImbMessageAssembly
[/usr/opt/wmqi/lib/libDataFlowDLL.a(libDataFlowDLL.a.so)]
(0xd8ce5fb0+0x000001cc) propagate__14ImbComputeNodeFRC18ImbMessageAssemblyR18Imb
MessageAssembly [/usr/opt/mqsi/lil/imbdfsql.lil]
(0xd8ca8cf0+0x00000a1c) evaluate__14ImbComputeNodeFRC18ImbMessageAssemblyPC19Imb
DataFlowTerminal [/usr/opt/mqsi/lil/imbdfsql.lil]
(0xd7868a28+0x000001bc) evaluate__19ImbDataFlowTerminalFRC18ImbMessageAssembly [
/usr/opt/wmqi/lib/libDataFlowDLL.a(libDataFlowDLL.a.so)]
(0xd7868840+0x00000074) propagate__19ImbDataFlowTerminalFRC18ImbMessageAssembly
[/usr/opt/wmqi/lib/libDataFlowDLL.a(libDataFlowDLL.a.so)]
(0xd89263c0+0x00002e1c) readQueue__14ImbMqInputNodeFP11ImbOsThread [/usr/opt/mqs
i/lil/imbdfmqm.lil]
(0xd8962d0c+0x00000048) run__Q2_14ImbMqInputNode10ParametersFP11ImbOsThread [/us
r/opt/mqsi/lil/imbdfmqm.lil]
(0xd66b162c+0x00000070) run__27ImbThreadPoolThreadFunctionFP11ImbOsThread [/usr/
opt/wmqi/lib/libCommonServices.a(libCommonServices.a.so)]
(0xd7868840+0x00000074) propagate__19ImbDataFlowTerminalFRC18ImbMessageAssembly
[/usr/opt/wmqi/lib/libDataFlowDLL.a(libDataFlowDLL.a.so)]
(0xd8ce5fb0+0x000001cc) propagate__14ImbComputeNodeFRC18ImbMessageAssemblyR18Imb
MessageAssembly [/usr/opt/mqsi/lil/imbdfsql.lil]
(0xd8ca8cf0+0x00000a1c) evaluate__14ImbComputeNodeFRC18ImbMessageAssemblyPC19Imb
DataFlowTerminal [/usr/opt/mqsi/lil/imbdfsql.lil]
(0xd7868a28+0x000001bc) evaluate__19ImbDataFlowTerminalFRC18ImbMessageAssembly [
/usr/opt/wmqi/lib/libDataFlowDLL.a(libDataFlowDLL.a.so)]
(0xd7868840+0x00000074) propagate__19ImbDataFlowTerminalFRC18ImbMessageAssembly
[/usr/opt/wmqi/lib/libDataFlowDLL.a(libDataFlowDLL.a.so)]
(0xd89263c0+0x00002e1c) readQueue__14ImbMqInputNodeFP11ImbOsThread [/usr/opt/mqs
i/lil/imbdfmqm.lil]
(0xd8962d0c+0x00000048) run__Q2_14ImbMqInputNode10ParametersFP11ImbOsThread [/us
r/opt/mqsi/lil/imbdfmqm.lil]
(0xd66b162c+0x00000070) run__27ImbThreadPoolThreadFunctionFP11ImbOsThread [/usr/
opt/wmqi/lib/libCommonServices.a(libCommonServices.a.so)]
(0xd66a7f70+0x00000054) threadRun__11ImbOsThreadFv [/usr/opt/wmqi/lib/libCommonS
ervices.a(libCommonServices.a.so)]
(0xd66a7b18+0x00000064) threadBootStrap__11ImbOsThreadFPv [/usr/opt/wmqi/lib/lib
CommonServices.a(libCommonServices.a.so)]
(0xd004b33c+0x000000ec) _pthread_body [/usr/lib/libpthreads.a(shr_xpg5.o)]
(0x00000000) <invalid code address>
----------------------------------------------------------------------
_________________
IBM Certified System Administrator - WebSphere MQ 5.3 |
|
| Back to top |
|
|
| elvis_gn |
| Posted: Thu Apr 20, 2006 10:47 pm Post subject: |
|
|
Padawan
Joined: 08 Oct 2004
Posts: 1905
Location: Dubai
|
Hi LearnMQSI,
I've faced this issue or atleast a similar one.
I remember the execution group used to shutdown and start everytime i sent a huge message...but i also used to get a stack overflow message...
Anyway if its any worth, I had documented the same, hope it helps
Problem:
| Quote: |
Stack full: Message vanishes or goes to the dead letter queue.The execution group ends abnormally and starts another thread. The event viewer shows the following.
Severe Abend Error detected. EXCEPTION_STACK_OVERFLOW.A Stack overflow has occured |
Solution:
| Quote: |
On AIX the .profile can be edited by logging in and from the home opening the file as
vi .profile
Find the MQSI_THREAD_STACK_SIZE= ??? increase the number |
Regards. |
|
| Back to top |
|
|
| LearnMQSI |
| Posted: Fri Apr 21, 2006 5:27 am Post subject: |
|
|
Centurion
Joined: 20 Aug 2002
Posts: 137
|
Hi elvis_gn,
Thank you so much for your response. Actually, I don't have .profile file in home directory, but I do have .profile in my own directory i.e. /home/abc.
My .profile file does not contain MQSI_THREAD_STACK_SIZE at all.
Is there any other file that contains this info?
_________________
IBM Certified System Administrator - WebSphere MQ 5.3 |
|
| Back to top |
|
|
| JT |
| Posted: Fri Apr 21, 2006 5:44 am Post subject: |
|
|
Padawan
Joined: 27 Mar 2003
Posts: 1564
Location: Hartford, CT.
|
| Quote: |
Is there any other file that contains this info?
|
I could be wrong, but I don't remember the MQSI_THREAD_STACK_SIZE parameter being included in the default profiles. We had to add it and assign the value ourselves. |
|
| Back to top |
|
|
| mgk |
| Posted: Fri Apr 21, 2006 6:08 am Post subject: |
|
|
Padawan
Joined: 31 Jul 2003
Posts: 1642
|
Hi,
Well from the abend you posted the problem is a seg-v, and it does not look like a stack overflow to me. Also the abend is happening in a trace node, which does not appear on your diagram of the flow. Try removing the trace node and see what happens.
What fix pac are you on? (If you are back level I would suggest an upgrade). Failing that you will need to raise a PMR.
Regards,
_________________
MGK
The postings I make on this site are my own and don't necessarily represent IBM's positions, strategies or opinions. |
|
| Back to top |
|
|
| LearnMQSI |
| Posted: Mon May 01, 2006 11:34 am Post subject: |
|
|
Centurion
Joined: 20 Aug 2002
Posts: 137
|
Hi mgk,
You are obsolutely right. I removed my trace node and it is working fine but I'm getting memory issues while my Reply message flow generating CWF-to-XML. I'm looking into it. I will let you guys know how it is going.
Thank you so much for all your help and inputs.
_________________
IBM Certified System Administrator - WebSphere MQ 5.3 |
|
| Back to top |
|
|
|
|
