| Author |
Message
|
| dilse |
 Posted: Wed Nov 08, 2006 1:18 pm Post subject: EG Shutdown |
 |
|
Master
Joined: 24 Jun 2004
Posts: 270
|
Hi All,
Envoronment:
WMBV6002
WMQ6011
AIX5.3
When we put a 56 MB xml message thru one of our message flows, EG is shutting down and abending. Here is the syslog information
| Quote: |
Nov 8 11:19:26 eaidev user:err|error WebSphere Broker v6002[651428]: (WMBD1BRK.51b978d2-0d01-0000-0080-ae3ad50a8541)[6683]BIP2228E: Severe error: /build/S600_P/src/CommonServices/Unix/ImbAbend.cpp 1916 ImbAbend::newHandler Abend file: /var/mqsi/common/errors/WMBD1BRK.51b978d2-0d01-0000-0080-ae3ad50a8541.651428.6683.abend action: abort
Nov 8 11:19:26 eaidev user:warn|warning WebSphere Broker v6002[725086]: (WMBD1BRK)[2571]BIP2060W: The broker has detected that the Execution Group ESH_VENDORMAPS_D, process ID 651428, has shutdown. : WMBD1BRK.agent: /build/S600_P/src/AdminAgent/ImbAdminAgent.cpp: 4114: ImbAdminAgent::startAndMonitorADataFlowEngine: :
Nov 8 11:19:28 eaidev user:info WebSphere Broker v6002[921692]: (WMBD1BRK.ESH_VENDORMAPS_D)[1]BIP2201I: Execution Group started: process '921692'; thread '1'; additional information: brokerName 'WMBD1BRK'; executionGroupUUID '51b978d2-0d01-0000-0080-ae3ad50a8541'; executionGroupLabel 'ESH_VENDORMAPS_D'; defaultExecutionGroup 'false'; queueManagerName 'WMBD1QMB'; trusted 'false'; dataSourceName 'WMBD1DB'; userId 'db2inst'; migrationNeeded 'false'; brokerUUID '9d24dab3-0d01-0000-0080-aaead4561597'; filePath '/opt/mqsi/6.0'; workPath '/var/mqsi'; ICU Converter Path ''. : WMBD1BRK.51b978d2-0d01-0000-0080-ae3ad50a8541: /build/S600_P/src/DataFlowEngine/ImbMain.cpp: 351: main: :
Nov 8 11:19:33 eaidev user:info WebSphere Broker v6002[921692]: (WMBD1BRK.ESH_VENDORMAPS_D)[1]BIP7407I: Publish/Subscribe subscriptions recovery started. : WMBD1BRK.51b978d2-0d01-0000-0080-ae3ad50a8541: /build/S600_P/src/DataFlowEngine/NativeTrace/ImbNativeTrace.cpp: 667: SubscriptionService.readSubscriptions: DynamicSubscriptionEngine: DynamicSubscriptionEngine
Nov 8 11:19:33 eaidev user:info WebSphere Broker v6002[921692]: (WMBD1BRK.ESH_VENDORMAPS_D)[1]BIP7033I: Publish/Subscribe state recovery completed. : WMBD1BRK.51b978d2-0d01-0000-0080-ae3ad50a8541: /build/S600_P/src/DataFlowEngine/NativeTrace/ImbNativeTrace.cpp: 667: SubscriptionService.readSubscriptions: DynamicSubscriptionEngine: DynamicSubscriptionEngine
Nov 8 11:19:42 eaidev user:err|error WebSphere Broker v6002[921692]: (WMBD1BRK.ESH_VENDORMAPS_D)[6683]BIP2648E: Message backed out to a queue; node.
’LAW_ESH_VendorMaps_00_V1.LAW.VNDRMAPREQ.LI'. : WMBD1BRK.51b978d2-0d01-0000-0080-ae3ad50a8541: /build/S600_P/src/DataFlowEngine/ImbMqInputNode.cpp: 1859: ImbCommonInputNode::eligibleForBackout: ComIbmMQInputNode: LAW_ESH_VendorMaps_00_V1#FCMComposite_1_1 |
I would really appreciate if anyone can give some idea on this.
Thanks,
Dilsse
_________________
DilSe..
Take life as it comes..
Last edited by dilse on Wed Nov 08, 2006 1:37 pm; edited 1 time in total |
|
| Back to top |
|
 |
| jefflowrey |
| Posted: Wed Nov 08, 2006 1:24 pm Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
Abends should be reported and handled through a PMR.
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| dilse |
| Posted: Wed Nov 08, 2006 1:50 pm Post subject: |
|
|
Master
Joined: 24 Jun 2004
Posts: 270
|
Thanks Jeff. We want to try all the options from our side before we raise a PMR. Here are the things we already made sure. Please let me know if we missed anything:
1. Made sure that the system limits are made unlimited.
2. Increased the maxHeapSize to 256MB.
3. Checked by making MQSI_THREAD_STACK_SIZE to 2MB.
Please let me if I am missing any steps from my side as this flow was working for small sizes(14MB).
Thanks,
DilSe..
_________________
DilSe..
Take life as it comes.. |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Wed Nov 08, 2006 1:59 pm Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
I would at least double that heap size.
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| dilse |
| Posted: Wed Nov 08, 2006 3:09 pm Post subject: |
|
|
Master
Joined: 24 Jun 2004
Posts: 270
|
Jeff,
I did double it but Still getting the same error. Please me know if you have any other ideas.
Thanks,
DilSe..
_________________
DilSe..
Take life as it comes.. |
|
| Back to top |
|
|
| kimbert |
| Posted: Thu Nov 09, 2006 2:15 am Post subject: |
|
|
Jedi Council
Joined: 29 Jul 2003
Posts: 5542
Location: Southampton
|
|
| Back to top |
|
|
| dilse |
| Posted: Thu Nov 09, 2006 12:14 pm Post subject: |
|
|
Master
Joined: 24 Jun 2004
Posts: 270
|
Thanks Kimbert.
This may not be applicable to my scenario as I am not processing this message but converting it to SOAP and sending it to the Web Service.
Please let me know if you have any ideas.
Thanks,
DilSe.. |
|
| Back to top |
|
|
| kimbert |
| Posted: Thu Nov 09, 2006 12:32 pm Post subject: |
|
|
Jedi Council
Joined: 29 Jul 2003
Posts: 5542
Location: Southampton
|
What exactly are you doing here? So far, this is what I'm hearing:
- Input XML message. Size is > 50Mb
- Output SOAP message. Size is presumably similar.
- Message is not being 'processed'
Do you need to parse and process every field in this message? Or are you simply wrapping it in a SOAP envelope? |
|
| Back to top |
|
|
| dilse |
| Posted: Thu Nov 09, 2006 12:45 pm Post subject: |
|
|
Master
Joined: 24 Jun 2004
Posts: 270
|
Thanks for the quick response Kimbert. Here is my flow
MQInput --> Compute(prepare request)-> HTTPRequest (HTTP Post)--> Compute(remove HTTP headers) --> MQOutput node.
1. I am taking input as an xml and saving it to a queue and reading one field from the xml which is a PrimaryKey in order for me to send with the response.
2. Converting the whole input to BLOB in oredr to insert into a DB table.
3. converting it to a string to send the whole input as one parameter in the SOAP that I am posting to the web service.
these are the steps precisely I am when I am sending the input to a Web Service. Web Service output will be a very small xml which shouldn't be a problem. But my EG is bombing out before it reaches HTTP Request and even before making it to the SAVQ.
Please let me know if I can fine tune this flow.
Thanks,
DilSe..
_________________
DilSe..
Take life as it comes.. |
|
| Back to top |
|
|
| malammik |
| Posted: Thu Nov 09, 2006 1:43 pm Post subject: |
|
|
Partisan
Joined: 27 Jan 2005
Posts: 397
Location: Philadelphia, PA
|
As already mentioned this would be indeed best handled through PMR however there are few tips.
1. Find out exactly where the breaking point in the message size is. Does 32MB work, how about 12, etc.
2. Try eliminating some nodes, or even esql statements so u can norrow down to where the problem is.
_________________
Mikhail Malamud
http://www.netflexity.com
http://groups.google.com/group/qflex |
|
| Back to top |
|
|
| jefflowrey |
| Posted: Thu Nov 09, 2006 1:46 pm Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
As a first step, I would take the entire input as BLOB, rather than XML.
Then I would use POSITION and SUBSTRING to extract the single XML field you need.
Then you won't need to unmarshal the XML data into a BLOB again.
And you can CAST the BLOB as a STRING and pass that as your one SOAP parameter.
_________________
I am *not* the model of the modern major general. |
|
| Back to top |
|
|
| dilse |
| Posted: Thu Nov 09, 2006 4:52 pm Post subject: |
|
|
Master
Joined: 24 Jun 2004
Posts: 270
|
Thanks Jeff.
Thats what I was doing at the time I sent the last message and I was able to send a 30MB file and it almost took 45 mins for the web service to process  but now I am trying a 60 mb file to see if it works. I will let you know on the progress.
Thanks a lot for all your help guys..,
DilSe.. |
|
| Back to top |
|
|
| dilse |
| Posted: Fri Nov 10, 2006 8:35 am Post subject: |
|
|
Master
Joined: 24 Jun 2004
Posts: 270
|
I implemented using BLOB domain.
I tried with 30MB file and it was successful but it still failed with 56MB file. Are there any system parameters that we can change to optimize this scenario.
Thanks for all help,
DilSe.. |
|
| Back to top |
|
|
| msukup |
| Posted: Sat Nov 11, 2006 4:22 pm Post subject: |
|
|
Acolyte
Joined: 11 Feb 2002
Posts: 56
|
Have you tried with recompiled DataFlowEngine? IBM Support will provide you with a script to recompile DataFlowEngine on AIX for larger address space -- look for script called set_AIX_address_space.sh
http://www-1.ibm.com/support/docview.wss?uid=swg21179813
Also, is key you are looking for at beginning of message tree or deeply embedded? |
|
| Back to top |
|
|
|
|
