| |
|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
  |
|
| Integration server abend during deploy in IB9003 |
« View previous topic :: View next topic » |
| Author |
Message
|
| Gralgrathor |
 Posted: Tue Mar 01, 2016 1:44 pm Post subject: Integration server abend during deploy in IB9003 |
 |
|
Master
Joined: 23 Jul 2009
Posts: 297
|
Hi!
During the deployment of an application to an IB9003 integration server running on AIX the process quits unexpectedly:
| Code: |
BIP2155I: About to 'create ' the deployed resource 'nl.company.esb.application.product_version3_composite.PRODUCT_version3_COMPOSITE' of type '.MSGFLOW'.
BIP2155I: About to 'create ' the deployed resource 'nl.company.esb.application.product_version2_service.PRODUCT_version2_SERVICE_RPL_MQ' of type '.MSGFLOW'.
BIP2060W: The broker has detected that the Execution Group EXECUTIONGROUP, process ID 29688182, has shutdown.
BIP2208I: Execution group (64) started: process '39584000'; thread '1'; additional information: brokerName 'THEBROKER' (operation mode 'advanced'); executionGroupUUID '9f727067-4e01-0000-0080-f3c136307155'; executionGroupLabel 'EXECUTIONGROUP'; queueManagerName 'THEQMGR'; trusted 'false'; userId 'sy49794'; migrationNeeded 'false'; brokerUUID '50ea89e2-247a-11e5-a970-91dbf5680000'; filePath '/usr/ibm/mqsi/9.0.0.3'; workPath '/var/mqsi'; ICU Converter Path ''; ordinality '2'.
BIP2116E: Message broker internal error: diagnostic information 'Fatal Error; exception thrown before initialisation completed', 'Initialise execution group manager', '39584000', '1', '20', '19'.
BIP2203E: An execution group has encountered a problem whilst starting.
BIP5024E: The creation and preprocessing of the XML schemas in message set '/var/mqsi/components/THEBROKER/9f727067-4e01-0000-0080-f3c136307155/config/XMAP/' has failed.
BIP4395E: Java exception: 'java.lang.NoClassDefFoundError'; thrown from class name: 'java.lang.ClassLoader', method name: 'defineClassImpl', file: 'ClassLoader.java', line: '-2'
BIP2204I: Execution group using process '39584000' thread '1' stopped. |
It then continues to restart and fail, repeating the last six lines of log.
The application in question contains some 300 XSD schemas, 24 flows, some 60 subflows (*.subflow) and some 100 ESQL files. The BAR file is created with all resources as source - no compilation is possible due to the mix of subflows, message flows and ESQL.
I suspect that lack of resources (disk rather than RAM) in combination with the large number of schemas may be the cause, but research is ongoing.
My question to you: does this sound familiar? Do you know what the causes may be?
Thanks in advance.
_________________
A measure of wheat for a penny, and three measures of barley for a penny; and see thou hurt not the oil and the wine. |
|
| Back to top |
|
 |
| stoney |
| Posted: Tue Mar 01, 2016 3:03 pm Post subject: |
|
|
Centurion
Joined: 03 Apr 2013
Posts: 140
|
Check out /tmp - does it have plenty of space free, and can the user ID that you are running IIB under write to it?
The permissions for /tmp on my AIX box are:
| Code: |
$ ls -ld /tmp
drwxrwxrwt 5 bin bin 8192 01 Mar 23:00 /tmp |
|
|
| Back to top |
|
|
| Gralgrathor |
| Posted: Wed Mar 02, 2016 5:04 am Post subject: |
|
|
Master
Joined: 23 Jul 2009
Posts: 297
|
| stoney wrote: |
| Check out /tmp - does it have plenty of space free, and can the user ID that you are running IIB under write to it? |
Thanks for your response. /tmp does have proper permissions, but it has only 3G worth of space. I've had no luck getting more detailed data on the cause of the crash, but this may be a factor.
_________________
A measure of wheat for a penny, and three measures of barley for a penny; and see thou hurt not the oil and the wine. |
|
| Back to top |
|
|
| timber |
| Posted: Wed Mar 02, 2016 6:18 am Post subject: |
|
|
Grand Master
Joined: 25 Aug 2015
Posts: 1292
|
| Quote: |
| The application in question contains some 300 XSD schemas, 24 flows, some 60 subflows (*.subflow) and some 100 ESQL files. |
That's quite large. Is it strictly necessary to have all of those artifacts in a single application?
| Quote: |
| I suspect that lack of resources (disk rather than RAM) in combination with the large number of schemas may be the cause |
Could be true. Can you could remove 50%/75%/90% of the xsds and try again? |
|
| Back to top |
|
|
| Gralgrathor |
| Posted: Wed Mar 02, 2016 6:22 am Post subject: |
|
|
Master
Joined: 23 Jul 2009
Posts: 297
|
| timber wrote: |
| That's quite large. Is it strictly necessary to have all of those artifacts in a single application? |
Strictly? No. But some design decisions have been made that are quite difficult to change. However, if this turns out to be the cause of the crash, then there's little choice.
| Quote: |
| Can you could remove 50%/75%/90% of the xsds and try again? |
I've already rewritten some of the WSDLs and reduced the number of XSDs to 60. The memory usage on my local IB9NODE/default remains the same, but perhaps the development environment I'm deploying to will be able to handle the deploy better. I'll update as soon as I get some answers.
_________________
A measure of wheat for a penny, and three measures of barley for a penny; and see thou hurt not the oil and the wine. |
|
| Back to top |
|
|
| zpat |
| Posted: Wed Mar 02, 2016 8:10 am Post subject: |
|
|
Jedi Council
Joined: 19 May 2001
Posts: 5866
Location: UK
|
There are various deployment defects in IIB.
I suggest you upgrade to IIB 9005 and try that.
_________________
Well, I don't think there is any question about it. It can only be attributable to human error. This sort of thing has cropped up before, and it has always been due to human error. |
|
| Back to top |
|
|
| Gralgrathor |
| Posted: Wed Mar 09, 2016 12:42 am Post subject: |
|
|
Master
Joined: 23 Jul 2009
Posts: 297
|
| zpat wrote: |
| I suggest you upgrade to IIB 9005 and try that. |
If the PMR I've raised leads to that recommendation, that'll probably have to be put on the agenda.
Do you know of any questions relating to the memory consumption of EG's sporting applications with extensive message models imported from WSDLs?
First, I deployed the application in its entirety, with all its 20+ flows and 9 WSDLs. The EG grew to about 4.5G in memory. After that, I tried splitting up the application into smaller sections, and deployed each one seperately. Together, they made the EG grow to about 2.5G in memory.
Considering that there must be some overlap between the applications, and other overhead, I find it odd behaviour that deploying the monolith version should lead to greater memory consumption than deploying the same application in parts.
_________________
A measure of wheat for a penny, and three measures of barley for a penny; and see thou hurt not the oil and the wine. |
|
| Back to top |
|
|
| stoney |
| Posted: Wed Mar 09, 2016 2:05 am Post subject: |
|
|
Centurion
Joined: 03 Apr 2013
Posts: 140
|
| Quote: |
| First, I deployed the application in its entirety, with all its 20+ flows and 9 WSDLs. The EG grew to about 4.5G in memory. After that, I tried splitting up the application into smaller sections, and deployed each one seperately. Together, they made the EG grow to about 2.5G in memory. |
Can you clarify, did you split one IIB application project into multiple IIB application projects? |
|
| Back to top |
|
|
| Gralgrathor |
| Posted: Wed Mar 09, 2016 4:07 am Post subject: |
|
|
Master
Joined: 23 Jul 2009
Posts: 297
|
| stoney wrote: |
| Can you clarify, did you split one IIB application project into multiple IIB application projects? |
Yes. The original application sports several 'front end' interfaces, which are basically consecutive versions of the same interface, with corresponding 'back end' interfaces and flows to translate between them. I split up the project so that each application only has one 'front end' interface: the translating flows now effectively translate and route messages to flows in the 'next' application.
Since all these flows form a single functional unit, I would have preferred to manage them as a single application.
_________________
A measure of wheat for a penny, and three measures of barley for a penny; and see thou hurt not the oil and the wine. |
|
| Back to top |
|
|
|
|
|
| |
|
Page 1 of 1 |
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
