| Author |
Message
|
| shashivarungupta |
 Posted: Sun Mar 15, 2009 10:29 pm Post subject: Data Flow Engine ? |
 |
|
Grand Master
Joined: 24 Feb 2009
Posts: 1343
Location: Floating in space on a round rock.
|
Hi Folk,
Could you please tell me what is the significance of DataFlowEngine?
How and what all information does it contain in it self?
How can I get those all information?
I have AIX5.3 platform and I ran the ps -ef | grep DataFlowEngine command to just view all the DataFlowEngines and associated EGs.
I would appreciate if you could provide me some more details on that.
Thanks |
|
| Back to top |
|
 |
| MQEnthu |
| Posted: Sun Mar 15, 2009 10:47 pm Post subject: |
|
|
Partisan
Joined: 06 Oct 2008
Posts: 329
Location: India
|
| shashivarungupta wrote: |
| ran the ps -ef | grep DataFlowEngine command to just view all the DataFlowEngines and associated EGs |
What was the result?? 
| Quote: |
| An execution group process is also known as a DataFlowEngine (DFE); this term is typically used in problem determination scenarios (trace contents, diagnostic messages, and so on). A DFE is created as an operating system process, and has a one-to-one relationship with the named execution group. If more than one message flow runs within an execution group, multiple threads are created within the DFE process |
http://publib.boulder.ibm.com/infocenter/wmbhelp/v6r1m0/topic/com.ibm.etools.mft.doc/ae00270_.htm 
_________________
-----------------------------------------------
It is good to remember the past,
but don't let past capture your future |
|
| Back to top |
|
|
| shashivarungupta |
| Posted: Sun Mar 15, 2009 11:11 pm Post subject: |
|
|
Grand Master
Joined: 24 Feb 2009
Posts: 1343
Location: Floating in space on a round rock.
|
| Quote: |
| What was the result?? |
When I ran that.. It displayed info. about EGs, PID, PPID, UID etc.
The result was :
$ ps -ef | grep DataFlow*
mqsiprd 303248 565558 0 Feb 26 - 156:30 DataFlowEngine EAIPRBR1_BROKER 91447d0d-1101-0000-0080-dfe0ed2f7c78 CON_PAYOFFS1 0
mqsiprd 315404 565558 0 Feb 26 - 4:02 DataFlowEngine EAIPRBR1_BROKER 8a4e830d-1101-0000-0080-dfe0ed2f7c78 WAMS2 0
mqsiprd 426060 565558 0 Mar 13 - 19:34 DataFlowEngine EAIPRBR1_BROKER fa75880d-1101-0000-0080-dfe0ed2f7c78 SOF 1
mqsiprd 503994 565558 0 Feb 26 - 18:37 DataFlowEngine EAIPRBR1_BROKER 46a17e0d-1101-0000-0080-dfe0ed2f7c78 DISCOUNTING_DATE_RANGE 0
mqsiprd 520404 565558 0 Feb 26 - 3:18 DataFlowEngine EAIPRBR1_BROKER 6047840d-1101-0000-0080-dfe0ed2f7c78 CON_DL_VEH 0
mqsiprd 524444 565558 0 Feb 26 - 3:41 DataFlowEngine EAIPRBR1_BROKER 2265800d-1101-0000-0080-dfe0ed2f7c78 CANDLE_MONITOR 0
Thats the only thing that I got.
| Quote: |
| ..If more than one message flow runs within an execution group, multiple threads are created within the DFE process |
How can I see them? Any idea, except writing a java program?
Any help.. would be appreciated.
Thanks |
|
| Back to top |
|
|
| MQEnthu |
| Posted: Sun Mar 15, 2009 11:19 pm Post subject: |
|
|
Partisan
Joined: 06 Oct 2008
Posts: 329
Location: India
|
| shashivarungupta wrote: |
| Quote: |
| ..If more than one message flow runs within an execution group, multiple threads are created within the DFE process |
How can I see them? Any idea, except writing a java program?
Any help.. would be appreciated. |
mqsilist with -e will give you all the flows running under the execution group.. or else use CMP
_________________
-----------------------------------------------
It is good to remember the past,
but don't let past capture your future |
|
| Back to top |
|
|
| shashivarungupta |
| Posted: Sun Mar 15, 2009 11:32 pm Post subject: RE |
|
|
Grand Master
Joined: 24 Feb 2009
Posts: 1343
Location: Floating in space on a round rock.
|
| Quote: |
mqsilist with -e will give you all the flows running under the execution group.. or else use CMP |
$ mqsilist
BIP8099I: ConfigMgr: ConfigMgr - EAIDVCF1
BIP8099I: Broker: EAIDVBR1_BROKER - EAIDVBR1
$ mqsilist -a EAIDVBR1_BROKER -e EG1
mqsilist with -e hangs for ever.. it seems it waits for another input. I don't see any result out of it.
(I am on AIX5.3 platform.) |
|
| Back to top |
|
|
| MQEnthu |
| Posted: Sun Mar 15, 2009 11:39 pm Post subject: |
|
|
Partisan
Joined: 06 Oct 2008
Posts: 329
Location: India
|
| shashivarungupta wrote: |
| $ mqsilist -a EAIDVBR1_BROKER -e EG1 |
Try:
| Code: |
| mqsilist <broker name> -e <execution group name> |
_________________
-----------------------------------------------
It is good to remember the past,
but don't let past capture your future |
|
| Back to top |
|
|
| shashivarungupta |
| Posted: Mon Mar 16, 2009 12:36 am Post subject: RE... |
|
|
Grand Master
Joined: 24 Feb 2009
Posts: 1343
Location: Floating in space on a round rock.
|
| Quote: |
Try:
| Code: |
| mqsilist <broker name> -e <execution group name> |
|
I did so :
$ mqsilist EAIDVBR1_BROKER -e EG1
And again it hangs for ever.. don't know why? It seems its waiting for something as input OR its processing something in background to display the list.
But then I did wait for at least 5 min. so that something would come up. But no luck. 
Why its behaving like this I have no clue.
When I give following command, it displays all the EGs under that broker with its PID.
$mqsilist -a EAIDVBR1_BROKER
BIP8130I: Execution Group: EG1 - 1097808
BIP8130I: Execution Group: EG2- 1036310
BIP8130I: Execution Group: EG3 - 1200202
But following doesn't seem to work.
$ mqsilist EAIDVBR1_BROKER -e EG1 |
|
| Back to top |
|
|
| MQEnthu |
| Posted: Mon Mar 16, 2009 12:56 am Post subject: |
|
|
Partisan
Joined: 06 Oct 2008
Posts: 329
Location: India
|
Are the broker and config mgr active... broker should be active to get the the flow information using mqsilsist
_________________
-----------------------------------------------
It is good to remember the past,
but don't let past capture your future |
|
| Back to top |
|
|
| shashivarungupta |
| Posted: Mon Mar 16, 2009 1:07 am Post subject: RE |
|
|
Grand Master
Joined: 24 Feb 2009
Posts: 1343
Location: Floating in space on a round rock.
|
| MQEnthu wrote: |
| Are the broker and config mgr active... they should be active to get the the flow information using mqsilsist |
Yes, those are active. I checked. I dont know what was wrong in TEST environment.
It worked in Production Environment...But then it doesn't show any details about the threads. As we have been looking for that details.
Though it shows the names of the message flows being already deployed in that EG.
$ mqsilist -a EAIPRBR1_BROKER -e EG2
BIP8131I: MessageFlow: GetVerificationDFRep
BIP8131I: MessageFlow: GetVerificationDFReq
BIP8131I: MessageFlow: GetVerificationRep
BIP8131I: MessageFlow: GetVerificationReq |
|
| Back to top |
|
|
| MQEnthu |
| Posted: Mon Mar 16, 2009 1:16 am Post subject: |
|
|
Partisan
Joined: 06 Oct 2008
Posts: 329
Location: India
|
| shashivarungupta wrote: |
But then it doesn't show any details about the threads. As we have been looking for that details.
Though it shows the names of the message flows being already deployed in that EG |
| MQEnthu wrote: |
| mqsilist with -e will give you all the flows running under the execution group or else use CMP.. |
What other details about the threads you wanted ??
_________________
-----------------------------------------------
It is good to remember the past,
but don't let past capture your future |
|
| Back to top |
|
|
| shashivarungupta |
| Posted: Mon Mar 16, 2009 1:28 am Post subject: |
|
|
Grand Master
Joined: 24 Feb 2009
Posts: 1343
Location: Floating in space on a round rock.
|
| MQEnthu wrote: |
| shashivarungupta wrote: |
But then it doesn't show any details about the threads. As we have been looking for that details.
Though it shows the names of the message flows being already deployed in that EG |
| MQEnthu wrote: |
| mqsilist with -e will give you all the flows running under the execution group or else use CMP.. |
What other details about the threads you wanted ?? |
No. of threads / Instances that are running for a particular message flow.
(Though that we can check from Broker Admin. perspective But is it possible to check that at Process level in that Operating System?).
Rest performance details I am looking into Accounting and Statistics of MFlows and EGs. |
|
| Back to top |
|
|
| MQEnthu |
| Posted: Mon Mar 16, 2009 1:34 am Post subject: |
|
|
Partisan
Joined: 06 Oct 2008
Posts: 329
Location: India
|
| shashivarungupta wrote: |
No. of threads / Instances that are running for a particular message flow.
(Though that we can check from Broker Admin. perspective But is it possible to check that at Process level in that Operating System?). |
You can get this info using CMP APIs...
not sure of any other perticular tool which provides the info regarding the threads running under a process..
_________________
-----------------------------------------------
It is good to remember the past,
but don't let past capture your future |
|
| Back to top |
|
|
| mqjeff |
| Posted: Mon Mar 16, 2009 1:35 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
Do you expect your Java Application server to report the full status of each and every thread and exactly which application URL is being served by that thread - at the OS/Process level? Does it?
Why do you expect this from Message Broker? |
|
| Back to top |
|
|
| shashivarungupta |
| Posted: Mon Mar 16, 2009 1:41 am Post subject: RE |
|
|
Grand Master
Joined: 24 Feb 2009
Posts: 1343
Location: Floating in space on a round rock.
|
| MQEnthu wrote: |
| shashivarungupta wrote: |
No. of threads / Instances that are running for a particular message flow.
(Though that we can check from Broker Admin. perspective But is it possible to check that at Process level in that Operating System?). |
You can get this info using CMP APIs...
not sure of any other perticular tool which provides the info regarding the threads running under a process.. |
Ok, I'll check CMP for that. 
You know, I got the Error when I was trying mqsilist command in TEST region and it was getting hanged for ever.
clmid025:/var/mqsi $ mqsilist -a EAIDVBR1_BROKER -e IDS_CCASS
BIP2087E: Broker EAIDVBR1_BROKER was unable to process the internal configuration message.
The entire internal configuration message failed to be processed successfully.
Use the messages following this message to determine the reasons for the failure. If the problem cannot be resolved after reviewing these messages, contact your IBM Support center. Enabling service trace may help determine the cause of the failure.
BIP2066E: Broker EAIDVBR1_BROKER (UUID f6c630fe-0e01-0000-0080-c7b36fc7ccba) was unable to retrieve an internal configuration response message for execution group 'IDS_CCASS' within the 360 second Configuration Timeout.
The execution group did not respond within the Configuration Timeout period. A negative response is returned to the Configuration Manager for this execution group. The Configuration Timeout is the maximum length of time that an execution group is allowed to apply a deployed configuration change. By default the Configuration Timeout period is 300 seconds. You can increase (or decrease) the timeout by using the mqsichangebroker option, ConfigurationTimeout. This will not resolve any underlying problem with the deployed message, but can be used to reduce the response turnaround time or increase it to allow for large and complex deployments.
Investigate why the execution group was unable to respond before being timed out. Use the system log messages to determine if there is a problem with the execution group. You should check that your system is not running short of resources, for example, you may need to increase the WebSphere log size. Reducing the complexity of the deploy by reducing the number of execution groups may also help to alleviate this problem. Correct the problem and redeploy the broker's configuration from the Message Brokers Toolkit, mqsideploy command or Config Manager Proxy. If there are no other failure diagnostics then you should consider increasing the Configuration Timeout, increase this value in units of 300 until this message no longer occurs. Contact your IBM support center if you are unable to resolve the problem.
BIP8071I: Successful command completion.
Though I checked both the Configuration manager and broker are runnning.
/var/mqsi $ mqsistatus_ConfigMgr ConfigMgr
Running
/var/mqsi $ mqsistatus_Broker EAIDVBR1_BROKER
Running |
|
| Back to top |
|
|
| shashivarungupta |
| Posted: Mon Mar 16, 2009 2:39 am Post subject: RE... |
|
|
Grand Master
Joined: 24 Feb 2009
Posts: 1343
Location: Floating in space on a round rock.
|
| mqjeff wrote: |
Do you expect your Java Application server to report the full status of each and every thread and exactly which application URL is being served by that thread - at the OS/Process level? Does it?
Why do you expect this from Message Broker? |
I am on Middleware and the server I am checking on is not the application server. No application hosts on that server. That server is the MQ Server. On which we have defined the broker and config manager and their respective mq queue managers.
On that AIX 5.3 server, I wanted to check the no. of instances of the particular message flow in a particular EG.
Its to analyze the performance (at broker level) and yes to know which application process is associated with that thread/instance of mflow.
I just said that the no. of instances of the mflow can be viewed from the broker admin. perspective. [in the EG in which mflow was being deployed.] |
|
| Back to top |
|
|
|
|
