| Author |
Message
|
| deepeshk79 |
 Posted: Thu Dec 24, 2009 11:21 pm Post subject: Data Flow Engine in WMB |
 |
|
Apprentice
Joined: 25 Mar 2007
Posts: 45
Location: Los Angeles
|
Hi,
Is there any direct cor-relation between the flow threads running and the data flow engine process? I dont have any message flow deployed in any of the execution groups and thus there is no thread running in memory but i can still see dataflowengine.exe in my processes in task manager.
My understanding is that dataflowengine.exe is used to manage the heap memory required for the message flows but if there are no message flows running then there will not be any dataflowengine process.
Any thoughts ?
Deepesh |
|
| Back to top |
|
 |
| Michael Dag |
| Posted: Fri Dec 25, 2009 2:51 am Post subject: |
|
|
Jedi Knight
Joined: 13 Jun 2002
Posts: 2607
Location: The Netherlands (Amsterdam)
|
|
| Back to top |
|
|
| fjb_saper |
| Posted: Fri Dec 25, 2009 11:19 am Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
| Michael Dag wrote: |
| there is always the default execution group... |
The default execution group need not be named default. If in Unix you'll see it having a 1 where the others have a 0 in the ps -ef | grep DataFlow output.
The default execution group publishes the broker's system topics and statistics...
Have fun 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| deepeshk79 |
| Posted: Fri Dec 25, 2009 11:23 am Post subject: |
|
|
Apprentice
Joined: 25 Mar 2007
Posts: 45
Location: Los Angeles
|
| But there are no flows deployed in default exec grp.... so what is the dataflowengine process for ? |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Fri Dec 25, 2009 11:25 am Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
| fjb_saper wrote: |
The default execution group publishes the broker's system topics and statistics...
Have fun |
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| rekarm01 |
| Posted: Fri Dec 25, 2009 6:54 pm Post subject: Re: Data Flow Engine in WMB |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 1415
|
Each execution group deployed to a broker runs as a separate (DataFlowEngine) process, whether it has message flows deployed to it or not.
Any deployed message flows (including hidden message flows) run as separate threads within an execution group process.
| fjb_saper wrote: |
| The default execution group need not be named 'default'. |
But if there is an execution group named 'default', it ought to be the default execution group, otherwise things can get confusing ... |
|
| Back to top |
|
|
| smdavies99 |
| Posted: Fri Dec 25, 2009 10:06 pm Post subject: Re: Data Flow Engine in WMB |
|
|
Jedi Council
Joined: 10 Feb 2003
Posts: 6076
Location: Somewhere over the Rainbow this side of Never-never land.
|
| rekarm01 wrote: |
Any deployed message flows (including hidden message flows) run as separate threads within an execution group process.
|
Did I miss something?
Can you elaborate on this little point?
_________________
WMQ User since 1999
MQSI/WBI/WMB/'Thingy' User since 2002
Linux user since 1995
Every time you reinvent the wheel the more square it gets (anon). If in doubt think and investigate before you ask silly questions. |
|
| Back to top |
|
|
| rekarm01 |
| Posted: Sat Dec 26, 2009 12:43 am Post subject: Re: Data Flow Engine in WMB |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 1415
|
| rekarm01 wrote: |
| Any deployed message flows (including hidden message flows) run as separate threads within an execution group process. |
| smdavies99 wrote: |
Did I miss something?
Can you elaborate on this little point? |
The default execution group has a message flow (PubSubControlMsgFlow), not normally listed in the toolkit Domains view or through the mqsilist command, which ...
| fjb_saper wrote: |
| ... publishes the broker's system topics and statistics ... |
It's one of the reasons why a broker must always have at least one execution group. |
|
| Back to top |
|
|
| smdavies99 |
| Posted: Sat Dec 26, 2009 3:11 am Post subject: Re: Data Flow Engine in WMB |
|
|
Jedi Council
Joined: 10 Feb 2003
Posts: 6076
Location: Somewhere over the Rainbow this side of Never-never land.
|
| rekarm01 wrote: |
The default execution group has a message flow (PubSubControlMsgFlow), not normally listed in the toolkit Domains view or through the mqsilist command, |
Thanks for the pointer.
So what happens if you don't use and have therefore deleted the 'default' execution group?
_________________
WMQ User since 1999
MQSI/WBI/WMB/'Thingy' User since 2002
Linux user since 1995
Every time you reinvent the wheel the more square it gets (anon). If in doubt think and investigate before you ask silly questions. |
|
| Back to top |
|
|
| mqjeff |
| Posted: Sat Dec 26, 2009 8:12 am Post subject: Re: Data Flow Engine in WMB |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
| smdavies99 wrote: |
| rekarm01 wrote: |
The default execution group has a message flow (PubSubControlMsgFlow), not normally listed in the toolkit Domains view or through the mqsilist command, |
Thanks for the pointer.
So what happens if you don't use and have therefore deleted the 'default' execution group? |
The default execution group is not the same as the execution group named 'default'.
In fact, it's really the "master" execution group that runs the PubSubControlMsgFlow, if I recall the terminology. It's more or less the first EG process to start up that acts as the master eg. So if you delete the EG named 'default', then some other EG will nominate itself. |
|
| Back to top |
|
|
| smdavies99 |
| Posted: Sat Dec 26, 2009 9:14 am Post subject: |
|
|
Jedi Council
Joined: 10 Feb 2003
Posts: 6076
Location: Somewhere over the Rainbow this side of Never-never land.
|
mqjeff,
Thanks for clearing that up. It is a lot clearer now. Too much use of the word 'default' methinks.
One final point. The article linker earlier describes hot to perform a user & service trace on this flow. How do you find out which EG is the one with this Hidden Flow?
_________________
WMQ User since 1999
MQSI/WBI/WMB/'Thingy' User since 2002
Linux user since 1995
Every time you reinvent the wheel the more square it gets (anon). If in doubt think and investigate before you ask silly questions. |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Sat Dec 26, 2009 5:35 pm Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
| fjb_saper wrote: |
If in Unix you'll see it (the master eg) having a 1 where the others have a 0 in the ps -ef | grep DataFlow output.
The master execution group publishes the broker's system topics and statistics...
Have fun |
Like
..... DataFlow ... BROKER ... egname 0
..... DataFlow ..... BROKER .....masteregname 1
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| rekarm01 |
| Posted: Sun Dec 27, 2009 2:29 am Post subject: Re: Data Flow Engine in WMB |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 1415
|
Hmm. Skimming through the WMB 7.0 documentation, it looks like the broker no longer makes use of a default execution group.
| mqjeff wrote: |
| The default execution group is not the same as the execution group named 'default'. |
| rekarm01 wrote: |
| But if there is an execution group named 'default', it ought to be the default execution group, otherwise things can get confusing ... |
| smdavies99 wrote: |
| Too much use of the word 'default' methinks. |
Perhaps. The documentation could have picked a different word to describe one of the two. However, when creating a broker, the two are one and the same. To keep it that way, don't delete 'default'.
| mqjeff wrote: |
| In fact, it's really the "master" execution group that runs the PubSubControlMsgFlow, if I recall the terminology. It's more or less the first EG process to start up that acts as the master |
Unfortunately, the documentation doesn't use that terminology.
The broker doesn't change its default execution group, unless the current one gets deleted. It's not dependent on process start up order.
| smdavies99 wrote: |
| One final point. The article linker earlier describes how to perform a user & service trace on this flow. How do you find out which EG is the one with this Hidden Flow? |
The BIP2201 start messages will indicate which is the default execution group; look for the one with "defaultExecutionGroup 'true'".
"ps" also works, as fjb_saper describes, but only for Unix. |
|
| Back to top |
|
|
| deepeshk79 |
| Posted: Sun Dec 27, 2009 3:47 pm Post subject: |
|
|
Apprentice
Joined: 25 Mar 2007
Posts: 45
Location: Los Angeles
|
rekarm01 wrote
| Quote: |
Each execution group deployed to a broker runs as a separate (DataFlowEngine) process, whether it has message flows deployed to it or not.
|
Didn't get the above statement, i have 8 execution groups in my broker including the default and there is nothing deployed in any of the execution groups, but i see only one "dataflowengine" process running.
As per your statement, i should see atleast 8 dataflowengine processes running but i just see one...
Please clarify. |
|
| Back to top |
|
|
| rekarm01 |
| Posted: Sun Dec 27, 2009 5:32 pm Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 1415
|
| rekarm01 wrote: |
| Each execution group deployed to a broker runs as a separate (DataFlowEngine) process, whether it has message flows deployed to it or not. |
| deepeshk79 wrote: |
| Didn't get the above statement, i have 8 execution groups in my broker including the default and there is nothing deployed in any of the execution groups, but i see only one "dataflowengine" process running. |
Creating an execution group in the Configuration Manager is not the same as deploying it to the broker. The broker will not create a DFE process until the Configuration Manager actually deploys something to the broker. |
|
| Back to top |
|
|
|
|
