ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum IndexWebSphere Message Broker SupportNode and flow additional instances

Post new topicReply to topic
Node and flow additional instances View previous topic :: View next topic
Author Message
PEPERO
PostPosted: Wed Aug 24, 2016 4:19 am Post subject: Node and flow additional instances Reply with quote

Disciple

Joined: 30 May 2011
Posts: 177

Hi all;
What is the added value of using additional instance of node instead of additional instance of the flow?
Back to top
View user's profile Send private message
ghoshly
PostPosted: Wed Aug 24, 2016 9:24 am Post subject: Reply with quote

Master

Joined: 10 Jan 2008
Posts: 287

Both thread pools are different from where additional threads are allowed. When more number of parallel input connections are required, I used the node pool and when over all flow processing throughput is required, I used additional instances of the flow. I would be glad as well if better explanation is received from seniors.
Back to top
View user's profile Send private message
mqjeff
PostPosted: Wed Aug 24, 2016 9:36 am Post subject: Reply with quote

Grand Master

Joined: 25 Jun 2008
Posts: 17447

Each node is a process.

Each instance of a flow is a thread in a process.
_________________
chmod -R ugo-wx /
Back to top
View user's profile Send private message
Craig B
PostPosted: Tue Sep 20, 2016 1:13 am Post subject: Reply with quote

Partisan

Joined: 18 Jun 2003
Posts: 316
Location: UK

When you have one node in a message flow it doesn't make any difference. It comes into play when you have multiple input nodes in a flow. If you rely on flow level additional instances then one input node can "steal" most of the threads, leaving other input nodes under resourced.

Historically, this functionality was added for Aggregation. In the old days IIB users used to implement their Request and Reply logic in the same flow. More often than not the Request leg would consume a large number of thread pool leaving the Reply side starved and unable to keep up. This was solved by adding node level additional instances to the product. That meant the reply side input nodes could be given what they needed to keep up with the request side.

Please be aware that if you are using IIB V10 and you have input nodes in a subflow that have node level additional instances, there has been a recently discovered defect in this area such that the additional instances did not get applied to the input node.
_________________
Regards
Craig
Back to top
View user's profile Send private message
DeadPool
PostPosted: Thu Sep 29, 2016 12:46 am Post subject: Reply with quote

Apprentice

Joined: 27 May 2016
Posts: 30

Craig B wrote:

Please be aware that if you are using IIB V10 and you have input nodes in a subflow that have node level additional instances, there has been a recently discovered defect in this area such that the additional instances did not get applied to the input node.


Craig do you have any more information on this? Is IBM working on it?
Back to top
View user's profile Send private message
Craig B
PostPosted: Thu Sep 29, 2016 1:51 am Post subject: Reply with quote

Partisan

Joined: 18 Jun 2003
Posts: 316
Location: UK

The APAR is:

IT15164: IF INPUT NODE OF THE MESSAGE FLOW IS PART OF A SUBFLOW THEN ADDITIONAL INSTANCE THREADS ARE NOT SPAWNED

As of yet it has not made it into any IIB V10 fixpacks.
However, you can request a fix for this via a PMR
_________________
Regards
Craig
Back to top
View user's profile Send private message
mehta10987
PostPosted: Sat Oct 19, 2019 12:44 pm Post subject: Node and flow additional instances Reply with quote

Novice

Joined: 12 Oct 2019
Posts: 10
Location: USA

I have scenario with two Main Flows in one App

Flow1 --> File Input Node(with only one instance) Reading a large file and reading records to put messages into a Queue.

Flow2 --> MQInput Node (multiple instances with Node) reading messages and further activities (calling three backend services) and writing Success and failures Report to two different files through File Output Node.

However the writing success and failure records into two diff files is getting through the subflow.

I am using multiple instances approach for MQInput Node.
IIB version is V10.
Any comments or suggestions
Back to top
View user's profile Send private message
timber
PostPosted: Sun Oct 20, 2019 10:45 am Post subject: Reply with quote

Grand Master

Joined: 25 Aug 2015
Posts: 1046

Not sure about anybody else, but I have no idea what this sentence means:
Quote:
the writing success and failure records into two diff files is getting through the subflow
I have no idea which 'subflow' you are talking about, and I do not know what you mean by 'getting through the subflow'. You will need to supply a *lot* more information if you want to get a useful answer.
Back to top
View user's profile Send private message
mehta10987
PostPosted: Sun Oct 20, 2019 7:21 pm Post subject: Node and flow additional instances Reply with quote

Novice

Joined: 12 Oct 2019
Posts: 10
Location: USA

Sorry for not making statement clear enough

Flow1 --> File Input Node(with only one instance) Reading a large file and reading records to put messages into a Queue.

Flow2 --> MQInput Node (multiple instances with Node) reading messages and further activities (calling three backend services) and writing Success and failures Report to two different files through File Output Node.

In Flow 2 there is a subflow where either records are written into
a Success File or
an Error File where failed records with Error Code/Description/Transaction ID/ Actual record is logged so that business can have a look and work on those failures.
Back to top
View user's profile Send private message
timber
PostPosted: Mon Oct 21, 2019 1:43 am Post subject: Reply with quote

Grand Master

Joined: 25 Aug 2015
Posts: 1046

So this is the same question as http://www.mqseries.net/phpBB2/viewtopic.php?t=64642&start=15&sid=a25218baae467724f24c61689cb3dac3
...but you did not link to the other thread.

Not sure why you are using node-level multithreading. I think there is a viable solution using standard 'additional instances' as described on the other thread. But we have agreed that a delay is a simpler and better solution for this batch job.
Back to top
View user's profile Send private message
mehta10987
PostPosted: Mon Oct 21, 2019 5:16 am Post subject: Reply with quote

Novice

Joined: 12 Oct 2019
Posts: 10
Location: USA

Hello Timber,
Actually there were two questions
One was over the SLEEP approach for the current business functionality to be achieved.
Second: What would be better approach to finish the file(records) processing. Mutithreading of MQ Input Node at Second Flow, OR creating multi instances of overall second Flow.
Back to top
View user's profile Send private message
Display posts from previous:
Post new topicReply to topic Page 1 of 1

MQSeries.net Forum IndexWebSphere Message Broker SupportNode and flow additional instances
Jump to:



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP


Theme by Dustin Baccetti
Powered by phpBB 2001, 2002 phpBB Group

Copyright MQSeries.net. All rights reserved.