| Author |
Message
|
| sundeepelec |
 Posted: Mon Feb 01, 2010 8:44 am Post subject: Fileinput node in Message broker 6.1 |
 |
|
Novice
Joined: 01 Feb 2010
Posts: 15
|
Hi,
I have a requirement in which a file need to be picked up from a folder and processed.We implemented this in MB 6.0 by using FtoQ adapter.
We would like to use Fileinput node now..in MB 6.1
But this method utilizes the CPU resources all the time (as the fileinput node polls the folder continuously)
(setting the polling time to be a long time is one option,but even that is not preferred as the CPU utilization still continues to add up)
Do we have any other ways of implementing this?
Any ideas/suggestions would be grateful...
Thanks,
Allen |
|
| Back to top |
|
 |
| Vitor |
| Posted: Mon Feb 01, 2010 8:50 am Post subject: Re: Fileinput node in Message broker 6.1 |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| sundeepelec wrote: |
Do we have any other ways of implementing this?
|
Aside from polling, what mechanisms are available in your environment for WMB to know that there's a file to be processed?
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| sundeepelec |
| Posted: Mon Feb 01, 2010 9:16 am Post subject: |
|
|
Novice
Joined: 01 Feb 2010
Posts: 15
|
I know only one approach ..using FtoQ adapter,we are trying to implement Fileinputnode...
I am not aware of any other method.
Please let me know the different methods available,if any..
Thanks in advance,
Allen |
|
| Back to top |
|
|
| Vitor |
| Posted: Mon Feb 01, 2010 9:42 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| sundeepelec wrote: |
I know only one approach ..using FtoQ adapter,we are trying to implement Fileinputnode...
I am not aware of any other method.
|
I didn't mean that. What I meant was inside your organisation's design, how would any application (not just WMB) know that there was a file available to be processed? What, apart from polling for the file, would provide this information?
Having determined what other means you can use, you can then see how applicable they are to WMB.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| sundeepelec |
| Posted: Mon Feb 01, 2010 9:54 am Post subject: |
|
|
Novice
Joined: 01 Feb 2010
Posts: 15
|
Thanks for ur replies 
The requirement is to pick up the files only when TWS says us to do so.
We are required to pick up the files from a directory and one of the reasons for moving to TWS triggering is to avoid the continous polling of files.
Unfortunately, we realised that the requirement to pick up the files when indicated is not possible as FileNodes would be polling continously.
We are just looking how we can achieve this. |
|
| Back to top |
|
|
| Vitor |
| Posted: Mon Feb 01, 2010 10:12 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| sundeepelec wrote: |
| The requirement is to pick up the files only when TWS says us to do so. |
If by TWS you do mean Tivoli Workload Scheduler?
So if TWS (whatever it is) is notifying you when the file is available, then it's a technical matter to convert that notification into a form by which you can initiate WMB to process the file. Or just incorporate WMB into the schedule if it is the Tivoli product.
There are a number of possibilities depending on what form the notification takes, or could take (if it's politically possible for you to change it).
More or less striaghtforward. 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| sundeepelec |
| Posted: Mon Feb 01, 2010 9:13 pm Post subject: |
|
|
Novice
Joined: 01 Feb 2010
Posts: 15
|
Yes,it is tivoli workload scheduler,and am not aware of how the notification is sent(am a newbie to WMB )
Can you please tell me how the notifications coulde be....different ways...
Also,let me know possible solution for each different method...
Your suggestions are grateful.
Thanks,
Allen |
|
| Back to top |
|
|
| Vitor |
| Posted: Mon Feb 01, 2010 9:19 pm Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| sundeepelec wrote: |
| Yes,it is tivoli workload scheduler,and am not aware of how the notification is sent(am a newbie to WMB ) |
It's nothing to do with WMB & everything to do with how TWS is configured at your site. You said earlier:
| sundeepelec wrote: |
| The requirement is to pick up the files only when TWS says us to do so |
So ask whoever's running TWS at your site how they plan to tell you; or what their options are given your site rules. Then see which fits best with how you've got WMB set up, or could set it up.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| dk27 |
| Posted: Tue Feb 02, 2010 1:44 am Post subject: |
|
|
Acolyte
Joined: 28 Apr 2008
Posts: 51
|
Write a simple amqsput to trigger a message to MQ queue which will in turn trigger file node.
Schedule this trigger in TWS and set dependency in TWS on file arrival. |
|
| Back to top |
|
|
| PeterPotkay |
| Posted: Tue Feb 02, 2010 4:32 am Post subject: Re: Fileinput node in Message broker 6.1 |
|
|
Poobah
Joined: 15 May 2001
Posts: 7716
|
| sundeepelec wrote: |
(setting the polling time to be a long time is one option,but even that is not preferred as the CPU utilization still continues to add up)
|
That's what CPUs are for. Or are you that pressed for CPU resources on this server? If yes then aren't you concerned what the rest of the nodes in that flow are going to do when a file does arrive? I'm sure they will use more CPU than some simple occasional polling for a file.
_________________
Peter Potkay
Keep Calm and MQ On |
|
| Back to top |
|
|
| sundeepelec |
| Posted: Wed Feb 03, 2010 3:28 am Post subject: |
|
|
Novice
Joined: 01 Feb 2010
Posts: 15
|
| dk27 wrote: |
Write a simple amqsput to trigger a message to MQ queue which will in turn trigger file node.
Schedule this trigger in TWS and set dependency in TWS on file arrival. |
Thanks for your reply..
Can you please explain me the steps to follow to go ahead with this method?
Thanks,
Allen |
|
| Back to top |
|
|
| WMBDEV1 |
| Posted: Wed Feb 03, 2010 3:43 am Post subject: |
|
|
Sentinel
Joined: 05 Mar 2009
Posts: 888
Location: UK
|
| sundeepelec wrote: |
| dk27 wrote: |
Write a simple amqsput to trigger a message to MQ queue which will in turn trigger file node.
Schedule this trigger in TWS and set dependency in TWS on file arrival. |
Thanks for your reply..
Can you please explain me the steps to follow to go ahead with this method?
|
As per this suggestion:
| Vitor wrote: |
| So ask whoever's running TWS at your site how they plan to tell you; or what their options are given your site rules. |
What did this person say were your options? This is the route I would have gone down first, failing that what searches have you done yourself to try and resolve this?
I'm not a TWS expert so I cant offer much help, but you are likely to get a more helpful response from people in the community if you show some proof of effort on your part. |
|
| Back to top |
|
|
| smdavies99 |
| Posted: Wed Feb 03, 2010 3:48 am Post subject: |
|
|
Jedi Council
Joined: 10 Feb 2003
Posts: 6076
Location: Somewhere over the Rainbow this side of Never-never land.
|
| sundeepelec wrote: |
| dk27 wrote: |
Write a simple amqsput to trigger a message to MQ queue which will in turn trigger file node.
Schedule this trigger in TWS and set dependency in TWS on file arrival. |
Thanks for your reply..
Can you please explain me the steps to follow to go ahead with this method?
Thanks,
Allen |
I'm sure a lot of readers of this forum would be interested in how you can make this work. Remember, the FileInputNode is a 'one ended' node. i.e. it has to be the start node of a flow.
_________________
WMQ User since 1999
MQSI/WBI/WMB/'Thingy' User since 2002
Linux user since 1995
Every time you reinvent the wheel the more square it gets (anon). If in doubt think and investigate before you ask silly questions. |
|
| Back to top |
|
|
| Vitor |
| Posted: Wed Feb 03, 2010 4:39 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| smdavies99 wrote: |
| I'm sure a lot of readers of this forum would be interested in how you can make this work. Remember, the FileInputNode is a 'one ended' node. i.e. it has to be the start node of a flow. |
It all depends on what sort of message TWS can or will send. It's not the obvious method. 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| PeterPotkay |
| Posted: Wed Feb 03, 2010 5:55 am Post subject: |
|
|
Poobah
Joined: 15 May 2001
Posts: 7716
|
I see a convoluted solution that is going to use a lot more CPU (that I still don't see how it will work - you can't "trigger" a File Input Node!) than simply using the FileInputNode as it was designed. Dude, just poll for the file. What kind of cpu does this solution have that it can't deal with that overhead? WMB on a 1st gen iPhone or something?
_________________
Peter Potkay
Keep Calm and MQ On |
|
| Back to top |
|
|
|
|
