| Author |
Message
|
| sushilishere |
 Posted: Thu Jun 10, 2010 12:45 am Post subject: Polling Interval Issue With FileInput Node |
 |
|
Apprentice
Joined: 27 Jul 2008
Posts: 36
|
Hi all,
I have set the polling interval in my FileInput Node to 120 seconds.
The msgflow reads the input file and once the set logic in it fails sends to a Message Queue.
The flow associated with this Message Queue kinda checks for more condition and once it fails there places the message back into this File Location.
( In short, the message flow associated with the FileInput node is for a retry purpose, with some logic in it to decide whether it should retry or not)
Issue :
Lets call the flow with the FileInput node as Flow1 and with MQInput as Flow2.
Flow1 is started, picks all the files and few files are sent to Flow2. Since the logic fails in Flow2, it is sent back to Flow1 for retry.
Now.. since the polling has already occured, this file for retry should be picked after 120 secs. But it is picked immediately as if it was a part of the first collection of files picked. What this does is, it creates a bunch of extra archive files creating confusion on the number of times it has archived!!
What i want to know is how long does the FileInput node look at the directory mentioned or is there any interval for it internally??
_________________
----------------------------
IBM MQ v6.0 Sys Admin
IBM MBv6.0 Sol Desgnr
----------------------------------------------------
By the Mountain Side.. looking at the Great Divide
---------------------------------------------------- |
|
| Back to top |
|
 |
| mqjeff |
| Posted: Thu Jun 10, 2010 1:52 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
Once a message has passed out of a flow started with FileInput entirely - once that flow has completed - then there is no way to tell the FileInput node to treat any file it sees as being a RETRY of that instance of the flow.
Just like you can never tell MQInput to rollback a message after you've completed the flow that processed that message.
As for polling interval, look at the docs. |
|
| Back to top |
|
|
| sushilishere |
| Posted: Thu Jun 10, 2010 2:13 am Post subject: |
|
|
Apprentice
Joined: 27 Jul 2008
Posts: 36
|
Accepted!!
But how can the FileInputNode, once it has picked the set of files in one go , pick a newly placed file. Doesnt that defeat the purpose of having a polling interval in the node property??
It shd have done in the following Seq :
poll at the directory --> process the picked files --> Wait for 120 secs( as i have set tat in polling interval) --> poll again at the directory.
If it picks the next set of files then again my previous qs comes in??
How long does it look at the folder ?? And cld u plz guide to a link or any redbook title which has details on this!!!
_________________
----------------------------
IBM MQ v6.0 Sys Admin
IBM MBv6.0 Sol Desgnr
----------------------------------------------------
By the Mountain Side.. looking at the Great Divide
---------------------------------------------------- |
|
| Back to top |
|
|
| fatherjack |
| Posted: Thu Jun 10, 2010 2:54 am Post subject: Re: Polling Interval Issue With FileInput Node |
|
|
Knight
Joined: 14 Apr 2010
Posts: 522
Location: Craggy Island
|
| sushilishere wrote: |
| But it is picked immediately as if it was a part of the first collection of files picked. |
| sushilishere wrote: |
| But how can the FileInputNode, once it has picked the set of files in one go , pick a newly placed file. |
Where has the concept of a collection or set of files come from?
_________________
Never let the facts get in the way of a good theory. |
|
| Back to top |
|
|
| sushilishere |
| Posted: Thu Jun 10, 2010 3:53 am Post subject: |
|
|
Apprentice
Joined: 27 Jul 2008
Posts: 36
|
Manual Check..
Just placed a bunch of files(say 20) in the location. Started the flow and all the files were picked.
The polling interval of the FileInput Node was placed at 120 secs.
Once it picked the 20 files, any file placed next was picked after an interval of 120 secs.
If it was picking one file at a time then each of the 20 files should have picked at an interval of 120 secs ..
Hence rests my "assumption"
_________________
----------------------------
IBM MQ v6.0 Sys Admin
IBM MBv6.0 Sol Desgnr
----------------------------------------------------
By the Mountain Side.. looking at the Great Divide
---------------------------------------------------- |
|
| Back to top |
|
|
| fatherjack |
| Posted: Thu Jun 10, 2010 4:12 am Post subject: |
|
|
Knight
Joined: 14 Apr 2010
Posts: 522
Location: Craggy Island
|
| sushilishere wrote: |
Manual Check..
Just placed a bunch of files(say 20) in the location. Started the flow and all the files were picked.
The polling interval of the FileInput Node was placed at 120 secs.
Once it picked the 20 files, any file placed next was picked after an interval of 120 secs.
If it was picking one file at a time then each of the 20 files should have picked at an interval of 120 secs ..
Hence rests my "assumption" |
Wrong assumption. The FileInput node will pick up one file at a time but will only sleep for 120 secs when there are no more files in the directory.
_________________
Never let the facts get in the way of a good theory. |
|
| Back to top |
|
|
| mqjeff |
| Posted: Thu Jun 10, 2010 4:28 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
Pretend that the file node works like this:
1) it generates a list of files in the directory
2) it processes each file, one at a time, from that list that it is "supposed" to process according to the criteria it has been configured with
3) It then waits for the polling interval
4) it then goes to step 1. |
|
| Back to top |
|
|
| sushilishere |
| Posted: Thu Jun 10, 2010 5:36 am Post subject: |
|
|
Apprentice
Joined: 27 Jul 2008
Posts: 36
|
That kinda clears my doubts and my wrong assumption 
Thanks Guyz for yet again saving the DAY.!!!
_________________
----------------------------
IBM MQ v6.0 Sys Admin
IBM MBv6.0 Sol Desgnr
----------------------------------------------------
By the Mountain Side.. looking at the Great Divide
---------------------------------------------------- |
|
| Back to top |
|
|
|
|
