| Author |
Message
|
| hellobond070 |
 Posted: Thu Feb 24, 2011 11:09 am Post subject: FileInput Node - Weird Issue |
 |
|
Centurion
Joined: 18 Nov 2009
Posts: 118
|
Hi All,
I have two files that have not got picked from the FTP server.
Files before that have got picked and files that were generated later have got picked.
Just to make sure if the file did not have problems, I did a manual FTP pull. Changed the file name and did a FTP put. The flow picked this file.
But the two files are still lying in the FTP server. The only difference I see is the date. Those two files are 2 day's older. Apart from this the file permissions are same as other files that are getting picked.
Does Fileinput node pick only latest file depending on dates ?? I know this is definitely not true..but could someone explain their thought of what must must be going ON.
Thank you |
|
| Back to top |
|
 |
| Vitor |
| Posted: Thu Feb 24, 2011 11:13 am Post subject: Re: FileInput Node - Weird Issue |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| hellobond070 wrote: |
| Does Fileinput node pick only latest file depending on dates ?? |
No.
Can you open these 2 files with another application? Is it possible the FTP burped and there's still a file handle open on these files preventing WMB access?
Most importantly, do the WMB logs make any reference to these files? Any messages along the lines of "I tried to open this file & you'll never guess what happened....."
What OS are you using? If it's Windows I've found the problem! 
(You've got a weird issue and you're using Windows. It's inevitable sooner or later)
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| hellobond070 |
| Posted: Thu Feb 24, 2011 11:21 am Post subject: |
|
|
Centurion
Joined: 18 Nov 2009
Posts: 118
|
Both the FTP server and the server where Broker is installed are windoews.
As far as I have seen, the FTP file gets picked even when it is worked on. And by manual FTP I am able to download the full file.
I have already checked for File filter and also tried changing teh file filter of the message flow to * so that all files get picked from the FTP server.
But all in vain. These 2 files are still present in the FTP windows server.
Any idea/thought. Thank you. |
|
| Back to top |
|
|
| hellobond070 |
| Posted: Thu Feb 24, 2011 11:22 am Post subject: |
|
|
Centurion
Joined: 18 Nov 2009
Posts: 118
|
| Nothing is getting logged in Windows event viewer where Broker flow is installed. So I do not have any kind of logs showing me that the flow is even attempting to pick the two files. |
|
| Back to top |
|
|
| Vitor |
| Posted: Thu Feb 24, 2011 11:29 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| hellobond070 wrote: |
| Any idea/thought. Thank you. |
Bounce one or both servers? 
I don't know how WMB detects a file via FTP (I'd assume an ftp command) and perhaps a passing IBMer will have more details.
It's clearly something about how those particular files have been written but I've no idea what. Welcome to Windows. 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| bsiggers |
| Posted: Thu Feb 24, 2011 11:36 am Post subject: |
|
|
Acolyte
Joined: 09 Dec 2010
Posts: 53
Location: Vancouver, BC
|
What broker version and fixpack are you running? Be aware that there were quite a few issues with 7.0.0.0 dealing with FileInput on the Windows platform with weird stuff like this, including stuff like weird file locks. These issues were fixed in 7.0.0.1.
BTW, I'm not feeling the love for Windows around here  If you'd ever used the Powershell extensions for MQ, you'd think differently - they're exceptionally good. It's a much better platform since Powershell was introduced and installed by default. I'm platform agnostic myself, having worked with broker/mq now on W2K3/W2K8, Linux and Solaris... and even some MQ on good old OS/2 |
|
| Back to top |
|
|
| Vitor |
| Posted: Thu Feb 24, 2011 11:44 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| bsiggers wrote: |
| BTW, I'm not feeling the love for Windows around here |
It's fair to say I display a slight bias against Windoze, having been bitten by various problems on WinNT/XP/2k/2003/2008/7 & still having been told from time to time that the solution is "to just reboot it and it'll be fine".
Having also used Solaris, AIX, HP-UX, AS/400 (sorry, iSeries) and z/OS I find Windows unique in that it's the only platform where the admins schedule restarts "just in case".
For the record, my current site is exclusively Windows (2003/2008 with some XP & 7) apart from a VSE mainframe. I spend my days feeling like a cat in a shower.
Any bias I display towards the Software Of Doom in no way diminishes the lack of practical advice I have for the OP, nor should it be used as evidence in any purchasing or OS evaluation, etc, etc, etc.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| mqjeff |
| Posted: Thu Feb 24, 2011 11:53 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
There should be *some* message *somewhere* that shows that the FileInput node tried to read these files and failed.
Check the Event Viewer Application log.
Check the console.txt file for the EG (broker workpath/components/<broker>/<eg uuid> or something).
Take a network trace using wireshark or something and watch for the FileInput to do a scan of the directory on the ftp server... |
|
| Back to top |
|
|
| bsiggers |
| Posted: Thu Feb 24, 2011 12:23 pm Post subject: |
|
|
Acolyte
Joined: 09 Dec 2010
Posts: 53
Location: Vancouver, BC
|
| Alternatively, and I'm sure you've probably checked this already, but is your filename regular expression filter correctly setup to make sure that these files will be picked up? |
|
| Back to top |
|
|
| Vitor |
| Posted: Thu Feb 24, 2011 12:25 pm Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| bsiggers wrote: |
| is your filename regular expression filter correctly setup to make sure that these files will be picked up? |
| hellobond070 wrote: |
| also tried changing teh file filter of the message flow to * so that all files get picked from the FTP server |
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| Esa |
| Posted: Fri Feb 25, 2011 12:03 am Post subject: |
|
|
Grand Master
Joined: 22 May 2008
Posts: 1387
Location: Finland
|
Windows has it's own imitation of unix file permissions. It may sometimes even work and then you get these surprising situations 
Open the file properties and check that the user id your flow is using for FTP access has read permission. |
|
| Back to top |
|
|
| mqjeff |
| Posted: Fri Feb 25, 2011 5:28 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
There are also several APARs with FileInput node and FTP traffic, particularly on "odd" FTP servers (and *all* windows based FTP servers are *odd*).
So you may want to make sure you're at the most recent FP of your version. |
|
| Back to top |
|
|
| gerdd |
| Posted: Mon Mar 07, 2011 5:27 am Post subject: |
|
|
Newbie
Joined: 04 Mar 2011
Posts: 8
|
This one may not be Windows specific, I hope I can be forgiven.
You wouldn't happen to have a situation where you actually consume the files (what is your backup disposition? Can you tell?) but for some reason or another something pushes new files with the same name (or even new copies of the same files) down your throat as soon as they can?
To test that, could you rename or move those files and see if they reappear? Could you do that repeatedly?
Is it possible that whoever resurrects those files does so in a well-intended attempt for your flow to complete processing them,while your flow takes one look each time and - figuratively speaking - pukes and drops them as indigestible? Possibly for good reasons?
It might also be interesting to know what sort of output (feedback) is expected as a result of successful processing of these files and if that actually can be demonstrated to have occurred. |
|
| Back to top |
|
|
|
|
