| Author |
Message
|
| wmbv7newbie |
 Posted: Mon Jan 04, 2016 3:49 am Post subject: Reading Multiple Files using FileRead Node SFTP |
 |
|
Centurion
Joined: 13 May 2014
Posts: 121
|
Hi,
We are using FileRead node to read a no. of files from remote server using SFTP. The file name pattern is something like PM*.csv where * would be timestamp value and we will get multiple files to be picked since its a weekly read. The problem is that we are getting error in case multiple files are found with the matching pattern.
Knowledge centre says -
| Quote: |
| 'If more than one file matches the pattern, and the Action property is set to No action - do nothing to the file, an exception is thrown.' |
We are setting Action property to Delete but still getting the same exception -
| Quote: |
| 'File pattern matched more than one file in the directory' |
Can the node not handle multiple files at source? Can anyone guide.
P.S. - We are using IIBV9 for our development. |
|
| Back to top |
|
 |
| Vitor |
| Posted: Mon Jan 04, 2016 5:14 am Post subject: Re: Reading Multiple Files using FileRead Node SFTP |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| wmbv7newbie wrote: |
| We are using FileRead node to read a no. of files from remote server using SFTP. |
Why not a FileInput node?
| wmbv7newbie wrote: |
| Can the node not handle multiple files at source? |
The FileRead node can't - how can it possibly know which file you mean? The FileInput node can, because each file can be directed to a separate threadf.
| wmbv7newbie wrote: |
| Can anyone guide. |
Don't use the FileRead node.
Also assume I've given you the whole speech on the ills of SFTP, and the woes file based data movement. Both of these can be found in multiple places on the forum. 
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| wmbv7newbie |
| Posted: Mon Jan 04, 2016 5:39 am Post subject: |
|
|
Centurion
Joined: 13 May 2014
Posts: 121
|
The interface is getting triggered via an external party which sends us the request for a no. of interfaces that need to be executed.
Some of these have to read files from a remote directory and process. So cant use FileInput node as the read trigger depends on another flow.
I know about the downside of using file transfers and trust me, I am not in agreement but I have tried and failed to convince  |
|
| Back to top |
|
|
| Vitor |
| Posted: Mon Jan 04, 2016 5:43 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| wmbv7newbie wrote: |
| The interface is getting triggered via an external party which sends us the request for a no. of interfaces that need to be executed. |
So why are they not just sending you the files (push not pull)?
| wmbv7newbie wrote: |
| Some of these have to read files from a remote directory and process. So cant use FileInput node as the read trigger depends on another flow. |
See above.
| wmbv7newbie wrote: |
| I know about the downside of using file transfers and trust me, I am not in agreement but I have tried and failed to convince |
At least we've got that entire discussion out of the way.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Mon Jan 04, 2016 5:47 am Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
| wmbv7newbie wrote: |
The interface is getting triggered via an external party which sends us the request for a no. of interfaces that need to be executed.
Some of these have to read files from a remote directory and process. So cant use FileInput node as the read trigger depends on another flow.
I know about the downside of using file transfers and trust me, I am not in agreement but I have tried and failed to convince |
Can the content of the trigger account for the exact file names ? Or be distinctive enough for you to use a wildcard and come up with a unique response? You might want to look at setting the filename dynamically via the local environment... 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| wmbv7newbie |
| Posted: Mon Jan 04, 2016 5:51 am Post subject: |
|
|
Centurion
Joined: 13 May 2014
Posts: 121
|
Yes. Have setup a discussion if they can send us the exact file names in the trigger.
But will IBM think about this functionality if I raise a PMR? Might help in the long run, if not now. |
|
| Back to top |
|
|
| mqjeff |
| Posted: Mon Jan 04, 2016 5:52 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
| wmbv7newbie wrote: |
Yes. Have setup a discussion if they can send us the exact file names in the trigger.
But will IBM think about this functionality if I raise a PMR? Might help in the long run, if not now. |
The FileRead node is not an Input node.
What you are asking is that the FileRead node send many files down new threads of the message flow.
If you raise a PMR, you are likely to be asked to raise an RFE instead.
_________________
chmod -R ugo-wx / |
|
| Back to top |
|
|
| wmbv7newbie |
| Posted: Mon Jan 04, 2016 5:53 am Post subject: |
|
|
Centurion
Joined: 13 May 2014
Posts: 121
|
| So will an RFE help down the lane? I know I am being stubborn but I just want this to be available at some point. |
|
| Back to top |
|
|
| mqjeff |
| Posted: Mon Jan 04, 2016 5:58 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
| wmbv7newbie wrote: |
| So will an RFE help down the lane? I know I am being stubborn but I just want this to be available at some point. |
An RFE will at least allow the development team to tell you if it will not help down the lane, by indicating that it's a duplicate or that they won't implement it for other reasons.
If they don't say that, then you will get to wait until they do respond, somewhere down the line.
_________________
chmod -R ugo-wx / |
|
| Back to top |
|
|
| Vitor |
| Posted: Mon Jan 04, 2016 6:17 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| mqjeff wrote: |
| wmbv7newbie wrote: |
| So will an RFE help down the lane? I know I am being stubborn but I just want this to be available at some point. |
An RFE will at least allow the development team to tell you if it will not help down the lane, by indicating that it's a duplicate or that they won't implement it for other reasons.
If they don't say that, then you will get to wait until they do respond, somewhere down the line. |
A side benefit is if you don't get a lot of votes for the RFE, you'll know this isn't a feature many people want to use and by extension, helps underline your discussions by pointing out this isn't a popular design pattern you're trying to use.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| wmbv7newbie |
| Posted: Mon Jan 04, 2016 6:35 am Post subject: |
|
|
Centurion
Joined: 13 May 2014
Posts: 121
|
| Thanks everyone. We will try to have a workaround for this but will definitely open an RFE. Atleast will get to know the need for the functionality and I'll have a justification for my leadership here |
|
| Back to top |
|
|
|
|
