| |
|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
  |
|
| There's no easy way to stop processing duplicate files |
« View previous topic :: View next topic » |
| Author |
Message
|
| mqpaul |
 Posted: Wed Apr 09, 2008 3:00 am Post subject: There's no easy way to stop processing duplicate files |
 |
|
Acolyte
Joined: 14 Jan 2008
Posts: 66
Location: Hursley, UK
|
| Quote: |
| We are using FileInput node. We do not want duplicate files to be processed. Is there a way to implement this without using a database. |
IMHO database is the best way. The problem is how to determine a duplicate file; in your case, you want unique file names. Is this "unique forever", or just "unique this month"? Whichever, you need a table of files already processed; for "unique this month" you clear that list monthly, or regularly delete rows more than 31 days old, or whatever your business needs.
Trying to do it with the FileInput node directly won't work; it would need to know which files have previously been processed, which would need a database entry, and we're back to your starting point.
You might think you could use the "move to archive" processing combined with not setting "Replace duplicate archives", but that won't work. Archive processing takes place after the downstream processing has finished, so it's too late to prevent the file being processed.
An alternative can be to process the file twice, and rely on downstream flows to reject duplicate transactions. For example, if files contain unique order numbers, the downstream order process could reject duplicates. Of course, this is the same a using a database, just the database is the one used by the order processing, and it rejects duplicate order numbers instead of duplicate file names.
_________________
Paul |
|
| Back to top |
|
 |
| jefflowrey |
| Posted: Wed Apr 09, 2008 4:07 am Post subject: |
|
|
Grand Poobah
Joined: 16 Oct 2002
Posts: 19981
|
|
| Back to top |
|
|
|
|
|
| |
|
Page 1 of 1 |
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
