ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum IndexGeneral IBM MQ SupportMQ - Queue dedupping? Remove duplicate messages

Post new topicReply to topic
MQ - Queue dedupping? Remove duplicate messages View previous topic :: View next topic
Author Message
rattray
PostPosted: Tue Nov 20, 2018 3:53 pm Post subject: MQ - Queue dedupping? Remove duplicate messages Reply with quote

Newbie

Joined: 20 Nov 2018
Posts: 1

Do the newer versions of MQ have built in "dedupping" logic?

e.g. if duplicate messages are dropped on a queue can we set some configurable value to dedup the second instance based on some key?

I'm pretty sure the answer is no just wanted to verify my assumption.
Back to top
View user's profile Send private message
bruce2359
PostPosted: Tue Nov 20, 2018 7:57 pm Post subject: Reply with quote

Poobah

Joined: 05 Jan 2008
Posts: 8219
Location: US: west coast, almost. Otherwise, enroute.

You are correct - the answer is no.
_________________
There are two types of people in this world:
1) Those that can extrapolate from incomplete data
Back to top
View user's profile Send private message
gbaddeley
PostPosted: Wed Nov 21, 2018 2:28 pm Post subject: Reply with quote

Padawan

Joined: 25 Mar 2003
Posts: 1909
Location: Melbourne, Australia

There are many possible criteria for a "duplicate" message. If MQ had this feature, there would be a lot of options around which MQMD fields, RFH elements and data that would be included. As MQ messages are ephemeral, and queue depths can go up and down unpredictably, there would also need to be a time constraint.

If your application has a design requirement to dedup, the logic needs to be build into the app. Sorry about that.

You could try creating a RFE with IBM.
_________________
Glenn
Back to top
View user's profile Send private message
bruce2359
PostPosted: Wed Nov 21, 2018 4:10 pm Post subject: Reply with quote

Poobah

Joined: 05 Jan 2008
Posts: 8219
Location: US: west coast, almost. Otherwise, enroute.

Is your app designed to duplicate messages on purpose? Are the duplicates identical as to MQMD, RFH, and app data?
_________________
There are two types of people in this world:
1) Those that can extrapolate from incomplete data
Back to top
View user's profile Send private message
gbaddeley
PostPosted: Sun Nov 25, 2018 2:48 pm Post subject: Reply with quote

Padawan

Joined: 25 Mar 2003
Posts: 1909
Location: Melbourne, Australia

Actually, any MQ consumer app should be tolerant of duplicate and missing messages in a business functional sense. MQ assures delivery of persistent messages, but they may be delayed or arrive on the destination queue out of order, or the source app may not be producing them as expected (the most common scenario).
_________________
Glenn
Back to top
View user's profile Send private message
bruce2359
PostPosted: Sun Nov 25, 2018 3:55 pm Post subject: Reply with quote

Poobah

Joined: 05 Jan 2008
Posts: 8219
Location: US: west coast, almost. Otherwise, enroute.

gbaddeley wrote:
Actually, any MQ consumer app should be tolerant of duplicate and missing messages in a business functional sense. MQ assures delivery of persistent messages, but they may be delayed or arrive on the destination queue out of order, or the source app may not be producing them as expected (the most common scenario).

A well-written app should, but Ive seen few that are.
_________________
There are two types of people in this world:
1) Those that can extrapolate from incomplete data
Back to top
View user's profile Send private message
Display posts from previous:
Post new topicReply to topic Page 1 of 1

MQSeries.net Forum IndexGeneral IBM MQ SupportMQ - Queue dedupping? Remove duplicate messages
Jump to:



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP


Theme by Dustin Baccetti
Powered by phpBB 2001, 2002 phpBB Group

Copyright MQSeries.net. All rights reserved.