ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » General Discussion » Using Pub/Sub to send grouped messages in a clustered env

Post new topic  Reply to topic
 Using Pub/Sub to send grouped messages in a clustered env « View previous topic :: View next topic » 
Author Message
dwitherspoon
PostPosted: Thu Oct 28, 2004 12:10 pm    Post subject: Using Pub/Sub to send grouped messages in a clustered env Reply with quote

Acolyte

Joined: 09 Dec 2003
Posts: 59

Hi folks,

If I wanted to send lots of files to lots of receivers, and break them up into chunks (an MQ group of messages), is it reasonable that I could do that using Pub/Sub in a clustered environment?

I am guaranteed of having multiple subscribers to the same topic (for load-balancing and failover). I've done some pub/sub stuff before using JMS, but I don't have a way of requiring that all the messages in a group come to the same receiver, that they don't start being delivered to the receiver until they've all landed, and to get them in the same order. Since these would be files, I'd really want to have that level of control. But I'm not sure how that work through pub/sub.

I'd appreciate some sage advice, as I think my project is about to take a turn down a dark road!
_________________
Good...Fast...Cheap. Choose any two.
Back to top
View user's profile Send private message
jefflowrey
PostPosted: Thu Oct 28, 2004 12:21 pm    Post subject: Reply with quote

Grand Poobah

Joined: 16 Oct 2002
Posts: 19981

If you use pub/sub, and you have multiple subscribers to the same topic, then *all* messages for that topic will go to *all* subscribers.

So every subscriber will get every file.
_________________
I am *not* the model of the modern major general.
Back to top
View user's profile Send private message
EddieA
PostPosted: Thu Oct 28, 2004 12:31 pm    Post subject: Reply with quote

Jedi

Joined: 28 Jun 2001
Posts: 2453
Location: Los Angeles

I don't think it will with JMS, because that doesn't have the required control over the Group options.

If you can live without JMS, then why don't you try publishing a message with the Group options set, and check at the Subscription queue to see if they "survive" through the Broker.

If they do, then all you need to do is Publish, using the Group, and code your Subscribers to use the Complete Group option.

If you must use JMS, then you are into building your own "Group" information in the Properties.

Cheers,
_________________
Eddie Atherton
IBM Certified Solution Developer - WebSphere Message Broker V6.1
IBM Certified Solution Developer - WebSphere Message Broker V7.0
Back to top
View user's profile Send private message
EddieA
PostPosted: Thu Oct 28, 2004 12:34 pm    Post subject: Reply with quote

Jedi

Joined: 28 Jun 2001
Posts: 2453
Location: Los Angeles

But I also spotted:
Quote:
using Pub/Sub in a clustered environment

This might cause you some problems, if there is more than a single copy of a Subscription queue. You will have no control (well, not easily) over which one each message in the Group is sent to.

Cheers,
_________________
Eddie Atherton
IBM Certified Solution Developer - WebSphere Message Broker V6.1
IBM Certified Solution Developer - WebSphere Message Broker V7.0
Back to top
View user's profile Send private message
dwitherspoon
PostPosted: Fri Oct 29, 2004 5:21 am    Post subject: Reply with quote

Acolyte

Joined: 09 Dec 2003
Posts: 59

Thanks for all this info! I read on a older post that the STREAM underlying the pub/sub mechanisms cannot be a clustered queue. Not sure why. Can anyone confirm whether that is the case, and if so why?

Thanks all!
_________________
Good...Fast...Cheap. Choose any two.
Back to top
View user's profile Send private message
EddieA
PostPosted: Fri Oct 29, 2004 7:13 am    Post subject: Reply with quote

Jedi

Joined: 28 Jun 2001
Posts: 2453
Location: Los Angeles

I don't have a copy handy, but if you pull the PDF for the original SupportPac Pub/Sub Broker, and search for Cluster, it has a section on which queues cannot be clustered.

Plus, as I pointed out earlier, if any of the Subscribers receive the information on a Cluster Q, then you have to think what happens when different Publications go to different copies of the Subscriber Q.

Cheers,
_________________
Eddie Atherton
IBM Certified Solution Developer - WebSphere Message Broker V6.1
IBM Certified Solution Developer - WebSphere Message Broker V7.0
Back to top
View user's profile Send private message
bower5932
PostPosted: Fri Oct 29, 2004 7:24 am    Post subject: Reply with quote

Jedi Knight

Joined: 27 Aug 2001
Posts: 3023
Location: Dallas, TX, USA

Without knowing for a fact, I'd guess that the stream queue can't be clustered because it contains state. It is where things go that the broker needs to know about. If messages were just round-robining around the cluster, brokers wouldn't know what is going on regarding publishes and subscribes.
Back to top
View user's profile Send private message Send e-mail Visit poster's website AIM Address Yahoo Messenger
Display posts from previous:   
Post new topic  Reply to topic Page 1 of 1

MQSeries.net Forum Index » General Discussion » Using Pub/Sub to send grouped messages in a clustered env
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.