| Author |
Message
|
| Michael Dag |
 Posted: Wed Nov 27, 2024 5:48 am Post subject: Request for supporting votes! Streaming Queue |
 |
|
Jedi Knight
Joined: 13 Jun 2002
Posts: 2607
Location: The Netherlands (Amsterdam)
|
Since MQ v9.2.3 CD we have Streaming Queue support for Local Qeueus, allowing you to stream a 'near' copy of the message
ARRIVING in the local queue to be sent to any other environment for analysis or re-use, like KAFKA or ELK stacks.
The Streaming Queue support was an alternative to the original requirement to duplicate messages in MQ:
adding the STREAMQ and STRMQOS attributes to QLOCAL objects allow you to duplicate a message to another Queue,
this can be a QALIAS or QREMOTE, however this is the 'near' copy and not the ACTUAL copy.
So if you want to Stream a message from an 'outbound' Queue, like a QREMOTE there is no way to do this currently!
Obviously you can use Exits to do this on most platforms, but for example on MQApplicance or MQ on Cloud Services you can not use Exits.
I always thought this capability would be added automatically to other Queue Type like QREMOTE and QLOCAL was only the first implementation in CD release v9.2.3
Now we are at CD release v9.4.1 and working on v9.4.2 and a lot of attention to Event Processing is going on, but still NO Streaming Queue support for QREMOTE.
To make a long story short, if you want this, it won't happen automagically and so please express your support for the RFE to inform IBM of real interest for this requirement!
Please express your interest and vote for this RFE: https://integration-development.ideas.ibm.com/ideas/MESNS-I-361
Thank you!
Michael Dag
https://www.mqsystems.com
_________________
Michael
MQSystems Facebook page
Last edited by Michael Dag on Thu Nov 28, 2024 2:59 pm; edited 1 time in total |
|
| Back to top |
|
 |
| gbaddeley |
| Posted: Thu Nov 28, 2024 2:35 pm Post subject: |
|
|
Jedi Knight
Joined: 25 Mar 2003
Posts: 2538
Location: Melbourne, Australia
|
|
| Back to top |
|
|
| Michael Dag |
| Posted: Thu Nov 28, 2024 2:58 pm Post subject: |
|
|
Jedi Knight
Joined: 13 Jun 2002
Posts: 2607
Location: The Netherlands (Amsterdam)
|
|
| Back to top |
|
|
| gbaddeley |
| Posted: Thu Nov 28, 2024 4:06 pm Post subject: |
|
|
Jedi Knight
Joined: 25 Mar 2003
Posts: 2538
Location: Melbourne, Australia
|
Yes, I've voted for this 3 year old idea, and many other MQ ideas.
_________________
Glenn |
|
| Back to top |
|
|
| Michael Dag |
| Posted: Fri Dec 06, 2024 12:43 am Post subject: |
|
|
Jedi Knight
Joined: 13 Jun 2002
Posts: 2607
Location: The Netherlands (Amsterdam)
|
|
| Back to top |
|
|
| PeterPotkay |
| Posted: Fri Dec 06, 2024 3:21 pm Post subject: |
|
|
Poobah
Joined: 15 May 2001
Posts: 7722
|
I added my vote
_________________
Peter Potkay
Keep Calm and MQ On |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Sun Dec 08, 2024 4:56 pm Post subject: Re: Request for supporting votes! Streaming Queue |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
| Michael Dag wrote: |
So if you want to Stream a message from an 'outbound' Queue, like a QREMOTE there is no way to do this currently!
Obviously you can use Exits to do this on most platforms, but for example on MQApplicance or MQ on Cloud Services you can not use Exits.
I always thought this capability would be added automatically to other Queue Type like QREMOTE and QLOCAL was only the first implementation in CD release v9.2.3
Now we are at CD release v9.4.1 and working on v9.4.2 and a lot of attention to Event Processing is going on, but still NO Streaming Queue support for QREMOTE.
|
Hi Michael,
Do you need specific attributes for the remote queue / local queue in your stream?
Because if you want to stream a remote queue all you have to do is
- Create a local queue with streaming to the remote queue
- Change the application's QAlias to point to the newly created local queue
Now if you wanted to distribute the messages , that is what the distribution list and pub/sub are for...
Hope it helps 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| Michael Dag |
| Posted: Mon Dec 09, 2024 1:49 am Post subject: |
|
|
Jedi Knight
Joined: 13 Jun 2002
Posts: 2607
Location: The Netherlands (Amsterdam)
|
Hi FJ,
The scenario you describe can work (obviously I tried) if you:
a) are sure there are no flags in the original message that are turned off for the 'near' identical streamed message
b) you can work with the application team to change the queue names, ie this is not something an MQ Admin can do on his own
to replicate traffic permanently or temporarily.
Having the Streaming Queue support attributes also on QREMOTE makes live so much easier than having to jump through hoops and not always getting what you need.
Michael
_________________
Michael
MQSystems Facebook page |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Tue Dec 10, 2024 6:14 am Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
| Michael Dag wrote: |
Hi FJ,
The scenario you describe can work (obviously I tried) if you:
a) are sure there are no flags in the original message that are turned off for the 'near' identical streamed message
b) you can work with the application team to change the queue names, ie this is not something an MQ Admin can do on his own
to replicate traffic permanently or temporarily.
Having the Streaming Queue support attributes also on QREMOTE makes live so much easier than having to jump through hoops and not always getting what you need.
Michael |
Hi Michael,
Disagree with point b). No need to change the app queue. Just change it from a QR to a QA and point it to the Stream queue. Then the stream queue will stream to the QR. Obviously if you need some specific flags that cannot be set with streaming, you may have to look at a different solution...
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| Michael Dag |
| Posted: Tue Dec 10, 2024 6:31 am Post subject: |
|
|
Jedi Knight
Joined: 13 Jun 2002
Posts: 2607
Location: The Netherlands (Amsterdam)
|
| fjb_saper wrote: |
Hi Michael,
Disagree with point b). No need to change the app queue. Just change it from a QR to a QA and point it to the Stream queue. Then the stream queue will stream to the QR. Obviously if you need some specific flags that cannot be set with streaming, you may have to look at a different solution...
|
first you need to delete the QR to create a QA with the same name without changes to the App Queue Name in the App, potentially the App in PROD would get a 2085... more probable the App has the queue open for output most of the time and you can't delete the QR at all...
The RFE is now finally under re-review again so we will see whether we will get the QREMOTE Streaming Support or not very soon 
_________________
Michael
MQSystems Facebook page |
|
| Back to top |
|
|
| gbaddeley |
| Posted: Tue Dec 10, 2024 3:46 pm Post subject: |
|
|
Jedi Knight
Joined: 25 Mar 2003
Posts: 2538
Location: Melbourne, Australia
|
| Quote: |
| first you need to delete the QR to create a QA with the same name without changes to the App Queue Name in the App, potentially the App in PROD would get a 2085... more probable the App has the queue open for output most of the time and you can't delete the QR at all... |
Yes, QR delete will fail with "object in use" error. The queue open handles will actually be on the transmission queue.
ALTER QREMOTE has a FORCE option, but unfortunately DELETE QREMOTE does not.
Deleting a QR to create a QA needs to be done at a time when the producer app does not have the queue open. I have done this several times, to change a QR messaging interface to a QA resolving to a TOPIC, so that msgs could be duplicated to multiple destinations via pub-sub (with no changes to the app).
_________________
Glenn |
|
| Back to top |
|
|
|
|
