ASG
IBM
Zystems
Cressida
Icon
Netflexity
 
  MQSeries.net
Search  Search       Tech Exchange      Education      Certifications      Library      Info Center      SupportPacs      LinkedIn  Search  Search                                                                   FAQ  FAQ   Usergroups  Usergroups
 
Register  ::  Log in Log in to check your private messages
 
RSS Feed - WebSphere MQ Support RSS Feed - Message Broker Support

MQSeries.net Forum Index » General IBM MQ Support » IBM MQ HA/multi-instance with glusterfs replicated storage

Post new topic  Reply to topic Goto page 1, 2  Next
 IBM MQ HA/multi-instance with glusterfs replicated storage « View previous topic :: View next topic » 
Author Message
Ganford
PostPosted: Wed Jul 22, 2020 7:08 am    Post subject: IBM MQ HA/multi-instance with glusterfs replicated storage Reply with quote

Novice

Joined: 09 Aug 2011
Posts: 22

Hi guys,

Is there maybe someone who would like to share some tips and knowledge about the setup of MQ HA/multi-instance with glusterfs replicated storage?

I was testing it for a longer time and we have even implemented some solutions based on this setup. Initially it felt like a decent solution, but during the time it feels like absolute failure.

Most of the issues are related to failing lock-release on mq files.

I know that IBM lists this solution as not working, but maybe somebody was able to implement some workaround. 

I will be glad for open discussion here )

Thanks,
Back to top
View user's profile Send private message
bruce2359
PostPosted: Wed Jul 22, 2020 10:22 am    Post subject: Reply with quote

Poobah

Joined: 05 Jan 2008
Posts: 9394
Location: US: west coast, almost. Otherwise, enroute.

Where and why does IBM say that glusterfs is not working?
_________________
I like deadlines. I like to wave as they pass by.
ב''ה
Lex Orandi, Lex Credendi, Lex Vivendi. As we Worship, So we Believe, So we Live.
Back to top
View user's profile Send private message
Ganford
PostPosted: Thu Jul 23, 2020 1:29 am    Post subject: Reply with quote

Novice

Joined: 09 Aug 2011
Posts: 22

bruce2359 wrote:
Where and why does IBM say that glusterfs is not working?


In this page:

https://www.ibm.com/support/pages/testing-statement-ibm-mq-multi-instance-queue-manager-file-systems

"
The following file systems are known not to work as they do not meet IBM MQ's technical requirements:
Gluster V3.x, V4.x, and V5.x, using the Gluster Native (FUSE) client
"
Back to top
View user's profile Send private message
exerk
PostPosted: Thu Jul 23, 2020 1:34 am    Post subject: Reply with quote

Jedi Council

Joined: 02 Nov 2006
Posts: 6339

Ganford wrote:
In this page:

https://www.ibm.com/support/pages/testing-statement-ibm-mq-multi-instance-queue-manager-file-systems

"
The following file systems are known not to work as they do not meet IBM MQ's technical requirements:
Gluster V3.x, V4.x, and V5.x, using the Gluster Native (FUSE) client
"

And are you using the native Gluster Native (FUSE) client?
_________________
It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys.
Back to top
View user's profile Send private message
Ganford
PostPosted: Thu Jul 23, 2020 2:02 am    Post subject: Reply with quote

Novice

Joined: 09 Aug 2011
Posts: 22

exerk wrote:
Ganford wrote:
In this page:

https://www.ibm.com/support/pages/testing-statement-ibm-mq-multi-instance-queue-manager-file-systems

"
The following file systems are known not to work as they do not meet IBM MQ's technical requirements:
Gluster V3.x, V4.x, and V5.x, using the Gluster Native (FUSE) client
"

And are you using the native Gluster Native (FUSE) client?


Yes, We are. I want to try different approach over NFS mount, but my first tyr has failed so I need repeat it again. Still I have worries that it will not lead anywhere, I have at least not found anywhere information about such setup to work.

Did you tried to use any application which requires lock-release by your self ? )

I ahve also found interesting topic here, which is related to DB:
https://serverfault.com/questions/171166/can-i-run-mysqld-on-top-of-glusterfs
Back to top
View user's profile Send private message
exerk
PostPosted: Thu Jul 23, 2020 2:16 am    Post subject: Reply with quote

Jedi Council

Joined: 02 Nov 2006
Posts: 6339

Ganford wrote:
exerk wrote:
And are you using the native Gluster Native (FUSE) client?


Yes, We are...

Then it's not going to work, and even if by some magical juju someone manages to do it's unlikely to be supported by IBM.

Ganford wrote:
...Did you tried to use any application which requires lock-release by your self ?...

Yes. Using a supported file system, one that was not using replication (how do you replicate file locks anyway?), and following the procedures for a supported MQ MI installation.

MQ is not a DB so what may work for a DB will not necessarily do so for MQ, and even if it does it may not be supported.
_________________
It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys.
Back to top
View user's profile Send private message
Ganford
PostPosted: Thu Jul 23, 2020 2:44 am    Post subject: Reply with quote

Novice

Joined: 09 Aug 2011
Posts: 22

exerk wrote:
Ganford wrote:
exerk wrote:
And are you using the native Gluster Native (FUSE) client?


Yes, We are...

Then it's not going to work, and even if by some magical juju someone manages to do it's unlikely to be supported by IBM.

Ganford wrote:
...Did you tried to use any application which requires lock-release by your self ?...

Yes. Using a supported file system, one that was not using replication (how do you replicate file locks anyway?), and following the procedures for a supported MQ MI installation.

MQ is not a DB so what may work for a DB will not necessarily do so for MQ, and even if it does it may not be supported.


I understand you very well. I have also experience with Veritas, AIX HACM, RDQM, there is problem that nobody want to invest in such solutions.

I feel like to be stuck with impossible request to achieve high availability on corporate level with almost 0 resources.

To use MQ cluster is not option, because I will not get application development support for that.

There is also CEPH Storage, but it seem to contain bug and therefore is is also not suitable run IBM MQ.

So this is the reason why I keep trying to make it work with glusterfs
Back to top
View user's profile Send private message
exerk
PostPosted: Thu Jul 23, 2020 2:51 am    Post subject: Reply with quote

Jedi Council

Joined: 02 Nov 2006
Posts: 6339

Ganford wrote:
I understand you very well. I have also experience with Veritas, AIX HACM, RDQM, there is problem that nobody want to invest in such solutions...

As is usually the case: a Rolls-Royce solution wanted for the price of a Trabant...

Ganford wrote:
...I feel like to be stuck with impossible request to achieve high availability on corporate level with almost 0 resources...

Welcome to the world of many of us...

Ganford wrote:
...To use MQ cluster is not option, because I will not get application development support for that...

Presumably they want a 'service' but aren't prepared to do their bit to achieve it?

Ganford wrote:
...There is also CEPH Storage, but it seem to contain bug and therefore is is also not suitable run IBM MQ.

So this is the reason why I keep trying to make it work with glusterfs

My advice is to stop trying to make it work with an unsupported solution because when it all goes wrong the powers-that-be will forget they wouldn't give you the resources to deliver a supported solution, and will hang-draw-and-quarter you for providing an unsupported one.
_________________
It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys.
Back to top
View user's profile Send private message
fjb_saper
PostPosted: Thu Jul 23, 2020 4:40 am    Post subject: Reply with quote

Grand High Poobah

Joined: 18 Nov 2003
Posts: 20696
Location: LI,NY

exerk wrote:
Ganford wrote:
I understand you very well. I have also experience with Veritas, AIX HACM, RDQM, there is problem that nobody want to invest in such solutions...

As is usually the case: a Rolls-Royce solution wanted for the price of a Trabant...

You should at least downgrade that to a Wartburg...
_________________
MQ & Broker admin
Back to top
View user's profile Send private message Send e-mail
Vitor
PostPosted: Thu Jul 23, 2020 5:10 am    Post subject: Reply with quote

Grand High Poobah

Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA

exerk wrote:
Ganford wrote:
exerk wrote:
And are you using the native Gluster Native (FUSE) client?


Yes, We are...

Then it's not going to work, and even if by some magical juju someone manages to do it's unlikely to be supported by IBM.




It's like looking in the manual for your car, seeing "minimum 98 octane" and seeing if you can get it going on a combination of peanut oil & moonshine. You might get it started, but how long and how reliably is anyone's guess. But you certainly won't get it fixed under the warrenty.
_________________
Honesty is the best policy.
Insanity is the best defence.
Back to top
View user's profile Send private message
exerk
PostPosted: Thu Jul 23, 2020 5:18 am    Post subject: Reply with quote

Jedi Council

Joined: 02 Nov 2006
Posts: 6339

fjb_saper wrote:
exerk wrote:
Ganford wrote:
I understand you very well. I have also experience with Veritas, AIX HACM, RDQM, there is problem that nobody want to invest in such solutions...

As is usually the case: a Rolls-Royce solution wanted for the price of a Trabant...

You should at least downgrade that to a Wartburg...

They were more 'luxury' end of the market compared to a Trabbie
_________________
It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys.
Back to top
View user's profile Send private message
Vitor
PostPosted: Thu Jul 23, 2020 5:35 am    Post subject: Reply with quote

Grand High Poobah

Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA

fjb_saper wrote:
exerk wrote:
Ganford wrote:
I understand you very well. I have also experience with Veritas, AIX HACM, RDQM, there is problem that nobody want to invest in such solutions...

As is usually the case: a Rolls-Royce solution wanted for the price of a Trabant...

You should at least downgrade that to a Wartburg...


I had a friend growing up who's family owned a Wartburg. I accept that it sounds highly improbable, as does the claim I had a friend growing up. It was a different time, I was a different person.......

But this penny pinching is an ongoing problem. As part of my duties, I was forced to deny an application team who'd decided not to pay for the enterprise standard software for a given solution (nothing MQ / IIB, another part of my brief) but had used magical juju to develop their own solution.

After much wrangling and a couple of games of "who's got the biggest stick", I was overruled. They pointed out that they'd been using it in QA for months without issues, they didn't have time or budget to figure out my solution architecture and they didn't care how many desks I chewed through. I took it well and my team was able to talk to me face to face only 2 days later.

On the designated Monday, I asked (as I routinely did) if they'd been any problems with the weekend implementations; both to see how many fires I needed to put out and to see if they'd had any problems going live I could gloat over. It had gone live 2am Saturday morning, crashed 5pm Saturday evening and they'd given up on it 4am Sunday morning because it wouldn't stay up for more than 30 minutes.

I laughed so hard I literally wet myself. I had to go home and change, and my team had to up their meds because my cackle had freaked them out.
_________________
Honesty is the best policy.
Insanity is the best defence.
Back to top
View user's profile Send private message
exerk
PostPosted: Thu Jul 23, 2020 11:59 am    Post subject: Reply with quote

Jedi Council

Joined: 02 Nov 2006
Posts: 6339

Vitor wrote:
...I laughed so hard I literally wet myself. I had to go home and change, and my team had to up their meds because my cackle had freaked them out.

Thankfully, I did not have to mop up after you...
_________________
It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys.
Back to top
View user's profile Send private message
belchman
PostPosted: Sat Aug 01, 2020 2:17 am    Post subject: Reply with quote

Partisan

Joined: 31 Mar 2006
Posts: 386
Location: Ohio, USA

If your contact admin storage facility and your network is not bulletproof, I advise you to use RDQM instead of multi-instance.

We've had so many issues with multi-instance, we have to back them out and replace them. They work as designed but if your apps cannot tolerate them failing back and forth frequently, you are asking for pain.
_________________
Make three correct guesses consecutively and you will establish a reputation as an expert. ~ Laurence J. Peter
Back to top
View user's profile Send private message
Ganford
PostPosted: Wed Aug 12, 2020 7:01 am    Post subject: Reply with quote

Novice

Joined: 09 Aug 2011
Posts: 22

belchman wrote:
If your contact admin storage facility and your network is not bulletproof, I advise you to use RDQM instead of multi-instance.

We've had so many issues with multi-instance, we have to back them out and replace them. They work as designed but if your apps cannot tolerate them failing back and forth frequently, you are asking for pain.


I would love to do this, but there are higher license costs. I will fight little bit glusterFS setup over nfs. I still have some issue there.

Still, I did also another research on internet, and looks like that maybe only "free" alternative will be some kind of DRBD home made solution.
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic  Reply to topic Goto page 1, 2  Next Page 1 of 2

MQSeries.net Forum Index » General IBM MQ Support » IBM MQ HA/multi-instance with glusterfs replicated storage
Jump to:  



You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Protected by Anti-Spam ACP
 
 


Theme by Dustin Baccetti
Powered by phpBB © 2001, 2002 phpBB Group

Copyright © MQSeries.net. All rights reserved.