| Author |
Message
|
| sudeepm |
 Posted: Tue Jul 26, 2011 5:26 am Post subject: using Extreme scale with message broker |
 |
|
Acolyte
Joined: 31 Jan 2008
Posts: 57
|
We are exploring the option of using Websphere eXtreme Scale with Message broker. Is there any one who has used this combination before?
Thanks |
|
| Back to top |
|
 |
| lancelotlinc |
| Posted: Tue Jul 26, 2011 6:06 am Post subject: |
|
|
Jedi Knight
Joined: 22 Mar 2010
Posts: 4941
Location: Bloomington, IL USA
|
solidDB is probably a better choice. solidDB is essentially a DB2 in-memory instance. Does the same thing as Extreme Scale but allows you to access the data through mapping nodes, ESQL, etc.
_________________
http://leanpub.com/IIB_Tips_and_Tricks
Save $20: Coupon Code: MQSERIES_READER |
|
| Back to top |
|
|
| mqmatt |
| Posted: Tue Jul 26, 2011 9:03 am Post subject: |
|
|
Grand Master
Joined: 04 Aug 2004
Posts: 1213
Location: Hursley, UK
|
The key point with Extreme Scale is that the data is distributed but the cache is coherent.
There are successful implementations of using WMB V7 with WXS (or the XC10 appliance) out there; generally implemented in WMB using a JavaCompute node. My understanding is that it's pretty straightforward (famous last words).
Let us know how it goes (and remember to get a requirement logged if you find there's anything either of the products could do to make the process easier)... |
|
| Back to top |
|
|
| sudeepm |
| Posted: Tue Jul 26, 2011 9:15 pm Post subject: |
|
|
Acolyte
Joined: 31 Jan 2008
Posts: 57
|
Thanks mqmatt.
Just one more question if you can help. I was going thru online documents for eXtreme scale, it acutally combines all JVMs' memory and create a kind of grid. Do you think for MB we should be able to combine memory of all execution groups' JVM(as every execution group has separate JVM) if we use this product with MB. |
|
| Back to top |
|
|
| mqmatt |
| Posted: Wed Jul 27, 2011 3:53 am Post subject: |
|
|
Grand Master
Joined: 04 Aug 2004
Posts: 1213
Location: Hursley, UK
|
| No, you'll still have completely separate JVMs in each execution group. You choose which objects (maps) you wish to share with the grid. |
|
| Back to top |
|
|
| er_pankajgupta84 |
| Posted: Sat Jul 30, 2011 4:37 am Post subject: |
|
|
Master
Joined: 14 Nov 2008
Posts: 203
Location: charlotte,NC, USA
|
I have an requirement where i need to do a db lookup to populate some stuff in each message.
For better performance and reduce db operation I have implemented caching using static hashtables in java.
Now the same flow is deployed in different EG so i am maintaining cache in all the EG.
In future the size of cache can increase so I am exploring options of having one cache for all of my EG.
Can I use Extreme Scale for that..?
Each EG is an independent JVM so would Extreme Scale be able to share memory across JVM?
How can we update the extreme scale data? |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Sat Jul 30, 2011 7:02 am Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
| er_pankajgupta84 wrote: |
I have an requirement where i need to do a db lookup to populate some stuff in each message.
For better performance and reduce db operation I have implemented caching using static hashtables in java.
Now the same flow is deployed in different EG so i am maintaining cache in all the EG.
In future the size of cache can increase so I am exploring options of having one cache for all of my EG.
Can I use Extreme Scale for that..?
Each EG is an independent JVM so would Extreme Scale be able to share memory across JVM?
How can we update the extreme scale data? |
If you are maintaining the same cache in multiple JVM's your design is wrong.
Have the cache in a single JVM and use RMI to access it. This will give you much better memory management and will allow you to update the cache for everybody in a single operation....
AFAIK Extreme Scale will allow you to "partition" the cache among multiple JVMs acting as one when you query/update...
Have fun 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| er_pankajgupta84 |
| Posted: Sun Jul 31, 2011 11:06 pm Post subject: |
|
|
Master
Joined: 14 Nov 2008
Posts: 203
Location: charlotte,NC, USA
|
| Quote: |
| If you are maintaining the same cache in multiple JVM's your design is wrong. |
As Each EG operates independently having it's own JVM, it would be a good idea to have separate cache if the cache size is small. This will give you much faster processing with simple implementation and less network overhead.
RMI can be used but we dropped the idea of using it due to its STUB maintenance.
HAS anyone implemented RMI architecture in broker EG environment?
My initial question was - " can we use extreme scale in this context" |
|
| Back to top |
|
|
| rkford11 |
| Posted: Tue Aug 09, 2011 6:04 am Post subject: |
|
|
Partisan
Joined: 06 Jun 2004
Posts: 316
|
Sudeep,
Were you able to integrate Message Broker with Extreme scale. We have a similar requirment, and after installing Extreme scale in a stand alone environment, we are trying to figure out the integration between message broker and Extreme scale.
Thanks |
|
| Back to top |
|
|
| mqjeff |
| Posted: Tue Aug 09, 2011 6:08 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
| rkford11 wrote: |
Sudeep,
Were you able to integrate Message Broker with Extreme scale. We have a similar requirment, and after installing Extreme scale in a stand alone environment, we are trying to figure out the integration between message broker and Extreme scale.
Thanks |
I believe that the current integration method is to use a JavaCompute node and write Java code to interact with ExtremeScale. |
|
| Back to top |
|
|
| er_pankajgupta84 |
| Posted: Tue Aug 09, 2011 7:07 am Post subject: |
|
|
Master
Joined: 14 Nov 2008
Posts: 203
Location: charlotte,NC, USA
|
|
| Back to top |
|
|
|
|
