| |
|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
  |
|
| Design issue around retrieving number of rows from database |
« View previous topic :: View next topic » |
| Author |
Message
|
| prasadpav |
 Posted: Tue Oct 11, 2005 1:29 am Post subject: Design issue around retrieving number of rows from database |
 |
|
Centurion
Joined: 03 Oct 2004
Posts: 142
|
Hi,
In my message broker flow (V5), I'm retrieving data from oracle database. The message flow is started by a trigger message, which is just a dummy message put by cron. Normally, my message size doesn't exceed the MQ message size (4MB), but in the event of any database being down or if for some reason number of records in database gets accumulated, then next time when I start reading the records from the database, then it is certain that it is going to fail because it exceeds 4MB. So, I think the safest approach always is to retrieve first 100 rows (just example) from database or increase the size of the queue. Any comments or thoughts on how best we can design for this case?
Thanks,
Prasad |
|
| Back to top |
|
 |
| javaforvivek |
| Posted: Tue Oct 11, 2005 2:31 am Post subject: |
|
|
Master
Joined: 14 Jun 2002
Posts: 282
Location: Pune,India
|
There are a couple of things you should consider -
1) You have thought of increasing the default message size on your queue. But, too big a message will cause your msg flow to perform badly.
2) How would you decide the number of rows you will fetch at a time? It will also depend upon what is the size of each row you are fetching..
3) Again, from your example, you are fetching 100 rows at a time.. if your database has accumulated 1000 rows, you will generate 10 different messages and put them on a output queue. But is it what you finally needed? Or your output should be a combined message of 1000 rows? i.e., you need to do some aggregation on these 10 messages.
I think your approach looks ok, but do consider these questions.
_________________
Vivek
------------------------------------------------------
...when you have eliminated the impossible, whatever remains, however improbable, must be the truth. |
|
| Back to top |
|
|
|
|
|
| |
|
Page 1 of 1 |
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
