| Author |
Message
|
| 4integration |
 Posted: Wed Apr 25, 2007 3:16 am Post subject: Propagate many messages (> 5000) |
 |
|
Disciple
Joined: 04 Sep 2006
Posts: 197
Location: Gothenburg, Sweden
|
Hello,
We have cases when a large message are processed in WMB 6 and the message are divided into many smaller pieces ( worst case is 100.000 msgs).
When running propagate on the smaller pieces it works fine up to 4999 msgs, then the transactions fails and rolls back the large message to the error queue.
The receiving queue have a max queue depth to 100.000.
Any ideas?
_________________
Best regards
4 Integration |
|
| Back to top |
|
 |
| marcin.kasinski |
| Posted: Wed Apr 25, 2007 3:25 am Post subject: Re: Propagate many messages (> 5000) |
|
|
Sentinel
Joined: 21 Dec 2004
Posts: 850
Location: Poland / Warsaw
|
Any errors in logs ?
What is size of input messages ?
Is output queue local or remote ?
_________________
Marcin |
|
| Back to top |
|
|
| 4integration |
| Posted: Wed Apr 25, 2007 3:34 am Post subject: |
|
|
Disciple
Joined: 04 Sep 2006
Posts: 197
Location: Gothenburg, Sweden
|
- No errors in Windows event log.
- The input message is 34.5 MB.
- The output queue is local.
The tester can see that messages are created on the output queue but when it reaches 4999 it's rolling back.
_________________
Best regards
4 Integration |
|
| Back to top |
|
|
| marcin.kasinski |
| Posted: Wed Apr 25, 2007 3:35 am Post subject: |
|
|
Sentinel
Joined: 21 Dec 2004
Posts: 850
Location: Poland / Warsaw
|
I was talking about MQ logs.
PS. Try to test it with smaller input message to see if 4999 is limit.
I mean prepare 2 * smaller input message.
Test if problem occurs with message number 4999 or 2 * 4999
But first read MQ logs !!!
_________________
Marcin |
|
| Back to top |
|
|
| Vitor |
| Posted: Wed Apr 25, 2007 3:54 am Post subject: Re: Propagate many messages (> 5000) |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| 4integration wrote: |
When running propagate on the smaller pieces it works fine up to 4999 msgs, then the transactions fails and rolls back the large message to the error queue.
|
Is 5000 your maximum uncommitted message limit?
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| marcin.kasinski |
| Posted: Wed Apr 25, 2007 3:57 am Post subject: Re: Propagate many messages (> 5000) |
|
|
Sentinel
Joined: 21 Dec 2004
Posts: 850
Location: Poland / Warsaw
|
| Vitor wrote: |
Is 5000 your maximum uncommitted message limit? |
I bet yes ... 
_________________
Marcin |
|
| Back to top |
|
|
| 4integration |
| Posted: Wed Apr 25, 2007 4:02 am Post subject: Re: Propagate many messages (> 5000) |
|
|
Disciple
Joined: 04 Sep 2006
Posts: 197
Location: Gothenburg, Sweden
|
| Vitor wrote: |
| 4integration wrote: |
When running propagate on the smaller pieces it works fine up to 4999 msgs, then the transactions fails and rolls back the large message to the error queue.
|
Is 5000 your maximum uncommitted message limit? |
No, it's 100.000 
_________________
Best regards
4 Integration |
|
| Back to top |
|
|
| 4integration |
| Posted: Wed Apr 25, 2007 4:03 am Post subject: |
|
|
Disciple
Joined: 04 Sep 2006
Posts: 197
Location: Gothenburg, Sweden
|
| marcin.kasinski wrote: |
I was talking about MQ logs.
PS. Try to test it with smaller input message to see if 4999 is limit.
I mean prepare 2 * smaller input message.
Test if problem occurs with message number 4999 or 2 * 4999
But first read MQ logs !!! |
MQ logs doesn't contain anything.
_________________
Best regards
4 Integration |
|
| Back to top |
|
|
| marcin.kasinski |
| Posted: Wed Apr 25, 2007 4:06 am Post subject: Re: Propagate many messages (> 5000) |
|
|
Sentinel
Joined: 21 Dec 2004
Posts: 850
Location: Poland / Warsaw
|
| 4integration wrote: |
| Vitor wrote: |
| 4integration wrote: |
When running propagate on the smaller pieces it works fine up to 4999 msgs, then the transactions fails and rolls back the large message to the error queue.
|
Is 5000 your maximum uncommitted message limit? |
No, it's 100.000 |
You mentioned that 100.000 is max message depth.
Are you sure that maximum uncommitted message is 100.000 to ?
_________________
Marcin |
|
| Back to top |
|
|
| marcin.kasinski |
| Posted: Wed Apr 25, 2007 4:08 am Post subject: |
|
|
Sentinel
Joined: 21 Dec 2004
Posts: 850
Location: Poland / Warsaw
|
| 4integration wrote: |
MQ logs doesn't contain anything. |
I dont believe you
There is error and there should be error message in MQ logs.
_________________
Marcin |
|
| Back to top |
|
|
| Vitor |
| Posted: Wed Apr 25, 2007 4:19 am Post subject: Re: Propagate many messages (> 5000) |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| 4integration wrote: |
| Vitor wrote: |
| 4integration wrote: |
When running propagate on the smaller pieces it works fine up to 4999 msgs, then the transactions fails and rolls back the large message to the error queue.
|
Is 5000 your maximum uncommitted message limit? |
No, it's 100.000 |
You have your maximum uncommitted messages set to your maximum queue depth????? 
That's a LOT of log space.....
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| Vitor |
| Posted: Wed Apr 25, 2007 4:21 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
| 4integration wrote: |
| marcin.kasinski wrote: |
I was talking about MQ logs.
PS. Try to test it with smaller input message to see if 4999 is limit.
I mean prepare 2 * smaller input message.
Test if problem occurs with message number 4999 or 2 * 4999
But first read MQ logs !!! |
MQ logs doesn't contain anything. |
If there's no MQ error (which is somewhat unexpected) then you may need to trace the broker to see what's prompting it to roll back.
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| EddieA |
| Posted: Wed Apr 25, 2007 9:43 am Post subject: |
|
|
Jedi
Joined: 28 Jun 2001
Posts: 2453
Location: Los Angeles
|
| marcin.kasinski wrote: |
I dont believe you
There is error and there should be error message in MQ logs. |
Not if it was just an MQ return code, like reaching Max Uncommited messages. Then, the Broker should log the response, but not MQ.
Cheers,
_________________
Eddie Atherton
IBM Certified Solution Developer - WebSphere Message Broker V6.1
IBM Certified Solution Developer - WebSphere Message Broker V7.0 |
|
| Back to top |
|
|
| marcin.kasinski |
| Posted: Wed Apr 25, 2007 9:51 am Post subject: |
|
|
Sentinel
Joined: 21 Dec 2004
Posts: 850
Location: Poland / Warsaw
|
| EddieA wrote: |
| marcin.kasinski wrote: |
I dont believe you
There is error and there should be error message in MQ logs. |
Not if it was just an MQ return code, like reaching Max Uncommited messages. Then, the Broker should log the response, but not MQ.
Cheers, |
Really ?
I thought this kind of errors is placed in error log.
_________________
Marcin |
|
| Back to top |
|
|
| Maximreality |
| Posted: Tue May 01, 2007 4:40 am Post subject: Re: Propagate many messages (> 5000) |
|
|
Acolyte
Joined: 04 Jun 2004
Posts: 65
Location: Copenhagen
|
| 4integration wrote: |
Hello,
We have cases when a large message are processed in WMB 6 and the message are divided into many smaller pieces ( worst case is 100.000 msgs).
When running propagate on the smaller pieces it works fine up to 4999 msgs, then the transactions fails and rolls back the large message to the error queue.
The receiving queue have a max queue depth to 100.000.
Any ideas? |
This is related to the setting "Max uncomitted messages" on your queue manager. It is a global setting for the queue manager and you need to restart it if you change the value.
I can create 100.000 messages using propagate in one transaction, on MB v6 running on my laptop.
/Rasmus |
|
| Back to top |
|
|
|
|
