| Author |
Message
|
| sebastia |
 Posted: Fri Feb 04, 2011 7:07 am Post subject: mq v 7.0.1.4 writes lots of FDC "task ERROR-LOG started |
 |
|
Grand Master
Joined: 07 Oct 2004
Posts: 1003
|
Hi - I have a brand new MQ v 7.0.1.4 on PPC64.
As we are still on install fase, there is no data flowing thru the QMgr (one defined).
But I have found that every 1 second, 2 or 3 *.FDC messages are written into /var/mqm/errors.
All of them contain a probe saying
"queue manager task NNN has started",
where NNN can be either STATISTICS, or ERROR-LOG or APP-SIGNAL.
No other ones are written.
Finaly, all filesystem (135 GB) did fill up, so I had to erase them, but they keep on coming back ...
FP4 just applied ... Dont know what else to do.
Any ideas ? Sebastian. |
|
| Back to top |
|
 |
| exerk |
| Posted: Fri Feb 04, 2011 7:15 am Post subject: |
|
|
Jedi Council
Joined: 02 Nov 2006
Posts: 6339
|
What's coming up in the Probe ID of the FDCs?
_________________
It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys. |
|
| Back to top |
|
|
| mqjeff |
| Posted: Fri Feb 04, 2011 7:17 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
| What's the header of the FDC? |
|
| Back to top |
|
|
| sebastia |
| Posted: Fri Feb 04, 2011 11:03 am Post subject: |
|
|
Grand Master
Joined: 07 Oct 2004
Posts: 1003
|
You will have to wait until Monday, gentlemen, as I am already at home and starting to enjoy the weekend.
Yes, you are right I should have posted those data in the first post, but as I already know, "we are not perfect".
Thanks for your support, coleagues. Sebastian. |
|
| Back to top |
|
|
| mqjeff |
| Posted: Fri Feb 04, 2011 11:12 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
| Say hi to the lovely ladies on Bondi for those of us stuck in the snow. |
|
| Back to top |
|
|
| Vitor |
| Posted: Fri Feb 04, 2011 11:16 am Post subject: |
|
|
Grand High Poobah
Joined: 11 Nov 2005
Posts: 26093
Location: Texas, USA
|
Hey, it's so hot here the ice is melting.....
_________________
Honesty is the best policy.
Insanity is the best defence. |
|
| Back to top |
|
|
| mvic |
| Posted: Sun Feb 06, 2011 6:56 am Post subject: Re: mq v 7.0.1.4 writes lots of FDC "task ERROR-LOG sta |
|
|
Jedi
Joined: 09 Mar 2004
Posts: 2080
|
| sebastia wrote: |
Finaly, all filesystem (135 GB) did fill up, so I had to erase them, but they keep on coming back ...
FP4 just applied ... Dont know what else to do.
Any ideas ? Sebastian. |
Did you open a PMR with IBM?
Save up a few of those files and send them in to IBM, let them work on it. |
|
| Back to top |
|
|
| sebastia |
| Posted: Mon Feb 07, 2011 5:19 am Post subject: |
|
|
Grand Master
Joined: 07 Oct 2004
Posts: 1003
|
Winter's gone ... 20+º again, ... blue sky ... nice beach ... tennis court ... jeje
PMR : yes, today I shall do that, obviously.
FDC : here it is ..
Thanks. Sebastian.
+++++++++++++++++++++++++++++
+-----------------------------------------------------------------------------+
| |
| WebSphere MQ First Failure Symptom Report |
| ========================================= |
| |
| Date/Time :- Mon February 07 2011 14:07:50 CET |
| UTC Time :- 1297084070.962864 |
| UTC Time Offset :- 60 (CET) |
| Host Name :- p9111-520 |
| Operating System :- Linux 2.6.16.21-0.8-ppc64 |
| PIDS :- 5724H7227 |
| LVLS :- 7.0.1.4 |
| Product Long Name :- WebSphere MQ for Linux (POWER platform) |
| Vendor :- IBM |
| Probe Id :- XC022001 |
| Application Name :- MQM |
| Component :- xcsDisplayMessage |
| SCCS Info :- lib/cs/amqxeida.c, 1.106.1.6 |
| Line Number :- 4956 |
| Build Date :- Jan 17 2011 |
| CMVC level :- p701-104-110114 |
| Build Type :- IKAP - (Production) |
| Effective UserID :- 103 (mqm) |
| Real UserID :- 1000 (sebas) |
| Program Name :- amqzmur0 |
| Addressing mode :- 64-bit |
| Process :- 10555 |
| Process(Thread) :- 10559 |
| Thread :- 5 |
| ThreadingModel :- PosixThreads |
| UserApp :- FALSE |
| ConnId(1) IPCC :- 170950 |
| ConnId(2) QM :- 170878 |
| Last HQC :- 1.0.0-1038200 |
| Last HSHMEMB :- 0.0.0-0 |
| Major Errorcode :- zrcX_TASK_STARTED |
| Minor Errorcode :- OK |
| Probe Type :- MSGAMQ5037 |
| Probe Severity :- 4 |
| Probe Description :- AMQ5037: The Queue Manager task 'ERROR-LOG' has |
| started. |
| FDCSequenceNumber :- 0 |
| Arith1 :- 10555 (0x293b) |
| Arith2 :- 1 (0x1) |
| Comment1 :- ERROR-LOG |
| Comment2 :- Restartable |
| |
+-----------------------------------------------------------------------------+ |
|
| Back to top |
|
|
| exerk |
| Posted: Mon Feb 07, 2011 5:26 am Post subject: |
|
|
Jedi Council
Joined: 02 Nov 2006
Posts: 6339
|
There are a few hits on that Probe ID, one of which has an eye-catcher of "...Check the bottom of the FDC that has the XC022001 probe. There should be a file listed that the open is failing on...", but THIS may be closer.
_________________
It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys. |
|
| Back to top |
|
|
| sebastia |
| Posted: Mon Feb 07, 2011 6:19 am Post subject: |
|
|
Grand Master
Joined: 07 Oct 2004
Posts: 1003
|
Your "blue" link points to ... "Fix Pack 7.0.1.5" !!!
Yes, the problem description is very similar to mine : "FDCs were created approximately once per minute for several hours."
Thanks ! |
|
| Back to top |
|
|
| sebastia |
| Posted: Tue Feb 08, 2011 3:55 am Post subject: |
|
|
Grand Master
Joined: 07 Oct 2004
Posts: 1003
|
Here is the solution, dear coleagues:
I did a trace and found :
+ + +
12:14:25.529793 10597.6 : Opening log file '/var/mqm/qmgrs/P9111/errors/AMQERR01.LOG' with flags 0x2, permissions 0x1B0
12:14:25.529816 10597.6 : ---}! xeeOpenFiles rc=xecP_E_ACCESS_DENIED
+ + +
So thread "amqzmur0" was crashing ans being restarted
The problem was evident :
+ + +
p9111-520:/var/mqm/qmgrs/P9111/errors # ls -l
total 4
-rw-r--r-- 1 sebas mqm 2 Feb 2 10:55 AMQERR01.LOG
-rw-rw---- 1 mqm mqm 0 Jan 12 23:50 AMQERR02.LOG
-rw-rw---- 1 mqm mqm 0 Jan 12 23:50 AMQERR03.LOG
+ + +
And the solution, easy :
p9111-520:/var/mqm/qmgrs/P9111/errors # chown mqm:mqm AMQERR01.LOG
Bye !
PD.- dont ask who changed the file ownership ... Yes, it was me. |
|
| Back to top |
|
|
| exerk |
| Posted: Tue Feb 08, 2011 4:00 am Post subject: |
|
|
Jedi Council
Joined: 02 Nov 2006
Posts: 6339
|
| sebastia wrote: |
| ...I did a trace and found... |
Why? I stated that:
| Quote: |
| There are a few hits on that Probe ID, one of which has an eye-catcher of "...Check the bottom of the FDC that has the XC022001 probe. There should be a file listed that the open is failing on..." |
Was it not listed?
_________________
It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys. |
|
| Back to top |
|
|
| sebastia |
| Posted: Tue Feb 08, 2011 4:10 am Post subject: |
|
|
Grand Master
Joined: 07 Oct 2004
Posts: 1003
|
mr EXERC :
the truth is that as the filesystem was filled up with FDCs (each 17 MB size), I had a cron deleting any FDC file every 15 minutes ... and there was a LARGE FDC saying .. "there are FDCs missing here ..."
I am absolutely sure your pointer is correct !
Sebastian. |
|
| Back to top |
|
|
| exerk |
| Posted: Tue Feb 08, 2011 4:16 am Post subject: |
|
|
Jedi Council
Joined: 02 Nov 2006
Posts: 6339
|
I was more concerned to confirm that it does appear in the FDC - I always have a concern with 'official' documentation that states should rather than will 
_________________
It's puzzling, I don't think I've ever seen anything quite like this before...and it's hard to soar like an eagle when you're surrounded by turkeys. |
|
| Back to top |
|
|
| mvic |
| Posted: Tue Feb 08, 2011 4:16 am Post subject: |
|
|
Jedi
Joined: 09 Mar 2004
Posts: 2080
|
| exerk wrote: |
| sebastia wrote: |
| ...I did a trace and found... |
Why? |
OP was doing investigation of his own. This is the sort of thing we usually like to encourage.
Your advice may have been right, but, since most of us only post as pseudonyums here, and we don't explain our credentials, we should expect our posts to be overlooked some of the time. |
|
| Back to top |
|
|
|
|
