| |
|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
  |
|
| Temporary FTE Agent |
« View previous topic :: View next topic » |
| Author |
Message
|
| jhan100 |
 Posted: Fri Aug 01, 2014 7:28 am Post subject: Temporary FTE Agent |
 |
|
Newbie
Joined: 01 Aug 2014
Posts: 5
Location: Brazil, DF
|
Hi all,
I would like to know whether can I use a static/fixed FTE Agent to receive my files ? I am afraid, if when I have an error in my flow/broker node I must stop my file receiving application feature.
Also there's a dev concern that we're using the transfer id from FTE in other nodes/objects internally in the flow, so using an other kind of "file receptionist" is not allowed.
I need FTE Input, but I don't want a temporary FTE Agent.
Thanks! |
|
| Back to top |
|
 |
| mqjeff |
| Posted: Fri Aug 01, 2014 7:29 am Post subject: |
|
|
Grand Master
Joined: 25 Jun 2008
Posts: 17447
|
| Use regular FileInput, and use an external FTE client to put files where FileInput can read from. |
|
| Back to top |
|
|
| jhan100 |
| Posted: Fri Aug 01, 2014 8:05 pm Post subject: |
|
|
Newbie
Joined: 01 Aug 2014
Posts: 5
Location: Brazil, DF
|
Hi Jeff,
1. Well, we're processing big files (500MB - 1GB) isn't there any limit in FileInput node ? I've heard from a dev that there's this kind of limit and its size is 100mb (max queue size).
2. Antoher question that just came up today is that while a few file processing tests we're getting 100% of CPU utilization(is that normal ?). Is there any way of limiting CPU utilization in IIB9 ?
The developer is not putting the lines of the file into the queue, so I am not able to use the new WorkLoadManager feature, to capping the message flow 'power/throughput'.
p.s
Right now in test env, we're just using a simple intel core x86 proc.
The sysctl.conf, ulimits and mq.ini tuning was done already.
Thank you! |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Fri Aug 01, 2014 9:05 pm Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
| jhan100 wrote: |
Hi Jeff,
1. Well, we're processing big files (500MB - 1GB) isn't there any limit in FileInput node ? I've heard from a dev that there's this kind of limit and its size is 100mb (max queue size).
|
Not quite. You can process up to 2 GB files with the large message technique. Beyond 2 GB you cannot use "whole file" but must use either parsed record, or delimited... However if you do put your outbound message on a queue then your outbound size limit is still 100 MB.
| jhan100 wrote: |
2. Antoher question that just came up today is that while a few file processing tests we're getting 100% of CPU utilization(is that normal ?). Is there any way of limiting CPU utilization in IIB9 ?
The developer is not putting the lines of the file into the queue, so I am not able to use the new WorkLoadManager feature, to capping the message flow 'power/throughput'.
p.s
Right now in test env, we're just using a simple intel core x86 proc.
The sysctl.conf, ulimits and mq.ini tuning was done already.
Thank you! |
Well the main work in the file input (and or subsequent nodes if parsing on demand) is the parsing, and that is CPU intensive. Did you also verify the message rate achieved during that 100% CPU hit? (message flow statistics should be able to help you out there).
Have fun 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| jhan100 |
| Posted: Sat Aug 02, 2014 5:24 am Post subject: |
|
|
Newbie
Joined: 01 Aug 2014
Posts: 5
Location: Brazil, DF
|
Well while using 1 processor de average was about 1350 msgs/second. But that average was based in the amount of lines that a huge file had and the amount of time used to process.
As I said, the developer is not unloading the file into a queue. He's processing it directly and I didn't find a way to explicity monitoring it msg/msg from broker statistics.
Anyway, I would like to say thanks by the help and doubts cleared. I will keep searching a way to improve its monitoring by using tivoli or monitor.
Thanks! |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Sat Aug 02, 2014 7:54 am Post subject: |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
| jhan100 wrote: |
Well while using 1 processor de average was about 1350 msgs/second. But that average was based in the amount of lines that a huge file had and the amount of time used to process.
As I said, the developer is not unloading the file into a queue. He's processing it directly and I didn't find a way to explicity monitoring it msg/msg from broker statistics.
Anyway, I would like to say thanks by the help and doubts cleared. I will keep searching a way to improve its monitoring by using tivoli or monitor.
Thanks! |
If you are trying to improve performance and are looking for bottlenecks try support pack IS03...
_________________
MQ & Broker admin |
|
| Back to top |
|
|
| jhan100 |
| Posted: Sun Aug 03, 2014 4:42 pm Post subject: |
|
|
Newbie
Joined: 01 Aug 2014
Posts: 5
Location: Brazil, DF
|
Sure, thanks by the SupportPack and all the support/replys.
Regards! |
|
| Back to top |
|
|
|
|
|
| |
|
Page 1 of 1 |
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
