| Author |
Message
|
| mahesh4eai |
 Posted: Tue Jan 27, 2015 12:46 am Post subject: Trying to fix the issue but don't know where is the problem |
 |
|
Novice
Joined: 09 Aug 2014
Posts: 21
|
Hi All,
Please help me for below issue.
Issue:
I have deployed my message flow in Dev server.I have passed the 60 MB file as input and tested the flow in Dev server it is taking 2 hours(Earlier it was taking 20 mins only for 60 MB file).I deployed the same flow in my local machine and local broker(MB8BROKER) and tested it is taken 20 mins only.I have surprised bit why it is taking so much time in Dev Server compare to local broker.I am expecting the file need to be passed in 20 mins in Dev server as well.I have increased the heap size and restarted the broker in Dev server but i did not get any luck.I had stopped the remaining flows in Dev server and only my flow is running in Dev server,but i did not get any luck.
Please help me for how to resolve this issue. |
|
| Back to top |
|
 |
| ruimadaleno |
| Posted: Tue Jan 27, 2015 1:32 am Post subject: |
|
|
Master
Joined: 08 May 2014
Posts: 274
|
do you have some kind of tracing enabled ? like trace nodes ? or service trace ? user trace ? is this info written to disk ?
what are the differences between you local broker and DEV broker ?
same version ? same OS ?
how about the load ? how many projects deployed and running in DEV (while in you local broker you are running only one project )?
_________________
Best regards
Rui Madaleno |
|
| Back to top |
|
|
| mahesh4eai |
| Posted: Tue Jan 27, 2015 1:39 am Post subject: |
|
|
Novice
Joined: 09 Aug 2014
Posts: 21
|
| local broker is running on window 7 and Dev broker(remote broker)is running on Unix.Both of have same message broker version 8.For both local broker and dev server only my flow is running and remain flows are stopped and deleted in Execution group. |
|
| Back to top |
|
|
| kimbert |
| Posted: Tue Jan 27, 2015 5:17 am Post subject: |
|
|
Jedi Council
Joined: 29 Jul 2003
Posts: 5542
Location: Southampton
|
|
| Back to top |
|
|
| mahesh4eai |
| Posted: Tue Jan 27, 2015 11:22 pm Post subject: |
|
|
Novice
Joined: 09 Aug 2014
Posts: 21
|
| Message flow is doing for merge the files from two different environments(one file from is file input node directory environment and second file is file read node directory environment) and put in file output node directory.I am using DFDL message model and parsing the 60 MB file at a time.The inputfile format is .dat format. |
|
| Back to top |
|
|
| kimbert |
| Posted: Wed Jan 28, 2015 4:05 am Post subject: |
|
|
Jedi Council
Joined: 29 Jul 2003
Posts: 5542
Location: Southampton
|
| Quote: |
| are you processing the file one record at a time |
You did not answer this question.
If you are parsing a 60Mb file then you will be using ~600Mb of memory to store the resulting message tree. If you are also parsing another large file in the same message flow then your memory usage could be >1Gb. Using a lot of memory can slow down a message flow.
| Quote: |
| Message flow is doing for merge the files from two different environments |
It would be easy to do that the wrong way. Can you ( briefly ) describe how the merge is done?
| Quote: |
| one file from is file input node directory environment and second file is file read node directory environment |
Is the FileRead node in your message flow called multiple times, in a loop?
_________________
Before you criticize someone, walk a mile in their shoes. That way you're a mile away, and you have their shoes too. |
|
| Back to top |
|
|
|
|
