| |
|
RSS Feed - WebSphere MQ Support
|
RSS Feed - Message Broker Support
|
  |
|
| Process TAR file using Broker Flow |
« View previous topic :: View next topic » |
| Author |
Message
|
| CuriCAT |
 Posted: Wed Feb 01, 2012 12:52 pm Post subject: Process TAR file using Broker Flow |
 |
|
Voyager
Joined: 26 Sep 2006
Posts: 82
|
Hi Folks,
I need to build a solution using WMB message flow for a requirement.
Requirement:
System A will send TAR files to WMB server, WMB message flow has to untar and process bunch of files inside TAR file, finaly transmit the data to 4 other systems (which uses different protocols webservice, ftp & MQ and data has to be sent in different formats too XML, CSV and COBOL formated).
I am considering following solutions:
1) Use Java compute node to do untar TAR file .
- One message flow to untar and One flow to process the files inside.
2) Use UNIX script to UNTAR files ,
- Single message flow will process the files after shell script untar and store files into the folder
3) Use any fix packs or user defined wmb nodes if available.
Greatly appreciate if any advices/best practices or your expertise.
Thank you so much |
|
| Back to top |
|
 |
| lancelotlinc |
| Posted: Wed Feb 01, 2012 1:13 pm Post subject: |
|
|
Jedi Knight
Joined: 22 Mar 2010
Posts: 4941
Location: Bloomington, IL USA
|
IMHO, Option 1 is better than Option 2 because you can handle the errors from one runtime (WMB - ESB ). Apache Commons has some nice file system utilities.
_________________
http://leanpub.com/IIB_Tips_and_Tricks
Save $20: Coupon Code: MQSERIES_READER |
|
| Back to top |
|
|
| CuriCAT |
| Posted: Wed Feb 01, 2012 1:26 pm Post subject: |
|
|
Voyager
Joined: 26 Sep 2006
Posts: 82
|
Thanks for your response!
Do I need to restrict on max file size limit, like 250MB, otherwise EG or JVM heap may encouter memory issues while java compute node untar the file?. |
|
| Back to top |
|
|
| lancelotlinc |
| Posted: Wed Feb 01, 2012 1:59 pm Post subject: |
|
|
Jedi Knight
Joined: 22 Mar 2010
Posts: 4941
Location: Bloomington, IL USA
|
|
| Back to top |
|
|
| CuriCAT |
| Posted: Thu Feb 02, 2012 7:09 am Post subject: |
|
|
Voyager
Joined: 26 Sep 2006
Posts: 82
|
Sorry, I didn't get it. Are you saying it doesn't make any sence, can i process any large (few GB) tar fileS with java compute node?.
"Sounds like a great defensive driving tip to me !" |
|
| Back to top |
|
|
| lancelotlinc |
| Posted: Thu Feb 02, 2012 7:51 am Post subject: |
|
|
Jedi Knight
Joined: 22 Mar 2010
Posts: 4941
Location: Bloomington, IL USA
|
In the US, defensive driving means looking out for the other girl when the other girl is not looking at you.
In the Philippines, defensive driving means smiling at the other guy as you merge into his lane. Head-on-a-swivel. Fenders two centimeters apart.
You can process as large files as you want. If your chosen file system library uses disk rather than memory, your better off for the larger files.
If you want to protect your code, put a limit on file size, and error out for files that exceed that size.
_________________
http://leanpub.com/IIB_Tips_and_Tricks
Save $20: Coupon Code: MQSERIES_READER |
|
| Back to top |
|
|
|
|
|
| |
|
Page 1 of 1 |
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
