| Author |
Message
|
| Devasis.Sahu |
 Posted: Thu Jul 13, 2006 10:09 pm Post subject: Batch Processing |
 |
|
Apprentice
Joined: 22 Feb 2003
Posts: 43
Location: India
|
Hi All,
We have the following requirments mentioned below:
1. Sys A (Source System) , SYS B (Target System).
2. The inputs to SYS A ---> from multiple systems in different file formats (For simplicity
we will consider XML as of now).
3. The Data needs to be transformed and needs to be sent to target System(S) in the same format
or in different formats.
4. The mode of operation is mostly batch processing instead of online processing. When i say batch
processing, it means that bulk data needs be processed at one go and sent to the target systems.
My question now is ...whats the correct way to approach this problem.
The thought process is .
scenario1:
==========
1. Have a Message Broker / ESB sitting between the SYS (A) and SYS(B) which will do the message
processing and necessary filtering.
2. Have Adapters for SYS(B) and SYS(A) [for receiving system] which can convert the data to the
required format.
Scenario2:
==========
1. Have all the logic built in the Adapters.
Also, if anybody can help me understand when to use MB and when to use ESB, it will be gr8.
Please suggest.
do let me know in case more visibility is required.
Regds |
|
| Back to top |
|
 |
| ashoon |
| Posted: Fri Jul 14, 2006 3:55 am Post subject: a few thoughts |
|
|
Master
Joined: 26 Oct 2004
Posts: 235
|
comparing MB to ESB...
ESB is WS-* conformant
ESB can easily lead to WPS (BPEL engine)
ESB is only XML based (handling non-XML data will either require code or the use of WTX callable node however MB has the same capability)
ESB has JCA adapter capabilities
you mentioned your input/output is files... if these files come in any format (not only XML) then I'd suggest your best bet is to use the MB for transformation.
RE: 'adapter' - in your above scenario why can't the adapter be an MB flow as well??? Typical pattern I've seen used is one MB flow transforms from one format to a canonical format and then have another flow route the message, and finally a 3rd flow to reshape the message to reciever's format. and Yes you're doing more parsing/it's less performant however for a true asynch. architecture who requires the ability to change endpoints without affecting other components this is a good concept. |
|
| Back to top |
|
|
| Devasis.Sahu |
| Posted: Mon Jul 17, 2006 1:07 am Post subject: batch processing |
|
|
Apprentice
Joined: 22 Feb 2003
Posts: 43
Location: India
|
Hi All,
Referring to the above discussion, we have a requirement wherein
Inbound Integration
=============
1. SAP needs to be fed with XML Data from a data source. The processing would happen in Batch Mode.
Within Systems integration
==================
2. SAP and Siebel integration also would happen in Batch mode.
Other reqmt:
1. Obviously SAP and Siebel Adapter would be involved in the transaction. However, there must be a brokering layer in between which would connect the adapter on both the sides.
Question:
1. What are the special considerations one needs to take for designing the EAI layer given the above considerations ?
2. Whats the Architecture we need to follow ?
3. What is the best middleware we can use in this Scenario ?
Expert comments and Suggestions would surely help.
Regds |
|
| Back to top |
|
|
| ashoon |
| Posted: Mon Jul 17, 2006 6:17 pm Post subject: why batch??? |
|
|
Master
Joined: 26 Oct 2004
Posts: 235
|
| why not use an ESB product and adapters to trickle feed information from one system to another... I'd suggest that IBM's WebSphere ESB and corresponding JCA adapters for SAP and Siebel be used. |
|
| Back to top |
|
|
| Devasis.Sahu |
| Posted: Tue Jul 18, 2006 1:05 am Post subject: Batch Processing |
|
|
Apprentice
Joined: 22 Feb 2003
Posts: 43
Location: India
|
Hi Ashoon,
Thanx for the suggestion. However, are u aware of any ESB installations with similar environment which is capable of batch processing capabilties.
Regds. |
|
| Back to top |
|
|
| fjb_saper |
| Posted: Tue Jul 18, 2006 3:19 am Post subject: Re: Batch Processing |
|
|
Grand High Poobah
Joined: 18 Nov 2003
Posts: 20756
Location: LI,NY
|
| Devasis.Sahu wrote: |
Hi Ashoon,
Thanx for the suggestion. However, are u aware of any ESB installations with similar environment which is capable of batch processing capabilties.
Regds. |
Wrong question. SAP and Siebel are essentially online processing apps. Yes they can process batches but have been optimized for online processing. You should do the same.
Enjoy 
_________________
MQ & Broker admin |
|
| Back to top |
|
|
|
|
