MQSeries.net :: View topic - 1 MQ Message Per File Vs 1 MQ Message Per Record (MRM Transf

kirani · Posted: Wed Nov 21, 2001 1:40 pm Post subject:

Hi folks,

We would like to transform records in a flat file using MQSI. The input and output formats are created in MRM. An adapter will read the file and put it on a queue.

We have two options to do this transformation,
1. Putting one message per record.
2. Putting one message per file.

I would like to know which method is best with the Pros and Cons of each.

I came up with following points,

One Message per File
Pros
1. More data can be processed at once.
2. Reduces Network traffic.

Cons
1. File needs to be edited such that MQ Message size will not exceed 100MB.
2. Two stage processing may be required to handle different types of records in a file.
3. Counter field needs to be added to the MQ Message, which will hold the record count for MRM parsing.
4. All records will rollback if any error occurs during file processing.

One Message per Record
Pros
1. Easy to parse. We don't need 2 stage processing.
2. File need not be edited.
3. As long as the record size is less than 100 MB we donâ€™t have to do any editing.
4. Transactions can be maintained at record level.

Cons
1. MQ adds its own data with each message while transmitting over network. This could be an overhead if the record length is very small (90 bytes or so).
2. Processing time may increase.
3. Increases Network traffic.

What would be the best solution for handling this type of problem?

Thanks.

Regards,
Kiran